If the heart is devoid of the love and remembrance of the Most Merciful, and is a stranger to speaking to Him, it will be filled with love of women, images and listening to music.
Shaykh al-Islam Ibn Taymiyah (may Allaah have mercy on him) said in Majmoo’ al-Fataawa (10/135):
If the heart loves Allaah alone and is sincerely devoted to Him, it will not even think of loving anyone else in the first place, let alone falling in love. When a heart falls in love, that is due to the lack of love for Allaah alone. Hence because Yoosuf loved Allaah and was sincerely devoted to Him, he did not fall into the trap of love, rather Allaah says (interpretation of the meaning):