Pop diva Madonna says she used to "loiter like some weirdo" in front of the building where late socialite Wallis Simpson used to live.

Madonna. PICs/AFP

The 53-year-old is making her directorial debut with "W.E", a story about the American mistress of King George VI whom he gave up the throne to marry in 1936, and admits the building where Simpson used live fascinated her.