I always thought the lore was that they could not see themselves in a mirror and that was misinterpreted as they did not have a reflection. First one could just be a mental block or they just don’t recognize their reflections as themselves.

Now there’s some sad things known to man
But ain’t too much sadder than the tears of a clown
When there’s no one around

– Smokey Robinson