Is it possible that what we define as physical beauty in a person is less viable genetically?

For most animals, there's a balance between survival and sexual selection.  A famous experiment with guppies showed that in the absence of predators, they developed brilliant coloration for sexual selection.  In the presence of predators, they were all drab grey to match their surroundings for camouflage.  For humans, simplistic biological evolution is no longer the dominant deciding factor.