The problem is that women are less likely or totally refuse to ask men out.  If you get all your dates by passively attracting people rather than taking an active role, you have to worry about your looks a lot more because your looks are the main way you're going to find a partner.