Please know that those comments are NOT your fault. People who gossip about someone behind their back/say mean things to someone are most of the time really insecure and they don't know how to cope with their own insecurity. That has nothing to do with you!
Anyway, I'm sure you're beautiful/handsome. You seem like a great person and if I were you, I would'nt want to change myself for the world. Please try to remind yourself that everyone is beautiful in their own way, and if someone doesn't think you're attractive, than that's their own problem. There are people out there who think you are gorgeous!