I observe similar reactions from some people too, I'm better than average looking and I dress up like my friends with a few personal accessories that compliment my vibe. But I'm shy when it comes to thinking I'm a looker.
However, I am on the other side of the spectrum, that I feel a balance sense of well being and confidence, and I feel comfortable in my own skin. I considered myself a listener unless I opened with my own subject, than I probe others for their views, I handle most social actions depending on the conditions, environment, etc..
I do get a fair number of people that react as you describe, I have an internal locus of control, others have external locus of control. In other words, it doesn't bother me cause I control my actions, as opposes to being affected by outside interactions.
So I think there's a couple scenarios at play. As I just described, some people allow others vibes to affect their actions. And another is, even though people perfected their social masks, they may feel uncomfortable around a genuine person's vibe, and display a hidden veneer insecurity, social their ego defense makes then act superior to compensate. And lastly, I feel I put out a healthy aura that attracts damage people, cluster b personality disorders that appear charismatic but secretly despise, envy, plus a host of underlying anger that they sense I'm balance, I have a narcissistic radar that recognized wolves in sheep's clothing, and they sometimes sense my solidness, making them act weird and competitive so I practice observe but don't absorb their negative energy and disengage from them as soon as possible.
A previous poster talks about a spectra that makes sense to me. You may be putting out a positive vibe and that's affecting the negative vibe people with a fake social masks on. One last thing... we are attracted to similar IQ levels and maturity level, so you got to think about that and try to stay with in your inner circle and keep growing, study about gender psychology, work on your own personal growth, and stay focused on your mission.