Yeah, and a big part of it is my eyes.
I have strabismus (crosseye) and I've had many surgeries to try to correct it. Cosmetically I don't look TOO bad, but unfortunately the doctors were never able to fine-tune my eyes so that they see things as they should. I have double vision if I try to look though both eyes at the same time, like normal people do. Further, those images are misaligned. One is higher than the other like 2 cameras that are not quite pointing at the same spot ("divergent"). At this point, there is no correction for my degree of divergence given my surgical history. But if I were a child now and just beginning treatment, there would be tons of options. The technology just wasn't there 40 years ago like it is today.
So, I unconsciously adapted to using only one eye at a time, and quickly shifting back and forth in order to simulate normal stereoscopic vision and depth perception. The big problem is that the divergent eye (my right) is very sensitive to bright glaring light, and I squint-- but only that eye. The left eye (the straighter one) isn't so bad unless I look sharply right-- then that one squints to block out confusing double images. I see just fine in terms of visual acuity (20/20). I just see 2 of everything. Thus, I often look angry because I'm squinting and my face might be somewhat "squoonched" because I'm trying to process what I'm seeing.
The thing is, the times when I'm squoonched up are the times when I'm most intently "focused" (literally and figuratively) on the person or thing that's in front of me... those are the times when you have me so enraptured in your story, or attentive to what you're saying. People take that the wrong way and they think I'm stonewalling or getting angry or something. I think it also sort of repels people, because they see my unintended facial expression and they don't understand that it's because of a vision "problem".
We've tried glasses with prism correction in order to help straighten the divergent eye. Remember how we played with prisms as kids and made rainbows, and watched as the prism made things appear to change positions? Well, we got the divergence corrected fairly well, but the rainbow effect was far too pronounced at the strength I needed to get that degree of straightening. I saw "rainbows" around anything I looked at in bright light. Even the sunglasses gave me rainbows. And headaches.
Adding to the angry appearance, I have permanent brow creases from all my years of squinting. I'm to the point of having plastic surgery or Botox to fix that, but unless the squint is fixed the creases will return.