Oh, yes. I have this problem big-time. And it doesn't help that I am horrible at communicating, be it in person, on the phone, or even in writing. I can say something and not mean it to sound rude or anything, but I'll come across that way anyways. So, I'm always extra careful about what I say to the point that I'm painfully anxious to say anything at all.
Also, I'm not good at telling people how I feel either, so that usually ends up biting me in the ***.
So, yeah, I think some of us can be hard to read perhaps since our anxiety prevents us from expressing ourselves effectively.