I think you're probably right. I guess an absence of anxiety is hard for me to understand. I see people not experiencing it and I wonder what it must feel like.
It's weird - because I do know what it feels like. Often in the past that's been from using medication like benzos etc - and other times strangely enough just "naturally." I don't really understand it. When I've been manic I don't usually feel anxious - you can actually feel overconfident, it's very strange. That causes other problems though obviously.
I hate anxiety - I think it's the worst feeling there is. It makes us crawl back into ourselves and not want to come out.
I was very "anxious" of things as a child, like my bed breaking if both my parents sat on it, sleep problems, etc. I didn't become anxious of people specifically until social norms started becoming a bigger thing in middle school.