Hey Emj, first off I just wanted to say how you're feeling is not silly, and is definitely not your fault.
Unfortunatly, what's happening to you is just what SA does to all of us sufferers. Your mind tunes itself to think these social situations you're afraid of are dangerous. Have you ever had any CBT Therapy? It might be able to help you re-train your brain to think differently about these types of things.
It hasn't yet worked for me, but I'm not at the point of totally giving up hope
If you ever need to talk, you can always PM me. I hope you can get some comforting answers from this forum.
Good luck