I've delt with similar things...like if I were better or more interesting or something, then someone would have been my friend rather than an acquaintance. Eventually, I learned that those feelings of guilt are non-productive and instead concentrated on all the good things about myself, and I found quite a few after I looked for a while. This feeling is definitely one stemming from social anxiety.
The solution? Learn to let go of things and accept what happens, even if it might not be what you like. You cannot control situations and always get the outcome that you want. However, you can set the situation up for success by working on your anxiety and reducing it as much as possible and just focus on working on your relaxation. When you are relaxed and confident, you are much more likely to get the outcome that you want, or at least another good one.
The process sounds simple, but for me it took a few years of really hard work at it, but I'm glad that I did it.