Reading your post, you actually sound like quite a thoughtful person
. And the fact that you have self esteem issues - and I can relate to that - is probably the only reason why you believe yourself to be a contemptible person.
Just stick to the path you're on, try not to over-analyze too much, and give yourself a pat on the back for having some good principles to go on, okay dude? You've got your head screwed on right for a 24 year old.
A flower falls, even though we love it; and a weed grows, even though we do not love it. - Dogen