I know how you feel...I hate my voice too. I always get really nervous talking to someone on the phone for the first time because of it. Plus I (apparently) have a heavy "California girl" accent, which some people find annoying (or so I've heard).
But I agree with what everyone else has said so far....go for it anyway!!