I'm the same way, so I don't keep any candy around. Things I like to do to keep cravings at bay:
Freeze coke or juice into ice cubes. Diet coke/pepsi doesnt work very well, but other diets are okay like root-beer, orange, whatever. Even if you use regular soda, they take a while to eat so you cant binge. You can also do this with instant pudding if you like chocolate-y things.
Kettle popcorn. Sort of sweet and you can eat a lot for few calories. (But I heard somewhere that people who eat a lot of sugar could be allergic to corn, so maybe you should cut corn totally?)
Smoothies with nonfat milk, fruit, and a little low-fat ice cream. Or tofu if you're brave.
Fruit salad, naturally sweet
Whole grain oatmeal. I like blueberry flavored. Very filling.
These won't make your sugar cravings stop, but maybe they will help you. I've heard eating complex carb rich foods (whole grains) can make you stop craving sugar. Eating 5/6 smaller meals without ultra-high protein could help. And take vitamins.