I was put in special education classes in high school and almost didn't receive my diploma. Needless to say, I had a very, very hard time in school interacting with the teachers and other students. Luckily, I had pretty good standardized test scores, and was accepted at a state university, from which I transferred to a large reputable university where I'm now an honor student!
If you know you're not lazy, you shouldn't give up on your education. I was in the bottom 5% of my graduating class, but am now a very, very good college student. Part of it is going to a large school where not everyone knows you, you don't get called on in class very often, and you can just sort of remain anonymous in your classes.