There a lapse in communication here, talk to your docor again and voice your concerns. If you want to stop taking them, which is desirable (they're seriously habit forming, and shouldn't really be taken long term)
Hope it goes okay for you!
"I think the existential dilemma is: We're social animals, so we all wrestle with a sense of inadequacy. But when we realize that we're not as inadequate as we thought we were, and when we realize that everybody elese also thinks they're inadequate, then the ache goes away and the idea that we're not a person of value disappears to some extent."
"I wash myself with a rag on a stick"