Yeah, I agree. I wouldn't view comparing someone's looks to that of a celebrity's as a compliment. All it is really, is telling the person something kind of amusing about how they look. And they've probably heard it umpteen times. I've done it a few times as well, though.
A flower falls, even though we love it; and a weed grows, even though we do not love it. - Dogen