I've been thinking about this again.
I speak a bit of Indonesian and it has this distinction. It's always a bit hard to know when to use it but another thing they do up there is to use the person's name instead of "you."
For example they'll say does "Harrison" want to come shopping with me? I think they do it when they're still unsure and wanting to be polite.
I know what you mean though - but I usually just switch to the more familiar term when I feel like I know them a bit better.