It would be ideal if you could hang out, at least then you could have movies on or something and then that helps alleviate some of the awkward silences when you have another form of entertainment going on.
I don't know try to ferret out his interests, find out if he is into a certain type of book or TV show? Thats usually what the home bodies I know are into... I never have much to talk about, to be honest because I am more of a passive person who just listens to people rather than do much. I'm trying to change that be more of a doer than a watcher but oh well..