I'd just go for it if I were you. How about a simple, "do you want to have a drink/coffee sometime?". If he says yes, give him your phone number and ask for his so that you can set it up.
Honestly, I'd rather have the short embarrassment of rejection then the long-term wonderings of "what...