Recognise it for what it is - an attraction to have a wank over now and then.
There is probably good reason he isn't committing to hanging out as it'll be confusing and territory that could muck up four peoples lives rather than two.
Like lets say you hung out and he thought an advance was OK when it wasn't and that made it back to each others other halves. Then you'd have to explain to your other half why you hang out alone together when you knew the attraction was there - same for him. And also you will both be awkward around each other.
Nobody wants that level of confusion in life after 25 years old. It's never been a fun scenario to be in.
Originally Posted by Bertrend Russell
The whole problem with the world is that fools and fanatics are always so certain of themselves, and wiser people so full of doubts.