As an asexual male, I totally understand where you are coming from.

I generally don't talk about anything like that with other men of any stripe. I have a few very understanding female friends who don't judge and even then when I talk about it, it feels like I'm handing them a burden.