Maybe you should arrange to meet him so the 2 of you can discuss things like men and come to some sort of resolve. Until that happens, I dont think you will ever get past all this third party he said she said BS. Im sure there is a lot more to this, and a lot of things that have been miscommunicated or misunderstood, that will only be made clear with direct communication between the 2 of you.
Just my opinion though...