Score one for the good guys.
I commend you for keeping a cool head through all this, it would be really easy to lose your head and make a mistake that would cost your shop. Kudos.
Based on my own personal experiences, the next time you both talk/meet, inform Joe that you will be recording all conversations from now on. Just to protect yourself, have everything on record. Just make sure he knows. If he makes a big deal about it, then you know he's full of BS.
Good Luck!