Something about rubbing on your shaft just doesn't sound right!

Try loosening the bolts and re-aligning the flanges to gain clearance. You might also have the rubber hangers attached to the wrong side of its body connection. (ie. rubber should go on the left side of body tab, versus the right side.) This happened on my brother's car when he installed his Blitz Realize TT in the middle on the night with a flashlight. Incorrect mounting in the rear axle area resulted in a driveshaft clearance of ~1mm.