So, it doesn't make the noise in neutral with the clutch engaged?

When it's happening, does it change sound if you place some pressure on the shift lever (try different directions)?