Confusius say: You look for trouble, you will soon find it.

Personally, I think you were quite wise to stop while you were ahead. I am sure if you wouldve pushed the issue, you would have found yourself being lit up for something careless that you normally do day-to-day without any thought.