I ALWAYS drive barefoot. If I wear shoes that day, I dont fully put them on until I get to my destination. I cannot drive as smooth and sometimes I end of hitting the brake and gas pedal at the same time with some of my wider shoes.
I can see driving could be a problem if you have a really stiff clutch, buts mine's a stock honda clutch.