you can still drive it, i would continue to check my oil frequently and add as needed until they are replaced. sounds like the spark plug seals to me.