I had the same issue. I put it back on and it rattled off again at a later date. The second time it stripped the keyway off of the crank... Here's the lesson I learned. Replace the crank pulley bolt, and replace the pulley itself.

If you don't, you're asking for it. The bolt was ~$9 at the dealer.