Tons of potential causes.
Best bet is to pick up a vacuum gauge and diagnose the problem from the needle readings. If I had to make a guess though I'd say you've got a simple vacuum leak.