Im not really sure whats going on now???

Car did not leak untill I replaced the rad. cap. I put back on the old cap and no leak. Put back the new cap and it leaks from the water pump area.

Im thinking maybe 2 much pressure is building up and causing the leak. What do you think? The reason I replaced the old cap was that its seems to have a slight leak on top of the cap.