Since this is the rear caliper I would bet that the piston has to be screwed back in rather than pushed. Once you install new pads you need to test fit them on the rotor. If there is any play at all between the pads and the rotor you may need to screw the piston back out a little bit to take up the slack.

My.02