you have to hold the button while you turn the key, if that still doesn't work there's a possibility it could be your starter you can try giving it a few good hits then try to start the car.
Was the rubber plug still on there?
__________________
Ricky