First of all you can't be scared to mess anything up. As I recall there are just rivets holding the panel to the door. Just check if there are any screws first, if not then just try prying the panel off. [Might need a flat head screwdriver to do so]