If you take it out it sucks when it rains. Also, AC is a must on long highway trips. Windows down at 75 mph is grating over several hours of driving.
Other than that, rip it out. The only time I drive my car on the interstate is to get to the track and I usually don't drive my car when it rains anyway. I used my AC less than ten times in 2006.