mmm...I'd never buy a damaged bike but it's up to you if it's only "visual damage" I wouldn't worry about it as much...if it sounds bad...I'd definetly walk away.

*But I am no expert by any means that's just my policy with buying cars...I'd apply the same to bikes.