copy background layer > ctrl + shift+ U (takes all color from picture) > image > adjustments > variations..


then adjust to your liking.

then you can use the pen tool and select things you dont want that color and hit delete.