I'd say
GO FUCK YOURSELF!
to them.
Homeowners associations and similar are the devil. It's the reason where I live has to have these gaudy white fences instead of a plain (or the green coloured) chain link in the back yard, and why there isnt a sweet ass house-colour matching 2 car garage with lift in the backyard either
Ps- your house is nice man. I dream of owning a home someday.