Then when the teacher suggests that the young niece isn't serious about her school career, Buck says to the teacher,"Here's a quarter, why don't you go down town and have a rat knaw that thing off your face."

Sorry, one of my favorite scenes from one of my favorite movies. A very funny line in reaction to a remark by a stupid person.
I'm not saying your neighbor/husband's boss is stupid. I think what he said was a reaction due to past experience.
If you decide to speak to him do it carefully, don't say something you might regret.

__________________