I distrust complements for all those reasons you listed, but also because growing up compliments were always given in a snide, backhanded way. And often just used as sarcasm to express discontent, so every compliment would mean the opposite. So, like the example you gave of coworker saying you work hard, I would take that as the opposite and them expressing discontent.