I personally prefer not to to ever ask anyone "where are you from" -- because, as you say, it can be a little off, and for some folks comes off as Why Are You Brown ?

In conversational and social settings, I like to ask "did you grow up around here?" -- which is much more what I'm really interested in asking! Making small talk or getting to know a person by asking a little bit about their background and history.

Anyway, OP -- I'm happy to say that yes, I'm not transient, I have roots here, but when people ask me where I'm from, it's usually an opportunity for me to talk about some of the other aspects of my identity.