People might once in a while say something nasty under their breath, but I doubt you'd be messed with. I'm white, felt the same way initially, then I realized it's stupid to make situations all about myself.

As others have said, support local business and you'll be celebrated. And be aware of your surroundings as you have before, I'm sure. You'll have a great time