I minored in anthropology in college, and many anthropologists have to do exactly this when they’re visiting and studying another culture. Observe, but don’t respond. Just make a note and focus your attention elsewhere as needed.