Ha I'm the same way, I only fly when I'm absolutely certain there's nobody around or over my own property or friend's property. I'm also afraid of some random person yelling at me for "spying" on them from 400' up even though I'm flying over public areas, and legally can fly anywhere that's not restricted by the faa. So far though the only times I've run into people it was a positive experience; they've loved it and wanted to see the photos.