Get a small handheld vacuum, letting the bugs go away on their own doesn't solve your fear of them if they can just come back, if you can dispose of them it'll be less likely for this to happen again. Hand held vacuum let's you get rid of them without getting too close.

I have firewood inside for the wood stove, super handy for little bugs.