I've been thinking about this and I think you should keep your outdoor shoes beside the chair you always sit in and bring them with you to go out. Then just be sure to enter back through the door you went out of to get your slippers back!