In addition to making sure the door seals are in place I would install a curtain rod above the door and in winter close a pair of heavy curtains. The process is easier if the rod you use has a cord operated mechanism that opens/close both side at the same time. We have this arrangement for some sliding doors and it makes a noticeable difference on cold days. We just close them at night.