Sounds like a job for maintenance. You can go buy a Window Insulation Kit at most box stores. It’s just clears plastic that you tape to the window trim and “tighten” up the plastic with a hair dryer.