It does sound like the problem is beyond your windows, but what’s the downside of trying out some fixes and seeing if they help? Don’t just do the strips, use one of those plastic sheet insulation kits.