Honestly taking out half of it is probably not too different from taking out all of it. A single layer of thin steel like a garage door provides basically zero insulation. In a lot of ways you might as well have a window open.