If you can find a way to leave more clothes at work, my suggestion is to wear nice clothes to the gym, change to gym clothes there while hanging your nice clothes, then shower/change back after your workout.