It's a Man's World (100 W Broad St, Richmond, VA 23220) is a good bet. I got a cool blazer there for like $15, and it has a ton of consignment dress clothes for men (I think the owner said it was the largest men's consignment shop in VA? Or the only one? Something like that).

It's fancier (and typically pricier) than goodwill, but it's also better quality.