What type of music are you into? Pittsburgh has a pretty good hardcore/metal/punk/indie scene.

I see everyone already suggested a lot of places to check out but you should make sure to check out Preserving Underground in New Kensington. They do a lot of shows there and also one of the best record stores you can find.

I saw a few mention good shops too. Backstage is the best place to go for repairs, hands down.