Baltimore's a pretty sizeable city with a whole lot of unique vibes. Starting from UMB you can go in almost any direction and find something interesting, especially with some street smarts in hand.

For two things that are a reasonable walk/bike/bus ride south from UMB, I might recommend the American Visionary Art Museum and Baltimore Museum of Industry, both are great and have plenty of other cool stuff nearby