Its really not that bad. There are some low income neighborhoods throughout the city, including fair haven, but most people just mind their business + are generally friendly. Obviously, there are occasional outliers but you should be fine.