There are portable indoor propane and kerosene heaters. Also there are wall mounted ones that vent outside but are basically just a slim box on the wall instead of a whole thing with a mantel and hearth.

And I'm not saying you can't have a whole thing with a mantel and a hearth if you want one, but if you don't want it, you can just have a blank unobtrusive white box on the wall.