Its technically against fire code in most states as well. I think in my state its 15' from any wooden structures including fence.

Aside from that, it doesn't look dangerous to use. I don't think pavers would explode like river rocks, and MANY people build firepit out of the bricks, blocks and pavers found at Home Depot