MHIC Contractor here. Not interested in your job.

Yes, you need a permit. If you read the regulations, you'll find they are super vague, and seem to say that almost any work requires a permit, which is basically the case. But of course, we live in a failed-state City, so in reality it doesn't work like that at all.

I routinely conduct business that involves plumbing, electrical, structural, HVAC,etc. without a permit, as does every other contractor in the City. The risk that by pulling permits, the City will completely fuck the project is so great that many clients prefer the risk that an inspector will somehow notice that work is under way, and put a stop work on us. I can't tell you how many interior-only jobs get permitted, but it's a tiny f'n fraction of what goes on. Basically the only time you get the City's attention on an interior job is the same way almost all other regulations get enforced in the City: solely by complaint. It's ludicrous how much power a shitfuck neighbor has in this town. My contracts for clients who don't want to pull permits state that the homeowner will pull permits according to local regulations etc, and that if a project is stopped due to failure to permit, I will cease work, remove all tools, and be paid for work to date, returning to the site only once permits have been worked out. This has never happened.

Exterior work however is a different ball game. Inspectors can see that work is under way as they drive around, and certainly do apply stop work orders to sites that don't have permits. So, for anything outside, I always pull a permit. A simple fence that could be a one day job? Permit, with the delays and costs that two inspections will introduce to the project. Window replacement--the inspectors literally don't enter the property to even look at the window, and there's nothing to actually inspect, City just gets their permit money and inspector hands you the final sticker--permit. I'm not interested in getting stop work orders so when it's exterior work, I get the permit.

In order to re-point, and remove formstone (then repoint what you uncover), you'll have to set up scaffolding. This isn't ladder work. And it's super messy...you'll be sending a plume of mortar dust into the air. It's all far too obvious to attempt without a permit.