Owner of an HVAC company here.

New Ductless heat pumps are pretty amazing & can put out 100% capacity well below zero. You can have one outdoor unit with as many as 5 indoor units, all independently controlled, so now your house will be “zoned” as well.

That said, the installing company is VERY important. Read the company’s reviews & get the 10-12 year extended warranty. Well worth it. Probably stick with Daikin, Mitsubishi or Fujitsu as far as manufacturers go. They’re all great. The brand of the equipment is not nearly as important as the company installing it.

Natural gas furnaces are great as well, but it is an outgoing technology.

For heat pump systems (ductless or ducted) there are Federal Tax Credits this year & usually local utility rebates as well.

Good luck with your home comfort journey!