That’s not true. the VT town I grew up in was founded by Quakers and quick google search pulls up many examples of Quakers living in Vermont

Shakers by definition couldn't breed. So, you only had to wait them out...