I don’t think a lot of people were traveling by horse or cart. North of the Wall Street wall was untamed land with little road infrastructure controlled by various native tribes and confederations.

If you were traveling to the closest colony at the time (either Massachusetts Bay or New Haven), you’d almost certainly do it by ship.