The village was first surveyed in 1702 after families had begun arriving on horseback. By 1730 roads had been cut into the forests so settlers could haul out wool and farm produce and bring in lumber that was being rafted down the Delaware River from Upper Pennsylvania. Originally called Indian Village, the town was later named Mill Town, later Milton and finally in 1833, Carversville. The latter name was borrowed from the postmaster whose last name was Carver.