If you ask anyone around the town of Nantucket how the deer came to the island, you may have some variety of answers, but generally “they swam” and “they were brought here” will be the primary responses. There is a local legend or old wives’ tale that states that our current population of more than 2,000 animals are descended from just three deer.