While both followed the teaching of John Calvin, a cardinal difference distinguished one group from the other: Pilgrims were Puritans who had abandoned local parishes and formed small congregations of their own because the Church of England was not holy enough to meet their standards. They were labeled Separatists.