While both followed the teaching of John Calvin, a cardinal difference distinguished one group from the other: Pilgrims were Puritans who had abandoned local parishes and formed small congregations of their own because the Church of England was not holy enough to meet their standards.