Hunter-gatherer societies had religion, art, language, and many other things that other later societies also had. But they didn't know how to write. Writing came later with more permanent settlements that were made possible by humans learning how to cultivate and grow their food and didn't have to move that much, or at all anymore.