The main difference is that public speaking is structured better, and often prepared earlier. Public speakers will often be more formal with an audience than someone they are having a plain conversation with. A conversation normally is just random subjects.
Either way, both are used to inform, entertain, etc.
