This apparent erratic movement is called "retrograde motion." The illusion also happens with Jupiter and the other planets that orbit farther from the sun. Just to make things a little more odd, the orbits that Earth and Mars follow don't quite lie in the same plane.
