This is because the "higher" the negative number, the less valuable. Imagine this, would it be better if you owed 32 dollars or 97 dollars? 32 because you don'y owe as much. The farther away from 0, the smaller the number is. -97 is farther than -32 from 0, so -97 is less than.
