The assumption that the cosmic microwave background
is the remnant of the environment at the time of the big bang
or very shortly after it explains very well what we observe now.
So it is the current prevailing theory. "Believe" is not involved.
A reference is critical because it determines how much motion has occurred. You can't determine how much an objected has moved if you don't know where it came from.