This is a religious reason.
This desire was the motivation of the crusaders who wanted to bring Jerusalem, and other sites that witness the life of Jesus, into the hands of the Christians, and away from the Muslims, so that Christians can worship in this sites.
Its a magnet that points north and with it pointing north also show west east and south
Romulus and Remus are the two twin brothers who supposedly founded Rome in its historical mythology.
