The annexation of Texas led to a war with Mexico which led to us gaining some more territory. He didn't want to do it because it would lead to a war, but did it anyway which declared war. In short, if you haven't figured it out already by taking the test for AZVA, he wanted to avoid war with Mexico.