Depends on your definition of "house". Technically it is possible to build a type of "shelter" But to build a real house, even a small shed, it is necessary to use at the very least basic math. Even if you were building and planning on the go, it would require some math. You need math to calculate how large of materials you would need, how much money, the length and width of the house, how much supplies you need etc.
5 goes into the 5 in 52,500 one time. 5-5 is 0. 5 doesn't go into 2 so put a 0. 5 goes into 25 five times. 25-25 is 0. 5 goes into 5 one time. subtract and add the zeros at end. And you get 10,500