Muslims did not continue to conquer Catholic areas in the norther region of the Iberian Peninsula because of the terrain. The area is very rugged and mountainous. This limited the ability of the Muslim forces to take over this region.
The answer is that it was based on the belief that segregation was permissible as long as the facilities were equal. This is the reason why the Supreme Court’s ruling in Plessy v. Ferguson was problematic.