It adds emphasis to that phrase, and implies a deeper meaning
Gandhi was unhappy because when the British granted India her independence, the Indian Independence Act of 1947 partitioned British India into two: India and Pakistan. His vision of a free India was a harmonious co-existence of the Hindus and Muslims in one nation.
On one hand, people consider bureaucracies as necessary administrative instruments that will ensure an orderly management of an organization.
On the other hand, bureaucracies are also believed to be the source of inefficiency in organizations. Which leads to a low perception of quality in the services they provide.
It is a matter of finding an adequate point between a swift service and good controlling tools. Even if this point is found, it demands constant revisions, as the reality of the environment which an organization serves changes with time.