When he said he felt an "a sunburst of deliverance" he meant he felt a sense of freedom. As in, the war is over, I can go home, and a big stress has just been lifted off my shoulders.
This is true because even if that grandparent was to change from Jewish to Christianity they would still be considered Jewish and the Nazis thought it was passed down to the grandchildren.