Question

Why don’t magnets affect gamma rays as they pass over it?

Answer 1

We may apply Fleming's Left Hand Rule of Electromagnetism to determine how a charged particle behaves in a magnetic field. However, because the gamma rays do not have a charge on them, like alpha particles and beta particles do, they are not deflected. 
Gamma rays are electromagnetic waves and its is a characteristic of electromagnetic waves that they have no charge.