Another big downside to using cardio as the primary method for chasing weight loss is that performing too much of it can actually hinder muscle growth and at worse eat away at your muscle tissue. <4> The reason this is so alarming is that when you lose muscle, your resting metabolic rate (RMR) decreases.:)