It's called the Social Security Trust Fund, and it's typically taken directly from wages. If you ever get a job, on your pay stub there will be a deduction that's usually just called "SOCIAL SECURITY". So, largely payroll taxes.
I'm assuming you meant subsistence farming? If so then yes, it would be a large problem because they would then not have enough food to feed themselves.