The Voting Rights Act of 1965, signed into law by president Lyndon B. Johnson, aimed to overcome legal barriers at the state and local levels that prevented African Americans from exercising their right to vote as guaranteed under the 15 amendment to the U.S.
If you had voted for Andrew Jackson for the Presidency during this time, it is likely that you were a "common person," such as a farmer, since this was the demographic that Jackson tried to appeal to.