If we look at the data we have from the question closely, we will discover that aluminum has a very negative reduction potential. Recall that very negative reduction potentials are associated with strong reducing agents.
Similarly, silver has a positive reduction potential signifying that it is an oxidizing agent. Since the reducing agent is oxidized in a redox reaction and the oxidizing agent is reduced.