Since rocks are denser than water, the water level will drop. The rocks in the boat will displace nearly the same amount of water as the rocks once thrown overboard. The difference would be the amount of water displaced by the boat itself and the person in it. Mass is mass whether in the water or the boat.
