Answer: the same direction I.e to the left.
Explanation:
The component perpendicular to the contact surface is such that will stop the relative motion and, in case of elastic collision like here, return the system to the same kinetic energy. So ball hitting immovable surface will have the same speed (magnitude of velocity) as before the collision.
There will also be parallel force caused by friction, but it has to be treated separately for two reasons:
The perpendicular force is limited to coefficient of friction times the normal force. If that is not enough to stop the ball, it will skid on the surface.The perpendicular force, and this depends on the specific geometry, does not pass through the centre of mass of the ball. Therefore it imparts a moment on the ball that causes it to start rotating. And once the ball is rotating so that the point of contact is stationary, there is no momentum to cause any friction force anymore and the friction force disappears and stops decelerating the ball.
So what happens is that the vertical component of the velocity will be reversed, while the horizontal component will be somewhat reduced with the corresponding amount of kinetic energy transferred to energy of rotation. The rotation will always eliminate the friction force before the horizontal component of velocity is zeroed, so the ball will always continue in the same direction, just a bit slower.
If you instead threw an elastic box (which could not start rotating freely) it could actually bounce back.
