A step function is a function that looks like stairs when you graph it. Normally the end of one line will be graphed as an open circle (less or greater than, not equal to) while the other end would be a closed circle. This allows for a new line of the function to start directly above it without it not being a function (an input cannot have two outputs)
The function f(x)=4 is just a horizontal line as it has a slope of 0 (there is no x on the right side of the equation), so this doesn't resemble a step function.