The answer is 8x.
You are combining like terms as 5 and 3 both have x so you are simply adding 5+3= 8
(x + y)^2 = (x^2 - 2xy + y^2)
First distribute the ^2 on the left side of the equation to each term inside the parenthesis:
x^2+ 2xy + y^2
Now pick one of the variables to solve for and isolate it:
(solving for x)
x^2 + 2xy + y^2 = x^2 - 2xy + y^2
x^2+ 2xy = x^2 - 2xy
2xy = -2xy
-x = x
x = 0
When you solve for y in the equation it will turn out to be 0 as well
The value of the function is -20