I'm assuming all of (x^2+9) is in the denominator. If that assumption is correct, then,
One possible answer is 
Another possible answer is 
There are many ways to do this. The idea is that when we have f( g(x) ), we basically replace every x in f(x) with g(x)
So in the first example above, we would have

In that third step, g(x) was replaced with x^2+9 since g(x) = x^2+9.
Similar steps will happen with the second example as well (when g(x) = x^2)
It's impossible for 2 factors of 12 to add up to 16. So there would be no answer to that.
Answer:
5(2x^5 + x^2 - 3)
Step-by-step explanation:
The only factor in common is 5, so you would have 5(2x^5 + x^2 - 3). That can't be factored further. IF the equation had been to the fourth degree on the first term rather than to the fifth degree, it could have been factored as 5(2x^2 -3)(x^2 +1).