Short answer: Polynomials can have very large derivatives compared to sigmoid or rectified linear functions which leads to exploding gradients.

https://en.wikipedia.org/wiki/Vanishing_gradient_problem#Recurrent_network_model