Conceptually, recurrent neural networks are not at all new. However, they've been largely relegated to academia because they were intractable to learn.
Some recent advances in hessian-free methods have made them more viable, though the authors' paper is awaiting publication.