Analysis of recurrent network training and suggestions for improvements

This paper describes some of the difficulties in training recurrent neural network, provides explanations for why these difficulties occur and explains how they can be mitigated.