Learning long-term dependencies with gradient descent is difficult

Optimization by Simulated Annealing

1983 • 42,775 citations

Parallel Distributed Processing

1986 • 14,631 citations

A Learning Algorithm for Continually Running Fully Recurrent Neural Networks

1989 • 4,222 citations

Advances in neural information processing systems 1

1989 • 3,021 citations

Advances in Neural Information Processing Systems 5

1993 • 1,861 citations

Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithm—Corrigenda for this article is available here

1987 • 1,538 citations

Improving the convergence of back-propagation learning with second-order methods

1989 • 338 citations

The problem of learning long-term dependencies in recurrent networks

2002 • 210 citations

Global optimization of a neural network-hidden Markov model hybrid

1992 • 204 citations

Local Feedback Multilayered Networks

1992 • 196 citations

A Focused Backpropagation Algorithm for Temporal Pattern Recognition.

1989 • 175 citations

Learning Process in an Asymmetric Threshold Network

1986 • 135 citations

Induction of Multiscale Temporal Structure

1991 • 131 citations

Unified integration of explicit knowledge and learning by example in recurrent networks

1995 • 80 citations

Nonlinear dynamics and stability of analog neural networks

1991 • 76 citations

BPS: a learning algorithm for capturing the dynamic nature of speech

1989 • 60 citations

Learning by choice of internal representations

1988 • 51 citations

The “moving targets” training algorithm

1990 • 48 citations

Using random weights to train multilayer networks of hard-limiting units

1992 • 42 citations

Artificial neural networks and their application to sequence recognition

1991 • 39 citations

Inserting rules into recurrent neural networks

2003 • 28 citations

A method of training multi-layer networks with heaviside characteristics using internal representations

2002 • 1 citations