Stochastic approximation for non-expansive maps: applications to q-learning algorithms

Convergence of Probability Measures

1999 • 14,297 citations

Learning from delayed rewards

1989 • 5,606 citations

Parallel and Distributed Computation: Numerical Methods

1989 • 5,603 citations

Neuro-dynamic Programming

2012 • 3,839 citations

Adaptive Algorithms and Stochastic Approximations

1990 • 2,105 citations

Stochastic Approximation Methods for Constrained and Unconstrained Systems

1978 • 1,483 citations

Analysis of recursive stochastic algorithms

1977 • 1,471 citations

Stochastic Approximation Algorithms and Applications

1998 • 1,084 citations

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

1994 • 765 citations

Untitled

1994 • 608 citations

An Analysis of Stochastic Shortest Path Problems

1991 • 508 citations

Ergodic Theory of Random Transformations

1986 • 495 citations

Asynchronous Stochastic Approximations

1998 • 176 citations

Smoothing derivatives of functions and applications

1969 • 174 citations

Probability Theory: An Advanced Course.

1996 • 131 citations

White-Noise Representations in Stochastic Realization Theory

1993 • 92 citations

Rate of Convergence of Recursive Estimators

1992 • 82 citations

Partially Asynchronous, Parallel Algorithms for Network Flow and Other Problems

1990 • 72 citations

An analog scheme for fixed-point computation-Part II: Applications

1999 • 16 citations