Modified Policy Iteration Algorithms for Discounted Markov Decision Problems

Iterative Solution of Nonlinear Equations in Several Variables

2000 • 6,865 citations

Dynamic Programming and Markov Processes.

1961 • 3,612 citations

Computational Methods of Linear Algebra

1964 • 1,640 citations

Dynamic Programming and Stochastic Control

1977 • 1,263 citations

Finite State Markovian Decision Processes

1970 • 877 citations

A Unified Convergence Theory for a Class of Iterative Processes

1968 • 188 citations

On the Convergence of Policy Iteration in Stationary Dynamic Programming

1979 • 148 citations

Optimal decision procedures for finite markov chains. Part I: Examples

1973 • 84 citations

Bounds and Transformations for Discounted Finite Markov Decision Chains

1975 • 77 citations

A set of successive approximation methods for discounted Markovian decision problems

1976 • 54 citations

Tests for Suboptimal Actions in Discounted Markov Programming

1973 • 31 citations

Technical Note—Accelerated Computation of the Expected Discounted Return in a Markov Chain

1978 • 30 citations

ELIMINATION OF NON-OPTIMAL ACTIONS IN MARKOV DECISION PROCESSES

1978 • 17 citations

Optimization of Discounted Markov Decision Problems

1969 • 16 citations

The action elimination algorithm for Markov decision processes

1976 • 13 citations

THE ANALYTIC THEORY OF POLICY ITERATION11This research was partially supported by NRC Grant A3609.

1978 • 10 citations

A Stationary Newton Method for Nonlinear Functional Equations

1967 • 7 citations

A Case for Relaxation Methods in Large Scale Linear Programming

1976 • 5 citations

The generation of successive approximation methods for Markov decision processes by using stopping times

1976 • 1 citations