Back to search

Geometric convergence of value-iteration in multichain Markov decision problems

Data up to Jan 2025

Published1979
Citations46
References23

Total Citations Per Year

Abstract

References (23)

Dynamic Programming and Markov Processes.

1961 • 3,612 citations

Finite State Markovian Decision Processes

1970 • 877 citations

Introduction to Probabilistic Automata

1971 • 684 citations

Contraction Mappings in the Theory Underlying Dynamic Programming

1967 • 463 citations

Introduction to probabilistic automata

1972 • 406 citations

Dynamic programming, Markov chains, and the method of successive approximations

1963 • 216 citations

Dynamic Programming and Markov Processes.

1961 • 196 citations

Iterative solution of the functional equations of undiscounted Markov renewal programming

1971 • 175 citations

Markov Decision Process

1992 • 126 citations

On Finding the Maximal Gain for Markov Decision Processes

1969 • 118 citations

Optimal decision procedures for finite markov chains. Part I: Examples

1973 • 84 citations

On the Iterative Method of Dynamic Programming on a Finite Space Discrete Time Markov Process

1965 • 69 citations

On powers of non-negative matrices

1958 • 68 citations

The Functional Equations of Undiscounted Markov Renewal Programming

1978 • 57 citations

Discounting, Ergodicity and Convergence for Markov Decision Processes

1977 • 55 citations

Generalization of White's Method of Successive Approximations to Periodic Markovian Decision Processes

1972 • 54 citations

The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems

1977 • 49 citations

Perturbation theory and Markovian decision processes.

1965 • 34 citations

Contraction mappings underlying undiscounted Markov decision problems

1978 • 29 citations

Contraction mappings underlying undiscounted Markov decision problems—II

1988 • 24 citations

Étude asymptotique des systèmes markoviens à commande

1967 • 22 citations

Optimal decision procedures for finite markov chains. Part I: Examples

1973 • 6 citations

An iterative method for approximating average cost optimal (s,S) inventory policies

1974 • 6 citations

Cited By (0)

Loading...