Geometric convergence of value-iteration in multichain Markov decision problems
Data up to Jan 2025
Total Citations Per Year
Abstract
References (23)
Dynamic Programming and Markov Processes.
1961 • 3,612 citations
Finite State Markovian Decision Processes
1970 • 877 citations
Introduction to Probabilistic Automata
1971 • 684 citations
Contraction Mappings in the Theory Underlying Dynamic Programming
1967 • 463 citations
Introduction to probabilistic automata
1972 • 406 citations
Dynamic programming, Markov chains, and the method of successive approximations
1963 • 216 citations
Dynamic Programming and Markov Processes.
1961 • 196 citations
Iterative solution of the functional equations of undiscounted Markov renewal programming
1971 • 175 citations
Markov Decision Process
1992 • 126 citations
On Finding the Maximal Gain for Markov Decision Processes
1969 • 118 citations
Optimal decision procedures for finite markov chains. Part I: Examples
1973 • 84 citations
On the Iterative Method of Dynamic Programming on a Finite Space Discrete Time Markov Process
1965 • 69 citations
On powers of non-negative matrices
1958 • 68 citations
The Functional Equations of Undiscounted Markov Renewal Programming
1978 • 57 citations
Discounting, Ergodicity and Convergence for Markov Decision Processes
1977 • 55 citations
Generalization of White's Method of Successive Approximations to Periodic Markovian Decision Processes
1972 • 54 citations
The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems
1977 • 49 citations
Perturbation theory and Markovian decision processes.
1965 • 34 citations
Contraction mappings underlying undiscounted Markov decision problems
1978 • 29 citations
Contraction mappings underlying undiscounted Markov decision problems—II
1988 • 24 citations
Étude asymptotique des systèmes markoviens à commande
1967 • 22 citations
Optimal decision procedures for finite markov chains. Part I: Examples
1973 • 6 citations
An iterative method for approximating average cost optimal (s,S) inventory policies
1974 • 6 citations