Value iteration in countable state average cost Markov decision processes with unbounded costs
Data up to Jan 2025
Total Citations Per Year
Abstract
References (14)
Dynamic Programming
1957 • 13,549 citations
Introduction to Stochastic Dynamic Programming.
1986 • 1,200 citations
Adaptive Markov control processes
1990 • 395 citations
Adaptive Markov Control Processes
1989 • 320 citations
Some Conditions for Ergodicity and Recurrence of Markov Chains
1969 • 288 citations
Dynamic programming, Markov chains, and the method of successive approximations
1963 • 216 citations
Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded Costs
1989 • 204 citations
Recent developments in Markov decision processes
1981 • 79 citations
Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems
1989 • 74 citations
The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems
1977 • 49 citations
A new condition for the existence of optimal stationary policies in average cost Markov decision processes
1986 • 47 citations
The asymptotic behaviour of the minimal total expected cost for the denumerable state Markov decision model
1975 • 26 citations
A new condition for the existence of optimum stationary policies in average cost Markov decision processes - Unbounded cost case
1986 • 14 citations
Hitting times of Markov chains, with application to state-dependent queues
1977 • 12 citations