Block-scaling of value-iteration for discounted Markov renewal programming
Data up to Jan 2025
Total Citations Per Year
Abstract
References (18)
Finite State Markovian Decision Processes
1970 • 877 citations
Applying a New Device in the Optimization of Exponential Queuing Systems
1975 • 749 citations
Elements of Numerical Analysis
1965 • 679 citations
Markov-Renewal Programming. I: Formulation, Finite Return Models
1963 • 186 citations
Adaptive aggregation methods for infinite horizon dynamic programming
1989 • 175 citations
A modified dynamic programming method for Markovian decision problems
1966 • 135 citations
Some Bounds for Discounted Sequential Decision Processes
1971 • 99 citations
Markov-Renewal Programming. II: Infinite Return Models, Example
1963 • 91 citations
An algorithm for Ph/Ph/c queues
1986 • 84 citations
Acceleration by aggregation of successive approximation methods
1982 • 82 citations
Recent developments in Markov decision processes
1981 • 79 citations
Bounds and Transformations for Discounted Finite Markov Decision Chains
1975 • 77 citations
An Iterative Aggregation Procedure for Markov Decision Processes
1982 • 65 citations
Linear programming algorithms for semi-Markovian decision processes
1968 • 38 citations
Iterative aggregation theory
1988 • 23 citations
On Bounds for Dynamic Programs
1985 • 17 citations
Bounds on the fixed point of a monotone contraction operator
1987 • 6 citations
Replacement process decomposition for discounted Markov renewal programming
1991 • 2 citations