Finite State Continuous Time Markov Decision Processes with a Finite Planning Horizon

The Mathematical Theory of Optimal Processes.

1963 • 4,275 citations

Markov Chains with Stationary Transition Probabilities

1960 • 923 citations

Sufficient Conditions for the Optimal Control of Nonlinear Systems

1966 • 372 citations

The theory of functions of real variables

1956 • 339 citations

Theory of Markov Processes

1960 • 156 citations

On the Iterative Method of Dynamic Programming on a Finite Space Discrete Time Markov Process

1965 • 69 citations

Optimal Control of a Continuous-Time Markov Chain with Periodic Transition Probabilities

1967 • 24 citations