Discrete-time Markov control processes : basic optimality criteria /

Markov chains /
by: Freedman, David, 1938-2008
Published: (1983)

Markov chains and invariant probabilities /
by: Hernández-Lerma, O. (Onésimo)
Published: (2003)

Adaptive Markov control processes /
by: Hernández-Lerma, O. (Onésimo)
Published: (1989)

Discrete-time Markov chains : two-time-scale methods and applications /
by: Yin, George, 1954-
Published: (2005)

Discrete Markov chains /
by: Romanovskiĭ, Vsevolod Ivanovich, 1879-1954
Published: (1970)

Markov decision processes with their applications /
by: Hu, Qiying
Published: (2008)

Markov processes /
by: Kirkwood, James R.
Published: (2026)

Markov processes and controlled Markov chains /
Published: (2002)

Markov processes : characterization and convergence /
by: Ethier, Stewart N., 1948-
Published: (1986)

Markov processes : an introduction for physical scientists /
by: Gillespie, Daniel T.
Published: (1992)

Excursions of Markov processes /
by: Blumenthal, R. M. (Robert McCallum), 1931-
Published: (1992)

Markov processes : characterization and convergence /
by: Ethier, Stewart N., 1948-
Published: (1986)

Markov processes : an introduction for physical scientists /
by: Gillespie, Daniel T.
Published: (1992)

Markov processes and applications : algorithms, networks, genome and finance /
by: Pardoux, E. (Etienne), 1947-
Published: (2008)

Theory of Markov processes /
by: Dynkin, E. B. (Evgeniĭ Borisovich), 1924-2014
Published: (2006)

An introduction to Markov processes /
by: Stroock, Daniel W.
Published: (2005)

Continuous time Markov processes : an introduction /
by: Liggett, Thomas M. (Thomas Milton), 1944-2020
Published: (2010)

Markov chains /
by: Revuz, D.
Published: (1984)

Topics in controlled Markov chains /
by: Borkar, Vivek S.
Published: (1991)

Markov decision processes : discrete stochastic dynamic programming /
by: Puterman, Martin L.
Published: (1994)

Finite Markov processes and their applications /
by: Iosifescu, Marius
Published: (1980)

Examples in Markov decision processes /
by: Piunovskiy, A. B.
Published: (2013)

An introduction to finite Markov processes /
by: Adke, S. R.
Published: (1984)

Random motions in Markov and semi-Markov random environments.
by: Pogorui, Anatoliy, et al.
Published: (2021)

Random Motions in Markov and Semi-Markov Random Environments.
by: Pogorui, Anatoliy
Published: (2021)

Markov processes and applications : algorithms, networks, genome and finance /
by: Pardoux, E. (Etienne), 1947-
Published: (2008)

Passage times for Markov chains /
by: Syski, R., 1924-2007
Published: (1992)

Markov chains and mixing times /
by: Levin, David Asher, 1971-
Published: (2009)

Markov processes, Brownian motion, and time symmetry /
by: Chung, Kai Lai, 1917-2009
Published: (2005)

Markov processes and control theory /
Published: (1989)

Computations with Markov chains : proceedings of the 2nd International Workshop on the Numerical Solution of Markov Chains /
Published: (1995)

An introduction to Markov processes /
by: Stroock, Daniel W.
Published: (2005)

Resultats recents sur les chaines discretes de Markov /
by: Letac, Gérard
Published: (1978)

Markov processes for stochastic modeling /
by: Ibe, Oliver C. (Oliver Chukwudi), 1947-
Published: (2013)

Hidden Markov models : estimation and control /
by: Elliott, Robert J. (Robert James), 1940-
Published: (1995)

Markov decision processes : discrete stochastic dynamic programming /
by: Puterman, Martin L.
Published: (1994)