Understanding Markov chains : examples and applications /

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to the computation of average hitting times and ruin probabilities. It also discusses classic...

Full description

Bibliographic Details
Main Author:	Privault, Nicolas (Author)
Format:	eBook
Language:	English
Published:	Singapore : Springer, 2026.
Edition:	Third edition.
Series:	Springer undergraduate mathematics series,
Subjects:	Markov processes. Distribution (Probability theory) Markov Chains Processus de Markov. Distribution (Théorie des probabilités) distribution (statistics-related concept) Procesos de Markov Markov processes Electronic books.

Table of Contents:

Probability Background
Gambling Problems
Random Walks
Discrete-Time Markov Chains
First Step Analysis
Classification of States
Long-Run Behavior of Markov Chains
Branching Processes
Continuous-Time Markov Chains
Discrete-Time Martingales
Spatial Poisson Processes
Reliability Theory.