Markov Chains

Couverture
Elsevier, 15 juil. 2008 - 380 pages
This is the revised and augmented edition of a now classic book which is an introduction to sub-Markovian kernels on general measurable spaces and their associated homogeneous Markov chains. The first part, an expository text on the foundations of the subject, is intended for post-graduate students. A study of potential theory, the basic classification of chains according to their asymptotic behaviour and the celebrated Chacon-Ornstein theorem are examined in detail.

The second part of the book is at a more advanced level and includes a treatment of random walks on general locally compact abelian groups. Further chapters develop renewal theory, an introduction to Martin boundary and the study of chains recurrent in the Harris sense. Finally, the last chapter deals with the construction of chains starting from a kernel satisfying some kind of maximum principle.

 

Table des matières

CHAPTER 0 PRELIMINARIES
1
CHAPTER 1 TRANSITION PROBABILITIES MARKOV CHAINS
8
CHAPTER 2 POTENTIAL THEORY
40
CHAPTER 3 TRANSIENCE AND RECURRENCE
80
CHAPTER 4 POINTWISE ERGODIC THEORY
117
CHAPTER 5 TRANSIENT RANDOM WALKS RENEWAL THEORY
159
CHAPTER 6 ERGODIC THEORY OF HARRIS CHAINS
186
CHAPTER 7 MARTIN BOUNDARY
233
CHAPTER 8 POTENTIAL THEORY FOR HARRIS CHAINS
261
CHAPTER 9 RECURRENT RANDOM WALKS
286
CHAPTER 10 CONSTRUCTION OF MARKOV CHAINS AND RESOLVENTS
324
NOTES AND COMMENTS
346
REFERENCES
356
INDEX OF NOTATION
371
INDEX OF TERMS
372
Droits d'auteur

Autres éditions - Tout afficher

Expressions et termes fréquents

Informations bibliographiques