National Science Library of Georgia

Image from Google Jackets

Topics in the constructive theory of countable Markov chains / G. Fayolle, V.A. Malyshev, M.V. Menshikov.

By: Contributor(s): Material type: TextTextPublisher: Cambridge : Cambridge University Press, 1995Description: 1 online resource (169 pages) : digital, PDF file(s)Content type:
  • text
Media type:
  • computer
Carrier type:
  • online resource
ISBN:
  • 9780511984020 (ebook)
Subject(s): Additional physical formats: Print version: : No titleDDC classification:
  • 519.2/33 23
LOC classification:
  • QA274.7 .F39 1995
Online resources: Summary: Markov chains are an important idea, related to random walks, which crops up widely in applied stochastic analysis. They are used, for example, in performance modelling and evaluation of computer networks, queuing networks, and telecommunication systems. The main point of the present book is to provide methods, based on the construction of Lyapunov functions, of determining when a Markov chain is ergodic, null recurrent, or transient. These methods can also be extended to the study of questions of stability. Of particular concern are reflected random walks and reflected Brownian motion. The authors provide not only a self-contained introduction to the theory but also details of how the required Lyapunov functions are constructed in various situations.
Tags from this library: No tags from this library for this title. Log in to add tags.
No physical items for this record

Markov chains are an important idea, related to random walks, which crops up widely in applied stochastic analysis. They are used, for example, in performance modelling and evaluation of computer networks, queuing networks, and telecommunication systems. The main point of the present book is to provide methods, based on the construction of Lyapunov functions, of determining when a Markov chain is ergodic, null recurrent, or transient. These methods can also be extended to the study of questions of stability. Of particular concern are reflected random walks and reflected Brownian motion. The authors provide not only a self-contained introduction to the theory but also details of how the required Lyapunov functions are constructed in various situations.

There are no comments on this title.

to post a comment.
Copyright © 2023 Sciencelib.ge All rights reserved.