Stochastic Processes

This book contains material on compound Poisson random variables including an identity which can be used to efficiently compute moments, Poisson approximations, and coverage of the mean time spent in transient states as well as examples relating to the Gibb's sampler, the Metropolis algorithm and mean cover time in star graphs. Preliminaries.

The Poisson Process.

Renewal Theory.

Markov Chains.

Continuous-Time Markov Chains.

Martingales.

Random Walks.

Brownian Motion and Other Markov Processes.

Stochastic Order Relations.

Poisson Approximations.

Answers and Solutions to Selected Problems.

Index.

Sheldon M. Ross is the author of Stochastic Processes, 2nd Edition, published by Wiley.