This course explanations and expositions of stochastic processes concepts which they need for their experiments and research. It also covers theoretical concepts pertaining to handling various stochastic modeling. This course provides classification and properties of stochastic processes, discrete and continuous time Markov chains and simple Markovian queueing models and applications of CTMC.
Week
Topics and Contents
1
Probability theory refresher
Introduction to stochastic process.
Introduction to stochastic process (contd.).
2
Probability theory refresher (contd.)
Problems in random variables and distributions
Problems in Sequence of random variables.
3
Definition and simple stochastic process
Definition, classification and Examples.
Simple stochastic processes.
4
Week 4: Discrete-time Markov chains
Introduction, Definition and Transition Probability Matrix.
Chapman-Kolmogorov Equations.
Classification of States and Limiting Distributions.
5
Week 5: Discrete-time Markov chains (contd.)
Limiting and Stationary Distributions.
Limiting Distributions, Ergodicity and stationary distributions.
Time Reversible Markov Chain, Application of Irreducible Markov chains in Queueing Models.
Reducible Markov Chains.
6
Continuous-time Markov chains
Definition, Kolmogrov Differential Equation and Infinitesimal Generator Matrix.
Limiting and Stationary Distributions, Birth Death Processes.
Poisson processes.
7
Week 7: Simple Markovian Queueing Models
M/M/1 Queueing model.
Simple Markovian Queueing Models.
8
Week 8: Applications of Continuous-time Markov Chains
Queueing networks.
Communication systems.
Stochastic Petri Nets.
A basic course on Probability.
1. J Medhi, Stochastic Processes, 3rd edition, New Age International Publishers, 2009 2. Liliana Blanco Castaneda, Viswanathan Arunachalam, Selvamuthu Dharmaraja, Introduction to Probability and Stochastic Processes with Applications, Wiley, 2012. 3. Kishor S. Trivedi, Probability and Statistics with Reliability, Queuing, and Computer Science Applications, 2nd Edition, Wiley, 2002.
Important: Please enable javascript in your browser and download Adobe Flash player to view this site
Site Maintained by Web Studio, IIT Madras. Contact Webmaster: nptel@iitm.ac.in