Syllabus  |   Lectures  |   Downloads  |   FAQ  |   Ask a question  |  
Course Co-ordinated by IIT Delhi
Dr. S. Dharmaraja
IIT Delhi


Download Syllabus in PDF format

Untitled Document
This course explanations and expositions of stochastic processes concepts which they need for their experiments and research. It also covers theoretical concepts pertaining to handling various stochastic modeling. This course provides classification and properties of stochastic processes, stationary processes, discrete and continuous time Markov chains and simple Markovian queueing models.




Probability theory refresher

1. Introduction to stochastic process

2. Introduction to stochastic process (contd.)


Probability theory refresher (contd.)

1. Problems in random variables and distributions

2. Problems in Sequence of random variables

3. Definition, classification and Examples


Definition and simple stochastic process

1. Simple stochastic processes

Stationary and Auto Regressive Processes

1. Stationary processes

2. Autoregressive processes


Discrete-time Markov chains

1. Introduction, Definition and Transition Probability Matrix

2. Chapman-Kolmogorov Equations


Discrete-time Markov chains (contd.)

1. Classification of States and Limiting Distributions

2. Limiting and Stationary Distributions

3. Limiting Distributions, Ergodicity and stationary distributions


Discrete-time Markov chains (contd.)

1. Time Reversible Markov Chain, Application of Irreducible Markov chains in

Queueing Models2. Reducible Markov Chains


Continuous-time Markov chains

1. Definition, Kolmogrov Differential Equation and Infinitesimal Generator Matrix

2. Limiting and Stationary Distributions, Birth Death Processes

3. Poisson processes


Continuous-time Markov Chains (contd.)

1. M/M/1 Queueing model

2. Simple Markovian Queueing Models

Probability Theory and Calculus

  1. J. Medhi, Stochastic Processes, 3rd Edition, New Age International, 2009.

  2. S.M. Ross, Stochastic Processes, 2nd Edition, Wiley, 1996.

  3. S Karlin and H M Taylor, A First Course in Stochastic Processes, 2nd edition, Academic Press, 1975.

  1. Liliana Blanco Castaneda, Viswanathan Arunachalam and S. Dharmaraja, Introduction to Probability and Stochastic Processes with Applications, Wiley, 2012.

  2. Suresh Chandra, S. Dharmaraja, Aparna Mehra, R. Khemchandani, Financial Mathematics: An Introduction, Narosa Publication House, 2012.

  3. Kishor S. Trivedi, Probability, Statistics with Reliability, Queueing and Computer Science Applications, 2nd edition, Wiley, 2001.

  4. S. E. Shreve, Stochastic Calculus for Finance, Vol. I & Vol. II, Springer, 2004.

  5. V. G. Kulkarni, Modeling and Analysis of Stochastic Systems, Chapman & Hall, 1995.

  6. G. Sankaranarayanan, Branching Processes and Its Estimation Theory, Wiley, 1989.

Important: Please enable javascript in your browser and download Adobe Flash player to view this site
Site Maintained by Web Studio, IIT Madras. Contact Webmaster: