Stochastic Processes

Video Lectures

Displaying all 39 video lectures.
I. Review of Probability Theory
Lecture 1
Introduction to Stochastic Processes
Play Video
Introduction to Stochastic Processes
Lecture 2
Introduction to Stochastic Processes (Contd.)
Play Video
Introduction to Stochastic Processes (Contd.)
Lecture 3
Problems in Random Variables and Distributions
Play Video
Problems in Random Variables and Distributions
Lecture 4
Problems in Sequences of Random Variables
Play Video
Problems in Sequences of Random Variables
II. Definition and Simple Stochastic Processes
Lecture 5
Definition, Classification and Examples
Play Video
Definition, Classification and Examples
Lecture 6
Simple Stochastic Processes
Play Video
Simple Stochastic Processes
III. Stationary and Auto Regressive Processes
Lecture 7
Stationary Processes
Play Video
Stationary Processes
Lecture 8
Autoregressive Processes
Play Video
Autoregressive Processes
Lecture 9
Introduction, Definition and Transition Probability Matrix
Play Video
Introduction, Definition and Transition Probability Matrix
Lecture 10
Chapman-Kolmogrov Equations
Play Video
Chapman-Kolmogrov Equations
IV. Discrete-time Markov Chain
Lecture 11
Classification of States and Limiting Distributions
Play Video
Classification of States and Limiting Distributions
Lecture 12
Limiting and Stationary Distributions
Play Video
Limiting and Stationary Distributions
Lecture 13
Limiting Distributions, Ergodicity and Stationary Distributions
Play Video
Limiting Distributions, Ergodicity and Stationary Distributions
Lecture 14
Time Reversible Markov Chain
Play Video
Time Reversible Markov Chain
Lecture 15
Reducible Markov Chains
Play Video
Reducible Markov Chains
V. Continuous-time Markov Chain
Lecture 16
Definition, Kolmogrov Differential Equations and Infinitesimal Generator Matrix
Play Video
Definition, Kolmogrov Differential Equations and Infinitesimal Generator Matrix
Lecture 17
Limiting and Stationary Distributions, Birth Death Processes
Play Video
Limiting and Stationary Distributions, Birth Death Processes
Lecture 18
Poisson Processes
Play Video
Poisson Processes
Lecture 19
M/M/1 Queueing Model
Play Video
M/M/1 Queueing Model
Lecture 20
Simple Markovian Queueing Models
Play Video
Simple Markovian Queueing Models
Lecture 21
Queueing Networks
Play Video
Queueing Networks
Lecture 22
Communication Systems
Play Video
Communication Systems
Lecture 23
Stochastic Petri Nets
Play Video
Stochastic Petri Nets
VI. Martingales
Lecture 24
Conditional Expectation and Filtration
Play Video
Conditional Expectation and Filtration
Lecture 25
Definition and Simple Examples
Play Video
Definition and Simple Examples
VII. Brownian Motion and its Applications
Lecture 26
Definition and Properties
Play Video
Definition and Properties
Lecture 27
Processes Derived from Brownian Motion
Play Video
Processes Derived from Brownian Motion
Lecture 28
Stochastic Differential Equations
Play Video
Stochastic Differential Equations
Lecture 29
Ito Integrals
Play Video
Ito Integrals
Lecture 30
Ito Formula and its Variants
Play Video
Ito Formula and its Variants
Lecture 31
Some Important SDE`s and Their Solutions
Play Video
Some Important SDE`s and Their Solutions
VIII. Renewal Processes
Lecture 32
Renewal Function and Renewal Equation
Play Video
Renewal Function and Renewal Equation
Lecture 33
Generalized Renewal Processes and Renewal Limit Theorems
Play Video
Generalized Renewal Processes and Renewal Limit Theorems
Lecture 34
Markov Renewal and Markov Regenerative Processes
Play Video
Markov Renewal and Markov Regenerative Processes
Lecture 35
Non Markovian Queues
Play Video
Non Markovian Queues
Lecture 36
Non Markovian Queues Cont,,
Play Video
Non Markovian Queues Cont,,
Lecture 37
Application of Markov Regenerative Processes
Play Video
Application of Markov Regenerative Processes
IX. Branching Processes
Lecture 38
Galton-Watson Process
Play Video
Galton-Watson Process
Lecture 39
Markovian Branching Process
Play Video
Markovian Branching Process