Probability & Stats 3: Markov Chains & Stochastic Processes

Video Lectures

Displaying all 38 video lectures.
Lecture 1
What are Markov Chains: An Introduction
Play Video		 What are Markov Chains: An Introduction
In this video I will introduce Markov chains and how it predicts the probability of future outcomes.

Next video in the Markov Chains series:
http://youtu.be/3P8ZIIYgpvc
Lecture 2
Markov Chains: An Introduction (Another Method)
Play Video		 Markov Chains: An Introduction (Another Method)
In this video I will introduce an alternative method of solving the Markov chain.

Next video in the Markov Chains series:
http://youtu.be/ECrsoUtsKq0
Lecture 3
Why Are Markov Chains Called
Play Video		 Why Are Markov Chains Called "Markov Chains"?
In this video I will explain why the Markov chain is call the “Markov chain”.

Next video in the Markov Chains series:
http://youtu.be/bBZrKmP020c
Lecture 4
Another Way to Calculate the Markov Chains
Play Video		 Another Way to Calculate the Markov Chains
In this video I will show an alternative method to calculate the 2nd, 3rd, 4th,...states of Markov chain.

Next video in the Markov Chains series:
http://youtu.be/9wBPa2eu_lc
Lecture 5
What Happens if the Markov Chain Continues?
Play Video		 What Happens if the Markov Chain Continues?
In this video I will show what happens when the Markov chain is allowed to continued to the nth state.

Next video in the Markov Chains series:
http://youtu.be/xgvgN4fUqcs
Lecture 6
Markov Chain Applied to Market Penetration
Play Video		 Markov Chain Applied to Market Penetration
In this video I will explain how Markov chain can be used to introduce a new product into the market.

Next video in the Markov Chains series:
http://youtu.be/KBCZ7o8XLKU
Lecture 7
Power of the Probability Matrix
Play Video		 Power of the Probability Matrix
In this video I will find the stable probability matrix.

Next video in the Markov Chains series:
http://youtu.be/VXntl6MqRIo
Lecture 8
What is a Stochastic Matrix?
Play Video		 What is a Stochastic Matrix?
In this video I will explain what is a stochastic matrix.

Next video in the Markov Chains series:
http://youtu.be/YMUwWV1IGdk
Lecture 9
What is a Regular Matrix?
Play Video		 What is a Regular Matrix?
In this video I will explain what is a regular matrix.

Next video in the Markov Chains series:
http://youtu.be/loBUEME5chQ
Lecture 10
Regular Markov Chain
Play Video		 Regular Markov Chain
In this video I will explain what is a regular Markov chain.

Next video in the Markov Chains series:
http://youtu.be/DeG8MlORxRA
Lecture 11
How to Check for a Stable Distribution Matrix
Play Video		 How to Check for a Stable Distribution Matrix
In this video I will show how to check for a stable distribution matrix.

Next video in the Markov Chains series:
http://youtu.be/cSKXAaIhW6w
Lecture 12
How to Find a Stable 2x2 Matrix - Ex. 1
Play Video		 How to Find a Stable 2x2 Matrix - Ex. 1
In this video I will find the stable probability and distribution matrix, example 1, 2x2 matrix.

Next video in the Markov Chains series:
http://youtu.be/C1hs3EQS_jo
Lecture 13
How to Find a Stable 2x2 Matrix - Ex. 2
Play Video		 How to Find a Stable 2x2 Matrix - Ex. 2
In this video I will find the stable probability and distribution matrix, example 2, 2x2 matrix.

Next video in the Markov Chains series:
http://youtu.be/vxdUtjoxWvE
Lecture 14
How to Find a Stable 2x2 Matrix - Ex. 3
Play Video		 How to Find a Stable 2x2 Matrix - Ex. 3
In this video I will find the stable probability and distribution matrix, example 3, of customers of 2 stores.

Next video in the Markov Chains series:
http://youtu.be/ZENBQj2qQ2k
Lecture 15
How to Find a Stable 3x3 Matrix
Play Video		 How to Find a Stable 3x3 Matrix
In this video I will find the stable probability and distribution matrix, 3x3 matrix.

Next video in the Markov Chains series:
http://youtu.be/87u7a2XGq1s
Lecture 16
Application Problem #1, Charity Contributions
Play Video		 Application Problem #1, Charity Contributions
In this video I will find the final (stable) distribution matrix of charitable contributions.

Next video in the Markov Chains series:
http://youtu.be/Na4m8HSpZSo
Lecture 17
Application Problem #2, Grocery Stores
Play Video		 Application Problem #2, Grocery Stores
In this video I will find the final (stable) distribution matrix of distribution matrix of customers of 2 stores.

Next video in the Markov Chains series:https://youtu.be/7_NI_9L35t0
Lecture 18
Application Problem #3, Brand Loyalty
Play Video		 Application Problem #3, Brand Loyalty
In this video I will find the stable distribution matrix (3x3) of brand loyalty.

Next video in the Markov Chains series:
http://youtu.be/bpWV66hnRvQ
Lecture 19
Absorbing Markov Chains - Definition 1
Play Video		 Absorbing Markov Chains - Definition 1
In this video I will define the absorbing Markov chain using examples and graphically.

Next video in the Markov Chains series:
http://youtu.be/S_QPpEELwZk
Lecture 20
Absorbing Markov Chains - Definition 2
Play Video		 Absorbing Markov Chains - Definition 2
In this video I will define the absorbing Markov in a nxn matrix and 3x3 matrix.

Next video in the Markov Chains series:
http://youtu.be/cZKAVOEWcrg
Lecture 21
Absorbing Markov Chains - Example 1
Play Video		 Absorbing Markov Chains - Example 1
In this video I will find the stable distribution matrix in an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/1bErNmzD8Sw
Lecture 22
Absorbing Markov Chains - Example 2
Play Video		 Absorbing Markov Chains - Example 2
In this video I will find the stable transition matrix in an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/hMceS_HIcKY
Lecture 23
Absorbing and Non-Absorbing Markov Chain
Play Video		 Absorbing and Non-Absorbing Markov Chain
In this video I will explain the difference between an absorbing and non-absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/UuZU3LUBalQ
Lecture 24
Absorbing Markov Chain in Standard Form
Play Video		 Absorbing Markov Chain in Standard Form
In this video I will find the standard form of a transition matrix, 3x3 and 4x4.

Next video in the Markov Chains series:
http://youtu.be/bj_O4edCwgc
Lecture 25
Absorbing Markov Chain: Stable Matrix=?
Play Video		 Absorbing Markov Chain: Stable Matrix=?
In this video I will find the stable transition matrix in an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/72Ipee3ueUs
Lecture 26
Absorbing Markov Chain: Stable Matrix=? Ex. 1
Play Video		 Absorbing Markov Chain: Stable Matrix=? Ex. 1
In this video I will find the stable transition matrix (3x3) in an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/TWq0CvkAWVg
Lecture 27
Absorbing Markov Chain: Stable Matrix=? Ex. 2
Play Video		 Absorbing Markov Chain: Stable Matrix=? Ex. 2
In this video I will find the stable transition matrix (4x4) in an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/u89Sd514EDI
Lecture 28
Absorbing Markov Chain: Stable Distribution Matrix I
Play Video		 Absorbing Markov Chain: Stable Distribution Matrix I
In this video I will find the stable distribution matrix after finding stable transition matrix.

Next video in the Markov Chains series:
http://youtu.be/0iNR2_gCM7I
Lecture 29
Absorbing Markov Chain: Stable Distribution Matrix II
Play Video		 Absorbing Markov Chain: Stable Distribution Matrix II
In this video I will find the stable distribution matrix (4x4) when there is only 1 absorbing state.

Next video in the Markov Chains series:
http://youtu.be/EAZ4K1Z7qws
Lecture 30
Basics of Solving Markov Chains
Play Video		 Basics of Solving Markov Chains
In this video I will demonstrate the basics of method 2 of solving Markov chain problems.

Next video in the Markov Chains series:
Lecture 31
Powers of a Transition Matrix
Play Video		 Powers of a Transition Matrix
In this video I will use method 2 to find the stable transition matrix (3x3).

Next video in the Markov Chains series:
http://youtu.be/SSeoW9IrVaw
Lecture 32
Finding Stable State Matrix
Play Video		 Finding Stable State Matrix
In this video I will use method 2 to find the stable state matrix (3x3).

Next video in the Markov Chains series:
http://youtu.be/5_Hb0lvlbH4
Lecture 33
What is an Absorbing Markov Chain
Play Video		 What is an Absorbing Markov Chain
In this video I will explain the method 2 transition matrix for an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/p_6poNVikn8
Lecture 34
Finding the Stable State Matrix
Play Video		 Finding the Stable State Matrix
In this video I will use method 2 to find the stable state and stable transition matrices (3x3).

Next video in the Markov Chains series:
http://youtu.be/uferdSl_e5E
Lecture 35
Finding the Stable State & Transition Matrices
Play Video		 Finding the Stable State & Transition Matrices
In this video I will explain the standard form of the absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/MrmMyK5CuWs
Lecture 36
Absorbing Markov Chain: Standard Form - Ex.
Play Video		 Absorbing Markov Chain: Standard Form - Ex.
In this video I will use method 2 to find the final stable transition matrix given an absorbing Markov chain.

Next video in the Markov Chains series:
http://youtu.be/gPOiDeHZX4E
Lecture 37
Absorbing Markov Chain: Changing to Standard Form
Play Video		 Absorbing Markov Chain: Changing to Standard Form
In this video I will find the standard form of absorbing Markov chains when there are 2 absorbing states.

Next video in the Markov Chains series:
http://youtu.be/LUtqqJ9VFhU
Lecture 38
Absorbing Markov Chain: Standard Form - Ex.
Play Video		 Absorbing Markov Chain: Standard Form - Ex.
In this video I will find the stable transition and stable state matrices of a standard Markov chain when there are 2 absorbing states.

First video in the Markov Chains series:
https://youtu.be/Uz3JIp6EvIg