IE 301 • Operations Research II • Midterm

Markov Property & One Step Transition Matrix

N-Step Transition Matrix

Unconditional Probabilities

Exam-like Question 1

Classification of States

Steady State Probabilities 1

Steady State Probabilities 2

Expected Recurrence Time

Exam-like Question 3

First Passage Time

Expected First Passage Time

Absorbing State

Best Exam-like Question

Creating a Transition Matrix (Important)

Exam-like Question 5

Transition Rate Matrix

Steady State Equations

Transition Rate Matrix 2

Exam Like Question 1

Exponential Distribution

Example 1

Example 2

Memoryless Property

Example 3

Exam Like Question 1

Exam Like Question 2

Exponential Distribution 1

Poisson Processes 1

Exponential Distribution 2

Poisson Processes 2

Exam Like Question 1

Exam Like Question 2

Discrete Time Markov Chains 1

Discrete Time Markov Chains 2

Discrete Time Markov Chains 3

Discrete Time Markov Chains 4

Discrete Time Markov Chains 5

Discrete Time Markov Chains 6

Discrete Time Markov Chains 7

Discrete Time Markov Chains 7

Discrete Time Markov Chains 9

Discrete Time Markov Chains 10

Poisson Processes 1

Poisson Processes 2

Poisson Processes 3

CTMC - Birth and Death 1

CTMC - Birth and Death 2

CTMC - Birth and Death 3

Performance Measures 1

Performance Measure 2

Birth and Death Process 1

Birth and Death Process 2

Birth and Death Process 3