IE 301 • Final • Operations Research II

From Discrete to Continuous

Example 1

Example 2

Example 3

Steady State Distribution

Q Matrix

Example 4

Example 5

Example 6

A subproblem of CTMC

Random Rates, Finite Chain

Example 1

Random Rates, Infinite Chain

Example 2

Equal Rates, Infinite Chain, Single Server

Example 3

Equal Rates, Finite Chain, Single Server

Example 4

Equal Rates, Finite Chain, Multiple Servers

Example 5

Kendall's Notation

Terminology

M/M/1 Queue

Example 1

M/M/s Queue

Example 2

M/M/1/K Queue

Example 3

M/M/s/K Queue

Example 4

Introduction

Policy Improvement Algorithm: Step 1

Policy Improvement Algorithm: Step 2

Example 1

LP Solution

LP Solution with Discount

Continuous Time Markov Chains 1

Continuous Time Markov Chains 2

Continuous Time Markov Chains 3

Continuous Time Markov Chains 4

Continuous Time Markov Chains 5

Birth and Death 1

Birth and Death 2

Birth and Death 3

Birth and Death 4

Queueing Theory 1

Queueing Theory 2

Queueing Theory 3

Queueing Theory 4

Queueing Theory 5

Queueing Theory 6

Queueing Theory 7

Queueing Theory 8

Markov Decision Process 1