M/M/c queue explained

In queueing theory, a discipline within the mathematical theory of probability, the M/M/c queue (or Erlang–C model[1]) is a multi-server queueing model.[2] In Kendall's notation it describes a system where arrivals form a single queue and are governed by a Poisson process, there are servers, and job service times are exponentially distributed.[3] It is a generalisation of the M/M/1 queue which considers only a single server. The model with infinitely many servers is the M/M/∞ queue.

Model definition

An M/M/c queue is a stochastic process whose state space is the set where the value corresponds to the number of customers in the system, including any currently in service.

The model can be described as a continuous time Markov chain with transition rate matrix

on the state space The model is a type of birth–death process. We write  = / for the server utilization and require  < 1 for the queue to be stable. represents the average proportion of time which each of the servers is occupied (assuming jobs finding more than one vacant server choose their servers randomly).

The state space diagram for this chain is as below.

Stationary analysis

Number of customers in the system

If the traffic intensity is greater than one then the queue will grow without bound but if server utilization

\rho=

λ
c\mu

<1

then the system has a stationary distribution with probability mass function[4] [5]

where is the probability that the system contains customers.

The probability that an arriving customer is forced to join the queue (all servers are occupied) is given by

which is referred to as Erlang's C formula and is often denoted C(/) or E2,(/). The average number of customers in the system (in service and in the queue) is given by[6]

Busy period of server

The busy period of the M/M/c queue can either refer to:

Write[8] [9]  = min( t:  jobs in the system at time 0+ and  − 1 jobs in the system at time) and for the Laplace–Stieltjes transform of the distribution of . Then

  1. For  > , has the same distribution as .
  2. For  = ,
  3. For  < ,

Response time

The response time is the total amount of time a customer spends in both the queue and in service. The average response time is the same for all work conserving service disciplines and is

Customers in first-come, first-served discipline

The customer either experiences an immediate exponential service, or must wait for customers to be served before their own service, thus experiencing an Erlang distribution with shape parameter  + 1.[10]

Customers in processor sharing discipline

In a processor sharing queue the service capacity of the queue is split equally between the jobs in the queue. In the M/M/c queue this means that when there are or fewer jobs in the system, each job is serviced at rate . However, when there are more than jobs in the system the service rate of each job decreases and is

c\mu
n
where is the number of jobs in the system. This means that arrivals after a job of interest can impact the service time of the job of interest. The Laplace–Stieltjes transform of the response time distribution has been shown to be a solution to a Volterra integral equation from which moments can be computed.[11] An approximation has been offered for the response time distribution.[12] [13]

Finite capacity

In an M/M// queue only customers can queue at any one time (including those in service). Any further arrivals to the queue are considered "lost". We assume that  ≥ . The model has transition rate matrixon the state space . In the case where  = , the M/M// queue is also known as the Erlang–B model.

Transient analysis

See Takács for a transient solution[14] and Stadje for busy period results.[15]

Stationary analysis

Stationary probabilities are given by[16]

The average number of customers in the system is and the average time in the system for a customer is

The average time in the queue for a customer is

The average number of customers in the queue can be obtained by using the effective arrival rate. The effective arrival rate is calculated by

Thus we can obtain the average number of customers in the queue by

An implementation of the above calculations in Python can be found.[17]

Heavy-traffic limits

Writing for the number of customers in the system at time, it can be shown that under three different conditions the processconverges to a diffusion process.

  1. Fix and, increase and scale by  = 1/(1 − )2.
  2. Fix and, increase and, and scale by  = .
  3. Fix as a constant where

and increase and using the scale  =  or  = 1/(1 − )2. This case is called the Halfin–Whitt regime.[18]

See also

Notes and References

  1. Book: Gautam, Natarajan . Analysis of Queues: Methods and Applications . CRC Press . 2012 . 9781439806586.
  2. Book: Peter . Harrison . Peter G. Harrison . Naresh M. . Patel . Performance Modelling of Communication Networks and Computer Architectures . Addison–Wesley . 1992 . 173.
  3. Kendall . D. G. . David George Kendall . Stochastic Processes Occurring in the Theory of Queues and their Analysis by the Method of the Imbedded Markov Chain . 10.1214/aoms/1177728975 . 2236285 . The Annals of Mathematical Statistics . 24 . 3 . 338–354 . 1953 . free.
  4. Book: Queueing Systems Volume 1: Theory . Leonard . Kleinrock . Leonard Kleinrock . 0471491101 . 1975 . 101–103, 404.
  5. Book: G. . Bolch . S. . Greiner . H. . de Meer . K. S. . Trivedi . 10.1002/0471200581.ch6 . Single Station Queueing Systems . Queueing Networks and Markov Chains . limited . 209–262 . 1998 . 0471193666.
  6. Book: Principles of Ad-hoc Networking . limited . 42 . Michel . Barbeau . Evangelos . Kranakis . John Wiley & Sons . 2007 . 978-0470032909.
  7. J. R.. Artalejo . M. J. . Lopez-Herrero . 2001 . Analysis of the Busy Period for the M/M/c Queue: An Algorithmic Approach . Journal of Applied Probability . 38 . 1 . 209–222 . 3215752 . 10.1239/jap/996986654. 123361268 .
  8. Omahen . K. . Marathe . V. . 10.1145/322063.322072 . Analysis and Applications of the Delay Cycle for the M/M/c Queueing System . . 25 . 2 . 283 . 1978 . 16257795 . free .
  9. Daley . D. J. . Servi . L. D. . 10.1239/jap/1032438390 . Idle and busy periods in stable M / M / k queues . Journal of Applied Probability . 35 . 4 . 950 . 1998. 121993161 .
  10. Web site: ITU/ITC Teletraffic Engineering Handbook . Villy B. . Iversen . June 20, 2001 . August 7, 2012.
  11. Braband . J. . Waiting time distributions for M/M/N processor sharing queues . 10.1080/15326349408807309 . . 10 . 3 . 533–548 . 1994.
  12. Braband . J. . Waiting time distributions for closed M/M/N processor sharing queues . 10.1007/BF01150417 . . 19 . 3 . 331–344 . 1995. 6284577 .
  13. Book: Jens . Braband . Rolf . Schassberger . Random Quantum Allocation: A New Approach to Waiting Time Distributions for M/M/N Processor Sharing Queues . Messung, Modellierung und Bewertung von Rechen- und Kommunikationssystemen: 7. ITG/GI-Fachtagung . 21–23 September 1993 . Bernhard H. . Walke . Bernhard H. Walke . Otto . Spaniol .

    de:Otto Spaniol

    . Aachen, Germany . Springer . 130–142 . 3540572015.
  14. Book: Takács, L. . Lajos Takács . Introduction to the Theory of Queues . London . Oxford University Press . 1962 . 12–21.
  15. Stadje . W. . 10.1016/0304-4149(94)00032-O . The busy periods of some queueing systems . Stochastic Processes and Their Applications . 55 . 159–167 . 1995. free .
  16. Book: Allen, Arnold O. . Probability, Statistics, and Queueing Theory: With Computer Science Applications . Gulf Professional Publishing . 1990 . 0120510510 . 679–680 .
  17. Web site: Basic Calculator for Queueing Theory . .
  18. Shlomo . Halfin . Ward . Whitt . Ward Whitt . 1981 . Heavy-Traffic Limits for Queues with Many Exponential Servers . . 29 . 3 . 567–588 . 170115 . 10.1287/opre.29.3.567 .

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "M/M/c queue".

Except where otherwise indicated, Everything.Explained.Today is © Copyright 2009-2024, A B Cryer, All Rights Reserved. Cookie policy.