The Annals of Applied Probability

Stability of join the shortest queue networks

Maury Bramson

Full-text: Open access


Join the shortest queue (JSQ) refers to networks whose incoming jobs are assigned to the shortest queue from among a randomly chosen subset of the queues in the system. After completion of service at the queue, a job leaves the network. We show that, for all nonidling service disciplines and for general interarrival and service time distributions, such networks are stable when they are subcritical. We then obtain uniform bounds on the tails of the marginal distributions of the equilibria for families of such networks; these bounds are employed to show relative compactness of the marginal distributions. We also present a family of subcritical JSQ networks whose workloads in equilibrium are much larger than for the corresponding networks where each incoming job is assigned randomly to a queue. Part of this work generalizes results in [Queueing Syst. 29 (1998) 55–73], which applied fluid limits to study networks with the FIFO discipline. Here, we apply an appropriate Lyapunov function.

Article information

Ann. Appl. Probab., Volume 21, Number 4 (2011), 1568-1625.

First available in Project Euclid: 8 August 2011

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 60K25: Queueing theory [See also 68M20, 90B22] 68M20: Performance evaluation; queueing; scheduling [See also 60K25, 90Bxx] 90B15: Network models, stochastic

Join the shortest queue stability


Bramson, Maury. Stability of join the shortest queue networks. Ann. Appl. Probab. 21 (2011), no. 4, 1568--1625. doi:10.1214/10-AAP726.

Export citation


  • [1] Azar, Y., Broder, A., Karlin, A. and Upfal, E. (1994). Balanced allocations. In Proc. 26th. ACM Symp. Theory Comp. 593–602.
  • [2] Billingsley, P. (1968). Convergence of Probability Measures. Wiley, New York.
  • [3] Bramson, M. (1998). Stability of two families of queueing networks and a discussion of fluid limits. Queueing Systems Theory Appl. 28 7–31.
  • [4] Bramson, M. (2008). Stability of Queueing Networks. Lecture Notes in Math. 1950. Springer, Berlin.
  • [5] Bramson, M. (2010). Network stability under max–min fair bandwidth sharing. Ann. Appl. Probab. 20 1126–1176.
  • [6] Bramson, M., Lu, Y. and Prabhakar, B. (2010). Randomized load balancing with general service time distributions. In Proc. ACM SIGMETRICS 2010 275–286. ACM, New York.
  • [7] Bramson, M., Lu, Y. and Prabhakar, B. (2011). Asymptotic independence of queues under randomized load balancing. Queueing Systems Theory Appl. Sumbitted.
  • [8] Dai, J. G. (1995). On positive Harris recurrence of multiclass queueing networks: A unified approach via fluid limit models. Ann. Appl. Probab. 5 49–77.
  • [9] Davis, M. H. A. (1993). Markov Models and Optimization. Monographs on Statistics and Applied Probability 49. Chapman and Hall, London.
  • [10] Foley, R. D. and McDonald, D. R. (2001). Join the shortest queue: Stability and exact asymptotics. Ann. Appl. Probab. 11 569–607.
  • [11] Foss, S. and Chernova, N. (1998). On the stability of a partially accessible multi-station queue with state-dependent routing. Queueing Systems Theory Appl. 29 55–73.
  • [12] Luczak, M. J. and McDiarmid, C. (2005). On the power of two choices: Balls and bins in continuous time. Ann. Appl. Probab. 15 1733–1764.
  • [13] Luczak, M. J. and McDiarmid, C. (2006). On the maximum queue length in the supermarket model. Ann. Probab. 34 493–527.
  • [14] Martin, J. B. and Suhov, Y. M. (1999). Fast Jackson networks. Ann. Appl. Probab. 9 854–870.
  • [15] Meyn, S. P. and Tweedie, R. L. (1993). Generalized resolvents and Harris recurrence of Markov processes. In Doeblin and Modern Probability (Blaubeuren, 1991). Contemp. Math. 149 227–250. Amer. Math. Soc., Providence, RI.
  • [16] Mitzenmacher, M. (2001). The power of two choices in randomized load balancing. IEEE Transactions on Parallel and Distributed Systems 12 1094–1104.
  • [17] Nummelin, E. (1984). General Irreducible Markov Chains and Nonnegative Operators. Cambridge Tracts in Mathematics 83. Cambridge Univ. Press, Cambridge.
  • [18] Orey, S. (1971). Lecture Notes on Limit Theorems for Markov Chain Transition Probabilities. Van Nostrand Reinhold, London.
  • [19] Suhov, Y. M. and Vvedenskaya, N. D. (2002). Fast Jackson networks with dynamic routing. Problems Inf. Transmission 38 136–153.
  • [20] Vöcking, B. (1999). How asymmetry helps load balancing. In 40th Annual Symposium on Foundations of Computer Science (New York, 1999) 131–141. IEEE Computer Soc., Los Alamitos, CA.
  • [21] Vvedenskaya, N. D., Dobrushin, R. L. and Karpelevich, F. I. (1996). Queueing system with selection of the shortest of two queues: An asymptotic approach. Probl. Inform. Trans. 32 15–29.
  • [22] Vvedenskaya, N. D. and Suhov, Y. M. (1997). Dobrushin’s mean-field approximation for a queue with dynamic routing. Markov Process. Related Fields 3 493–526.