The Annals of Applied Probability

Ergodicity of a Lévy-driven SDE arising from multiclass many-server queues

Ari Arapostathis, Guodong Pang, and Nikola Sandrić

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber. If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text


We study the ergodic properties of a class of multidimensional piecewise Ornstein–Uhlenbeck processes with jumps, which contains the limit of the queueing processes arising in multiclass many-server queues with heavy-tailed arrivals and/or asymptotically negligible service interruptions in the Halfin–Whitt regime as special cases. In these queueing models, the Itô equations have a piecewise linear drift, and are driven by either (1) a Brownian motion and a pure-jump Lévy process, or (2) an anisotropic Lévy process with independent one-dimensional symmetric $\alpha $-stable components or (3) an anisotropic Lévy process as in (2) and a pure-jump Lévy process. We also study the class of models driven by a subordinate Brownian motion, which contains an isotropic (or rotationally invariant) $\alpha $-stable Lévy process as a special case. We identify conditions on the parameters in the drift, the Lévy measure and/or covariance function which result in subexponential and/or exponential ergodicity. We show that these assumptions are sharp, and we identify some key necessary conditions for the process to be ergodic. In addition, we show that for the queueing models described above with no abandonment, the rate of convergence is polynomial, and we provide a sharp quantitative characterization of the rate via matching upper and lower bounds.

Article information

Ann. Appl. Probab., Volume 29, Number 2 (2019), 1070-1126.

Received: July 2017
Revised: May 2018
First available in Project Euclid: 24 January 2019

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 60J75: Jump processes 60H10: Stochastic ordinary differential equations [See also 34F05]
Secondary: 60G17: Sample path properties 60J25: Continuous-time Markov processes on general state spaces 60K25: Queueing theory [See also 68M20, 90B22]

Multidimensional piecewise Ornstein–Uhlenbeck processes with jumps pure-jump Lévy process (an)isotropic Lévy process (sub)exponential ergodicity multiclass many-server queues Halfin–Whitt regime heavy-tailed arrivals service interruptions


Arapostathis, Ari; Pang, Guodong; Sandrić, Nikola. Ergodicity of a Lévy-driven SDE arising from multiclass many-server queues. Ann. Appl. Probab. 29 (2019), no. 2, 1070--1126. doi:10.1214/18-AAP1430.

Export citation


  • [1] Albeverio, S., Brzeźniak, Z. and Wu, J.-L. (2010). Existence of global solutions and invariant measures for stochastic differential equations driven by Poisson type noise with non-Lipschitz coefficients. J. Math. Anal. Appl. 371 309–322.
  • [2] Andrieu, C., Fort, G. and Vihola, M. (2015). Quantitative convergence rates for subgeometric Markov chains. J. Appl. Probab. 52 391–404.
  • [3] Arapostathis, A., Biswas, A. and Caffarelli, L. (2016). The Dirichlet problem for stable-like operators and related probabilistic representations. Comm. Partial Differential Equations 41 1472–1511.
  • [4] Arapostathis, A., Biswas, A. and Pang, G. (2015). Ergodic control of multi-class $M/M/N+M$ queues in the Halfin–Whitt regime. Ann. Appl. Probab. 25 3511–3570.
  • [5] Arapostathis, A., Borkar, V. S. and Ghosh, M. K. (2012). Ergodic Control of Diffusion Processes. Encyclopedia of Mathematics and Its Applications 143. Cambridge Univ. Press, Cambridge.
  • [6] Arapostathis, A., Caffarelli, L., Pang, G. and Zheng, Y. (2018). Ergodic control of a class of jump diffusions with finite Lévy measures and rough kernels. Available at arXiv:1801.07669.
  • [7] Arapostathis, A. and Pang, G. (2016). Ergodic diffusion control of multiclass multi-pool networks in the Halfin–Whitt regime. Ann. Appl. Probab. 26 3110–3153.
  • [8] Arapostathis, A. and Pang, G. (2018). Infinite horizon average optimality of the N-network in the Halfin–Whitt regime. Math. Oper. Res. 43 838–866.
  • [9] Arapostathis, A. and Pang, G. (2018). Infinite horizon asymptotic average optimality for large-scale parallel server networks. Stochastic Process. Appl. To appear.
  • [10] Bass, R. F. and Chen, Z.-Q. (2006). Systems of equations driven by stable processes. Probab. Theory Related Fields 134 175–214.
  • [11] Bass, R. F. and Chen, Z.-Q. (2010). Regularity of harmonic functions for a class of singular stable-like processes. Math. Z. 266 489–503.
  • [12] Blumenthal, R. M. and Getoor, R. K. (1968). Markov Processes and Potential Theory. Pure and Applied Mathematics 29. Academic Press, New York.
  • [13] Butkovsky, O. (2014). Subgeometric rates of convergence of Markov processes in the Wasserstein metric. Ann. Appl. Probab. 24 526–552.
  • [14] Chaker, J. (2016). Regularity of solutions to anisotropic nonlocal equations. Available at arXiv:1607.08135.
  • [15] Connor, S. B. and Fort, G. (2009). State-dependent Foster–Lyapunov criteria for subgeometric convergence of Markov chains. Stochastic Process. Appl. 119 4176–4193.
  • [16] Dai, J. G., He, S. and Tezcan, T. (2010). Many-server diffusion limits for $G/Ph/n+GI$ queues. Ann. Appl. Probab. 20 1854–1890.
  • [17] Dieker, A. B. and Gao, X. (2013). Positive recurrence of piecewise Ornstein–Uhlenbeck processes and common quadratic Lyapunov functions. Ann. Appl. Probab. 23 1291–1317.
  • [18] Douc, R., Fort, G. and Guillin, A. (2009). Subgeometric rates of convergence of $f$-ergodic strong Markov processes. Stochastic Process. Appl. 119 897–923.
  • [19] Douc, R., Fort, G., Moulines, E. and Soulier, P. (2004). Practical drift conditions for subgeometric rates of convergence. Ann. Appl. Probab. 14 1353–1377.
  • [20] Down, D., Meyn, S. P. and Tweedie, R. L. (1995). Exponential and uniform ergodicity of Markov processes. Ann. Probab. 23 1671–1691.
  • [21] Durmus, A., Fort, G. and Moulines, É. (2016). Subgeometric rates of convergence in Wasserstein distance for Markov chains. Ann. Inst. Henri Poincaré Probab. Stat. 52 1799–1822.
  • [22] Ethier, S. N. and Kurtz, T. G. (1986). Markov Processes: Characterization and Convergence. Wiley, New York.
  • [23] Fort, G. and Roberts, G. O. (2005). Subgeometric ergodicity of strong Markov processes. Ann. Appl. Probab. 15 1565–1589.
  • [24] Golomoziĭ, V. V. (2009). A subgeometric estimate for the stability of time-homogeneous Markov chains. Teor. Ĭmovīr. Mat. Stat. 81 31–45.
  • [25] Gyöngy, I. and Krylov, N. (1996). Existence of strong solutions for Itô’s stochastic equations via approximations. Probab. Theory Related Fields 105 143–158.
  • [26] Hairer, M. (2016). Convergence of Markov processes. Lecture Notes, University of Warwick. Available at
  • [27] Halfin, S. and Whitt, W. (1981). Heavy-traffic limits for queues with many exponential servers. Oper. Res. 29 567–588.
  • [28] Hou, Z., Liu, Y. and Zhang, H. (2005). Subgeometric rates of convergence for a class of continuous-time Markov process. J. Appl. Probab. 42 698–712.
  • [29] Kevei, P. (2018). Ergodic properties of generalized Ornstein–Uhlenbeck processes. Stochastic Process. Appl. 128 156–181.
  • [30] King, C. and Nathanson, M. (2006). On the existence of a common quadratic Lyapunov function for a rank one difference. Linear Algebra Appl. 419 400–416.
  • [31] Kulik, A. M. (2009). Exponential ergodicity of the solutions to SDE’s with a jump noise. Stochastic Process. Appl. 119 602–632.
  • [32] Kusuoka, S. and Marinelli, C. (2014). On smoothing properties of transition semigroups associated to a class of SDEs with jumps. Ann. Inst. Henri Poincaré Probab. Stat. 50 1347–1370.
  • [33] Kwon, Y. and Lee, C. (1999). Strong Feller property and irreducibility of diffusions with jumps. Stoch. Stoch. Rep. 67 147–157.
  • [34] Liu, Y., Zhang, H. and Zhao, Y. (2010). Subgeometric ergodicity for continuous-time Markov chains. J. Math. Anal. Appl. 368 178–189.
  • [35] Masuda, H. (2004). On multidimensional Ornstein–Uhlenbeck processes driven by a general Lévy process. Bernoulli 10 97–120.
  • [36] Masuda, H. (2007). Ergodicity and exponential $\beta$-mixing bounds for multidimensional diffusions with jumps. Stochastic Process. Appl. 117 35–56.
  • [37] Masuda, H. (2009). Erratum to: “Ergodicity and exponential $\beta$-mixing bound for multidimensional diffusions with jumps” [Stochastic Process. Appl. 117 (2007) 35–56] [MR2287102]. Stochastic Process. Appl. 119 676–678.
  • [38] Meyn, S. and Tweedie, R. L. (2009). Markov Chains and Stochastic Stability, 2nd ed. Cambridge Univ. Press, Cambridge.
  • [39] Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes. II. Continuous-time processes and sampled chains. Adv. in Appl. Probab. 25 487–517.
  • [40] Meyn, S. P. and Tweedie, R. L. (1993). Stability of Markovian processes. III. Foster–Lyapunov criteria for continuous-time processes. Adv. in Appl. Probab. 25 518–548.
  • [41] Pang, G. and Whitt, W. (2009). Heavy-traffic limits for many-server queues with service interruptions. Queueing Syst. 61 167–202.
  • [42] Pang, G. and Whitt, W. (2010). Continuity of a queueing integral representation in the $M_{1}$ topology. Ann. Appl. Probab. 20 214–237.
  • [43] Peszat, S. and Zabczyk, J. (1995). Strong Feller property and irreducibility for diffusions on Hilbert spaces. Ann. Probab. 23 157–172.
  • [44] Priola, E., Shirikyan, A., Xu, L. and Zabczyk, J. (2012). Exponential ergodicity and regularity for equations with Lévy noise. Stochastic Process. Appl. 122 106–133.
  • [45] Puhalskii, A. A. and Reiman, M. I. (2000). The multiclass $GI/PH/N$ queue in the Halfin–Whitt regime. Adv. in Appl. Probab. 32 564–595.
  • [46] Puhalskii, A. A. and Reiman, M. I. (2004). Correction: “The multiclass $GI/PH/N$ queue in the Halfin–Whitt regime” [Adv. in Appl. Probab. 32 (2000), no. 2, 564–595]. Adv. in Appl. Probab. 36 971.
  • [47] Reed, J. and Zwart, B. (2011). A piecewise linear stochastic differential equation driven by a Lévy process. J. Appl. Probab. 48A 109–119.
  • [48] Samorodnitsky, G. and Taqqu, M. S. (1994). Stable Non-Gaussian Random Processes: Stochastic Models with Infinite Variance. CRC Press, New York.
  • [49] Sandrić, N. (2016). Ergodicity of Lévy-type processes. ESAIM Probab. Stat. 20 154–177.
  • [50] Sato, K. (1999). Lévy Processes and Infinitely Divisible Distributions. Cambridge Studies in Advanced Mathematics 68. Cambridge Univ. Press, Cambridge. Translated from the 1990 Japanese original. Revised by the author.
  • [51] Sato, K. and Yamazato, M. (1984). Operator-self-decomposable distributions as limit distributions of processes of Ornstein–Uhlenbeck type. Stochastic Process. Appl. 17 73–100.
  • [52] Skorokhod, A. V. (1989). Asymptotic Methods in the Theory of Stochastic Differential Equations. Translations of Mathematical Monographs 78. Amer. Math. Soc., Providence, RI. Translated from the Russian by H. H. McFaden.
  • [53] Stramer, O. and Tweedie, R. L. (1994). Stability and instability of continuous-time Markov processes. In Probability, Statistics and Optimisation 173–184. Wiley, Chichester.
  • [54] Tuominen, P. and Tweedie, R. L. (1994). Subgeometric rates of convergence of $f$-ergodic Markov chains. Adv. in Appl. Probab. 26 775–798.
  • [55] Tweedie, R. L. (1994). Topological conditions enabling use of Harris methods in discrete and continuous time. Acta Appl. Math. 34 175–188.
  • [56] Wang, F.-Y. (2010). Harnack inequalities on manifolds with boundary and applications. J. Math. Pures Appl. (9) 94 304–321.
  • [57] Wang, F.-Y. (2011). Coupling for Ornstein–Uhlenbeck processes with jumps. Bernoulli 17 1136–1158.
  • [58] Wang, F.-Y. and Wang, J. (2014). Harnack inequalities for stochastic equations driven by Lévy noise. J. Math. Anal. Appl. 410 513–523.
  • [59] Wang, J. (2008). Criteria for ergodicity of Lévy type operators in dimension one. Stochastic Process. Appl. 118 1909–1928.
  • [60] Wang, J. (2012). On the exponential ergodicity of Lévy-driven Ornstein–Uhlenbeck processes. J. Appl. Probab. 49 990–1004.
  • [61] Wee, I.-S. (1999). Stability for multidimensional jump-diffusion processes. Stochastic Process. Appl. 80 193–209.
  • [62] Whitt, W. (2002). Stochastic-Process Limits: An Introduction to Stochastic-Process Limits and Their Application to Queues. Springer, New York.
  • [63] Zhang, X. (2013). Stochastic differential equations with Sobolev drifts and driven by $\alpha$-stable processes. Ann. Inst. Henri Poincaré Probab. Stat. 49 1057–1079.