## The Annals of Probability

### The segregated $\Lambda$-coalescent

Nic Freeman

#### Abstract

We construct an extension of the $\Lambda$-coalescent to a spatial continuum and analyse its behaviour. Like the $\Lambda$-coalescent, the individuals in our model can be separated into (i) a dust component and (ii) large blocks of coalesced individuals. We identify a five phase system, where our phases are defined according to changes in the qualitative behaviour of the dust and large blocks. We completely classify the phase behaviour, including necessary and sufficient conditions for the model to come down from infinity.

We believe that two of our phases are new to $\Lambda$-coalescent theory and directly reflect the incorporation of space into our model. Firstly, our semicritical phase sees a null but nonempty set of dust. In this phase the dust becomes a random fractal, of a type which is closely related to iterated function systems. Secondly, our model has a critical phase in which the coalescent comes down from infinity gradually during a bounded, deterministic time interval.

#### Article information

Source
Ann. Probab., Volume 43, Number 2 (2015), 435-467.

Dates
First available in Project Euclid: 2 February 2015

https://projecteuclid.org/euclid.aop/1422885567

Digital Object Identifier
doi:10.1214/13-AOP857

Mathematical Reviews number (MathSciNet)
MR3305997

Zentralblatt MATH identifier
1334.60178

#### Citation

Freeman, Nic. The segregated $\Lambda$-coalescent. Ann. Probab. 43 (2015), no. 2, 435--467. doi:10.1214/13-AOP857. https://projecteuclid.org/euclid.aop/1422885567

#### References

• Agresti, A. (1975). On the extinction times of varying and random environment branching processes. J. Appl. Probab. 12 39–46.
• Angel, O., Berestycki, N. and Limic, V. (2010). Global divergence of spatial coalescents. Probab. Theory Related Fields 152 1–45.
• Barton, N. H., Etheridge, A. M. and Véber, A. (2010). A new model for evolution in a spatial continuum. Electron. J. Probab. 15 162–216.
• Barton, N. H., Etheridge, A. M. and Véber, A. (2013). Modelling evolution in a spatial continuum. J. Stat. Mech. Theory Exp. 1 P01002, 38.
• Berestycki, N. (2009). Recent Progress in Coalescent Theory. Ensaios Matemáticos [Mathematical Surveys] 16. Sociedade Brasileira de Matemática, Rio de Janeiro.
• Berestycki, J., Berestycki, N. and Limic, V. (2014). A small-time coupling between $\Lambda$-coalescents and branching processes. Ann. Appl. Probab. 24 449–475.
• Bertoin, J. and Le Gall, J.-F. (2000). The Bolthausen–Sznitman coalescent and the genealogy of continuous-state branching processes. Probab. Theory Related Fields 117 249–266.
• Le Gall, J.-F. and Bertoin, J. (2003). Stochastic flows associated to coalescent processes. Probab. Theory Related Fields 126 261–288.
• D’Souza, J. C. and Biggins, J. D. (1992). The supercritical Galton–Watson process in varying environments. Stochastic Process. Appl. 42 39–47.
• Birkner, M., Blath, J., Capaldo, M., Etheridge, A., Möhle, M., Schweinsberg, J. and Wakolbinger, A. (2005). Alpha-stable branching and beta-coalescents. Electron. J. Probab. 10 303–325 (electronic).
• Bolthausen, E. and Sznitman, A. S. (1998). On Ruelle’s probability cascades and an abstract cavity method. Comm. Math. Phys. 197 247–276.
• Church, J. D. (1967). Composition limit theorems for probability generating functions. MRC Techn. Summ. Rept. 732 1–41.
• Donnelly, P. and Kurtz, T. G. (1999). Genealogical processes for Fleming–Viot models with selection and recombination. Ann. Appl. Probab. 9 1091–1148.
• Durand, A. (2009). Random fractals and tree-indexed Markov chains. Rev. Mat. Iberoam. 25 1089–1126.
• Etheridge, A. M. (2008). Drift, draft and structure: Some mathematical models of evolution. In Stochastic Models in Biological Sciences. Banach Center Publications 80 121–144. Polish Acad. Sci., Warsaw.
• Etheridge, A. (2011). Some Mathematical Models from Population Genetics. Lecture Notes in Math. 2012. Springer, Heidelberg.
• Falconer, K. J. (1986). Random fractals. Math. Proc. Cambridge Philos. Soc. 100 559–582.
• Falconer, K. (2003). Fractal Geometry: Mathematical Foundations and Applications, 2nd ed. Wiley, Hoboken, NJ.
• Fearn, D. H. (1972). Galton–Watson processes with generation dependence. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability (Univ. California, Berkeley, Calif., 1970/1971), Vol. IV: Biology and Health 159–172. Univ. California Press, Berkeley, CA.
• Freeman, N. (2012). The Segregated $\Lambda$-coalescent. Ph.D. thesis, Oxford Univ.
• Graf, S. (1987). Statistically self-similar fractals. Probab. Theory Related Fields 74 357–392.
• Greven, A., Limic, V. and Winter, A. (2005). Representation theorems for interacting Moran models, interacting Fisher–Wright diffusions and applications. Electron. J. Probab. 10 1286–1356 (electronic).
• Greven, A., den Hollander, F., Kliem, S. and Klimovsky, A. (2012). Renormalisation of hierarchically interacting Cannings processes. Available at arXiv:1209.1856v1.
• Jagers, P. (1974). Galton–Watson processes in varying environments. J. Appl. Probab. 11 174–178.
• Jiřina, M. (1976). Extinction of non-homogeneous Galton–Watson processes. J. Appl. Probab. 13 132–137.
• Kingman, J. F. C. (1982). The coalescent. Stochastic Process. Appl. 13 235–248.
• Kingman, J. F. C. (1993). Poisson Processes. Oxford Studies in Probability 3. Oxford Univ. Press, New York.
• Limic, V. and Sturm, A. (2006). The spatial $\Lambda$-coalescent. Electron. J. Probab. 11 363–393 (electronic).
• Lyons, R. (1992). Random walks, capacity and percolation on trees. Ann. Probab. 20 2043–2088.
• Mauldin, R. D. and Williams, S. C. (1986). Random recursive constructions: Asymptotic geometric and topological properties. Trans. Amer. Math. Soc. 295 325–346.
• Mörters, P. (2010). New Perspectives in Stochastic Geometry. Oxford Univ. Press, Oxford.
• Pitman, J. (1999). Coalescents with multiple collisions. Ann. Probab. 27 1870–1902.
• Rogers, L. C. G. and Williams, D. (2000). Diffusions, Markov Processes and Martingales. Cambridge Univ. Press, Cambridge.
• Sagitov, S. (1999). The general coalescent with asynchronous mergers of ancestral lines. J. Appl. Probab. 36 1116–1125.