The Annals of Applied Statistics

Testing statistical hypothesis on random trees and applications to the protein classification problem

Jorge R. Busch, Pablo A. Ferrari, Ana Georgina Flesia, Ricardo Fraiman, Sebastian P. Grynberg, and Florencia Leonardi

Source: Ann. Appl. Stat. Volume 3, Number 2 (2009), 542-563.

Abstract

Efficient automatic protein classification is of central importance in genomic annotation. As an independent way to check the reliability of the classification, we propose a statistical approach to test if two sets of protein domain sequences coming from two families of the Pfam database are significantly different. We model protein sequences as realizations of Variable Length Markov Chains (VLMC) and we use the context trees as a signature of each protein family. Our approach is based on a Kolmogorov–Smirnov-type goodness-of-fit test proposed by Balding et al. [Limit theorems for sequences of random trees (2008), DOI: 10.1007/s11749-008-0092-z]. The test statistic is a supremum over the space of trees of a function of the two samples; its computation grows, in principle, exponentially fast with the maximal number of nodes of the potential trees. We show how to transform this problem into a max-flow over a related graph which can be solved using a Ford–Fulkerson algorithm in polynomial time on that number. We apply the test to 10 randomly chosen protein domain families from the seed of Pfam-A database (high quality, manually curated families). The test shows that the distributions of context trees coming from different families are significantly different. We emphasize that this is a novel mathematical approach to validate the automatic clustering of sequences in any context. We also study the performance of the test via simulations on Galton–Watson related processes.

Keywords: Protein classification; hypothesis testing; random trees; variable length Markov chains

Full-text: Access denied (no subscription detected)

In 2007, access to the Annals of Applied Statistics was open. Beginning in 2008, you must hold a subscription or be a member of the IMS to view the full journal. For more information on subscribing, please visit: http://imstat.org/orders.
If you are already an IMS member, you may need to update your Euclid profile following the instructions here: http://imstat.org/publications/eaccess.htm.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoas/1245676185
Digital Object Identifier: doi:10.1214/08-AOAS218
Zentralblatt MATH identifier: 1166.62079

References

Balding, D., Ferrari, P., Fraiman, R. and Sued, M. (2008). Limit theorems for sequences of random trees., Test (online). DOI: 10.1007/s11749-008-0092-z.
Banks, D. and Constantine, G. (1998). Metric models for random graphs., J. Classification 15 199–223.
Mathematical Reviews (MathSciNet): MR1665974
Zentralblatt MATH: 0912.62074
Digital Object Identifier: doi:10.1007/s003579900031
Bejerano, G. (2003). Automata learning and stochastic modeling for biosequence analysis. Ph.D. thesis, Hebrew, Univ.
Bejerano, G. (2004). Algorithms for variable length Markov chain modeling., Bioinformatics 20 788–789.
Bejerano, G. and Yona, G. (2001). Variations on probabilistic suffix trees: Statistical modeling and prediction of protein families., Bioinformatics 17 23–43.
Bühlmann, P. and Wyner, A. J. (1999). Variable length Markov chains., Ann. Statist. 27 480–513.
Csiszár, I. and Talata, Z. (2006). Context tree estimation for not necessarily finite memory processes, via BIC and MDL., IEEE Trans. Inform. Theory 52 1007–1016.
Finn, R. D., Mistry, J., Schuster-Böckler, B., Griffiths-Jones, S., Hollich, V., Lassmann, T., Moxon, S., Marshall, M., Khanna, A., Durbin, R., Eddy, S. R., Sonnhammer, E. L. L. and Bateman, A. (2006). Pfam: Clans, web tools and services., Nucleic Acids Res. 34 D247-D51.
Galves, A., Galves, C., Garcia, N. and Peixoto, C. (2004). Correlates of rhythm in written texts of Brazilian and European Portuguese. Preprint. Available as Technical Report 08/08,, IMECC/UNICAMP.
Galves, A., Maume-Deschamps, V. and Schmitt, B. (2008). Exponential inequalities for VMLC empirical trees., ESAIM Probab. Stat. 12 219–229.
Mathematical Reviews (MathSciNet): MR2374639
Digital Object Identifier: doi:10.1051/ps:2007035
Greig, D., Porteous, B. and Seheult, A. (1989). Exact maximum a posteriori estimation for binary images., J. Roy. Statist. Soc. Ser. B 51 271–279.
Kolmogorov, V. and Zabih, R. (2004). What energy functions can be minimized via graphs cuts?, IEEE Trans. Pattern Analysis and Machine Intelligence 26 147–159.
Leonardi, F., Matioli, S. R., Armelin, H. A. and Galves, A. (2007). Detecting phylogenetic relations out from sparse context trees. Available at, ArXiv:math/0804.4279.
Manly, B. F. J. (2007)., Randomization, Bootstrap and Monte Carlo Methods in Biology, 3rd ed. Chapman & Hall/CRC, New York.
Mathematical Reviews (MathSciNet): MR2257066
Rissanen, J. (1983). A universal data compression system., IEEE Trans. Inform. Theory 29 656–664.
Mathematical Reviews (MathSciNet): MR730903
Digital Object Identifier: doi:10.1109/TIT.1983.1056741
Ron, D., Singer, Y. and Tishby, N. (1996). The power of amnesia: Learning probabilistic automata with variable memory length., Machine Learning 25 117–149.
Stein, L. (2001). Genome annotation: From sequence to biology., Nat. Rev. Genet. 2 493–505.
Wang, H., and Marron, J. S. (2007). Object oriented data analysis: Sets of trees., Ann. Statist. 35 1849–1873.
Mathematical Reviews (MathSciNet): MR2363955
Zentralblatt MATH: 1126.62002
Digital Object Identifier: doi:10.1214/009053607000000217
Project Euclid: euclid.aos/1194461714
Wong, K. M., Suchard, M. A. and Huelsenbeck, J. P. (2008). Alignment uncertainty and genomic analysis., Science 319 473–476.
Mathematical Reviews (MathSciNet): MR2381044
Digital Object Identifier: doi:10.1126/science.1151532

2009 © Institute of Mathematical Statistics