Data compression concepts and algorithms and their applications to bioinformatics

Entropy

Volumn 12, Issue 1, 2010, Pages 34-52

  Nalbantog̃lu, Özkan U ^a   Russell, David J ^a   Sayood, Khalid ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Bioinformatics; Data compression; Information theory

Indexed keywords

EID: 77953484795     PISSN: None     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e12010034     Document Type: Review

References (89)

1. Schrodinger, E. What is Life; Cambridge University Press: Cambridge, UK, 1944.
2. Giancarlo, R.; Scaturro, D.; Utro, F. Textual data compression in computational biology: A synopsis. Bioinformatics 2009, 25, 1575-1586.
3. Gatlin, L. Triplet frequencies in DNA and the genetic program. J. Theor. Biol. 1963, 5, 360-371.
4. Gatlin, L. The information content of DNA. J. Theor. Biol. 1966, 10, 281-300.
5. Gatlin, L. The information content of DNA II. J. Theor. Biol. 1968, 18, 181-194.
6. Gatlin, L. Information Theory and the Living System; Columbia University Press: New York, NY, USA, 1972.
7. Shannon, C. A mathematical theory of communication. AT&T Tech. J. 1948, 27, 379-423, 623-656.
8. Kovac, L. Information and knowledge in biology: Time for reappraisal. Plant Signal. Behav. 2007, 2, 65-73.
9. Stormo, G.; Hartzell, G.W. Identifying protein-binding sites from unaligned DNA fragments. PNAS 1989, 86, 1183-1187.
10. Schneider, T.; Stormo, G.; Gold, L.; Ehrefeucht, A. Information content of binding sites on nucleotide sequences. J. Mol. Biol. 1986, 188, 415-431.
11. Schneider, T.; Stephens, R. Sequence logos: A new way to display consensus sequences. Nucleic Acids Res. 1990, 18, 6097-6100.
12. Schneider, T.; Mastronade, D. Fast Multiple alignment of ungapped DNA sequences using information theory and a relaxation method. Discrete Appl. Math. 1996, 71, 259-268.
13. Bailey, T.; Elkan, C. Fitting a Mixture Model by Expectation Maximization to Discover Motifs in Biopolymers. In Proceedings of the Second International Conference on Intelligent Systems for Molecular Biology, Stanford, CA, USA, August 14-17, 1994.
14. Bailey, T.; Gribskov, M. Combining evidence using p-values: application to sequence homology searches. Bioinformatics 1998, 14, 48-54.
15. Mahony, S.; Benos, P. STAMP: a web tool for exploring DNA-binding motif similarities. Nucleic Acids Res. 2007, 35, W253-W258.
16. Shultzaberger, R.; Schneider, T. Using sequence logos and information analysis of Lrp DNA binding sites to investigate discrepancies between natural selection and SELEX. Nucleic Acids Res. 1999, 27, 882-887.
17. Schneider, T. Strong minor groove base conservation in sequence logos implies DNA distortion or base flipping during replication and transcription initiation. Nucleic Acids Res. 2001, 27, 882-887.
18. Lyakhov, I.; Krishnamachari, A.; Schneider, T. Discovery of novel tumor suppressor p53 response elements using information theory. Nucleic Acids Res. 2008, 36, 3828-3833.
19. Korber, B.; Farber, R.; Wolpert, D.; Lapedes, A. Covariation of mutations in the V3 loop of human immunodeficiency virus Type I envelope protein: An information theoretic analysis. PNAS 1993, 90, 7176-7180.
20. Sayood, K.; Hoffman, F.; Wood, C. Use of Average Mutual Information for Studying Changes in HIV Populations. In Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, September 3-6, 2009.
21. Zhang, H.; Orti, G.; Du, Q.; He, J.; Kankasa, C.; Bhat, G.; Wood, C. Phylogenetic and phenotypic analysis of HIV Type 1 Env gp120 in cases of Subtype C mother-to-child transmission. AIDS Res. Hum. Retrov. 2002, 18, 1415-1423.
22. Hoffman, F.; He, X.; West, J.; Lemey, P.; Kankasa, C.; Wood, C. Genetic variation in mother-child acute seroconverter pairs from Zambia. AIDS 2008, 22, 817-824.
23. Giraud, B.; Lapedes, A.; Liu, L. Analysis of correlations between sites in models of protein sequences. Phys. Rev. E 1998, 58, 6312-6322.
24. Herzel, H.; Grosse, I. Correlations in DNA sequences: The role of protein coding segments. Phys. Rev. E 1997, 55, 800-810.
25. Roman-Roldan, R.; Bernaolo-Galvan, P.; Oliver, J. Application of information theory to DNA sequence analysis: A review. Pattern Recognit. 1996, 29, 1187-1194.
26. Martin, L.; Gloor, G.; Dunn, S.; Wahl, L. Using information theory to search for co-evolving residues in proteins. Bioinformatics 2005, 21, 4116-4124.
27. Adami, C. Information Theory in Molecular Biology. Phys. Life Rev. 2004, 1, 3-22.
28. Grosse, I.; Herzel, H.; Buldyrev, S.; Stanley, H. Species independence of mutual information in coding and noncoding regions. Phys. Rev. E 2000, 61, 5624-5629.
29. Bauer, M. A Distance Measure for DNA Sequences. PhD thesis, University of Nebraska-Lincoln, Lincoln, NE, USA, January 1, 2001.
30. Bauer, M.; Schuster, S.; Sayood, K. The average mutual information profile as a genomic signature. BMC Bioinf., doi:10.1186/1471-2105-9-48. http://www.biomedcentral.com/1471-2105/9/48 (accessed on December 29, 2009).
31. Berryman, M.; Allison, A.; Abbot, D. Mutual information for examining correlations in DNA. Fluct. Noise Lett. 2004, 4, 237-246.
32. Holste, D.; Grosse, I.; Beirer, S.; Schieg, P.; Herzel, H. Repeats and correlations in human DNA sequences. Phys. Rev. E 2003, 67, 061913:1-061913:7.
33. Otu, H.; Sayood, K. A divide and conquer approach to sequence assembly. Bioinformatics 2003, 19, 22-29.
34. Linde, Y.; Buzo, A.; Gray, R.M. An algorithm for vector quantization design. IEEE Trans. Commun. 1980, COM-28, 84-95.
35. Butte, A.; Kohane, I. Mutual Information Relevance Networks: Functional Genomic Clustering Using Pairwise Entropy Measurements. In Proceedings Pacific Symposium on Biocomputing 2000, Oahu, HI, USA, January 4-9, 2000.
36. Steur, R.; Kurths, J.; Daub, C.; Wiese, J.; Selbig, J. The mututal information: Detecting and evaluating dependencies between variables. Bioinformatics 2002, 18, S231-S240.
37. Quackenbush, J. Computational analysis of microarray data. Nat. Rev. Genet. 2001, 2, 418-427.
38. Chen, X.; Kwong, S.; Li, M. A compression algorithm for DNA sequences and its applications in Genome comparison. In Proceedings of the Fourth Annual International Conference on Computational Molecular Biology, Tokyo, Japan, April 8-11, 2000.
39. Ziv, J.; Lempel, A. A Universal Algorithm for Data Compression. IEEE Trans. Inf. Theory 1977, IT-23, 337-343.
40. Grumbach, A.; Tahi, F. Compression of DNA Sequences. In Proceedings of the IEEE Data Compression Conference, Snowbird, UT, USA, March 30-April 2, 1993.
41. Chen, X.; Li, M.; Ma, B.; Tromp, J. DNA compress: fast and effective DNA sequence compression. Bioinformatics 2002, 18, 1696-1698.
42. Matsumoto, T.; Sadakane, K.; Imai, H. Biological sequence compression algorithms. Genome Inform. 2000, 11, 43-52.
43. Behzadi, B.; Fessant, F.L. DNA compression challenge revisited: A dynamic programming approach. In Lect. Notes Comput. SC; Springer: Berlin/Heidelberg, Germany, 2005; pp. 190-200.
44. Cao, M.; Dix, T.I.; Allison, L.; Mears, C. A Simple Statistical Algorithm for Biological Sequence Compression. In Proceedings of the IEEE Data Compression Conference, Snowbird, UT, USA, March 27-29, 2007.
45. Ziv, J.; Lempel, A. Compression of individual sequences via variable-rate coding. IEEE Trans. Inf. Theory 1978, IT-24, 530-536.
46. Benedetto, D.; Cagliotti, E.; Loreto, V. Language trees and zipping. Phys. Rev. Lett. 2002, 88, 048702:1-048702:4.
47. Pugliosi, A.; Benedetto, D.; Cagliotti, E.; Loreto, V.; Vulpiani, A. Data compression and learning in time sequence analysis. Physica D 2003, 180, 92-107.
48. Pinker, S.; Bloom, P. Natural-language and natural-selection. Behav. Brain Sci. 1990, 13, 707-726.
49. Corballis, M. The evolution of language. Ann. N.Y. Acad. Sci. 2009, 1156, 19-43.
50. Li, M.; Xin, C.; Li, X.; Ma, B.; Vitanyi, P. The similarity metric. IEEE Trans. Inf. Theory 2003, 50, 3250-3264.
51. Apostolico, A.; Comin, M.; Parida, L. Mining, compressing and classifying with extensible motifs. Algorithm. Mol. Biol., doi:10.1186/1748-7188-1-4. http://www.almob.org/content/1/1/4 (accessed on Decmber 29, 2009).
52. Otu, H.; Sayood, K. A new sequence distance measure for phylogenetic tree construction. Bioinformatics 2003, 19, 2122-2130.
53. Bastola, D.; Doukas, H.O.S.; Sayood, K.; Hinrichs, S.; Iwen, P. Utilization of the relative complexity measure to construct a phylogenetic tree for fungi. Mycol. Res. 2004, 108, 117-125.
54. Lempel, A.; Ziv, J. On the complexity of finite sequences. IEEE Trans. Inf. Theory 1976, IT-22, 75-81.
55. Weeks, K.; Chuzhanova, N.; Donnison, I.; Scott, I. Evolutionary hierarchies of conserved blocks in 5'-noncoding sequences of dicot rbcS genes. BMC Evol. Biol., doi:10.1186/1471-2148-7-51. http://www.biomedcentral.com/1471-2148/7/51 (accessed on December 29, 2009).
56. Russell, D.; Otu, H.; Sayood, K. Grammar-based distance in progressive multiple sequence alignment. BMC Bioinf., doi:10.1186/1471-2105-9-306. http://www.biomedcentral.com/1471-2105/9/306 (accessed on December 29, 2009).
57. Krasnogor, N.; Pelta, D.A. Measuring the similarity of protein structures by means of the universal similarity metric. Bioinformatics 2004, 20, 1015-1021.
58. Kocsor, A.; Kartesz-Farkas, A.; Kajan, L.; Pongor, S. Application of compression-based distance measures to protein sequence classification: a methodological study. Bioinformatics 2005, 22, 407-412.
59. Pelta, D.; Gonzales, J.R.; Krasnogor, N. Protein Structure Comparison Through Fuzzy Contact Maps and the Universal Similarity Metric. In Proceedings of the Joint 4th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT) and the 11th Rencontres Francophones sur la Logique Floue et ses Applications (LFA), Barcelona, Spain, September 7-9, 2005.
60. Ferragina, P.; Giancarlo, R.; Greco, V.; Manzini, G.; Valiente, G. Compression-based classification of biological sequences and structures via the universal similarity metric: Experimental assessment. BMC Bioinf., doi:10.1186/1471-2105-8-252. http://www.biomedcentral.com/1471-2105/8/252 (accessed on December 29, 2009).
61. Loewenstern, D.; Hirsh, H.; Yianilos, P.; Noordewier, M. DNA Sequence Classification Using Compression-Based Induction; DIMACS Technical Report 95-04; Rutgers University: New Brunswick, NJ 08903, USA, 1995.
62. Rocha, J.; Rossello, F.; Segura, J. Compression ratios based on the universal similarity metric still yield protein distances far from CATH distances. 2006, arXiv:q-bio/0603007. arXiv.org e-Print archive. http://arxiv.org/abs/q-bio/0603007 (accessed on December 18, 2009).
63. Kieffer, J.C.; Yang, E.H. Grammar based codes: A new class of universal lossless source codes. IEEE Trans. Inf. Theory 2000, 46, 2000.
64. Chomsky, N. Logical Structure of Linguistic Theory. PhD thesis, University of Pennsylvania, Philadelphia, PA, USA, 1955.
65. Chomsky, N. On certain formal properties of grammars. Inform. Control 1959, 2, 137-167.
66. Chiang, D.; Joshi, A.K.; Searls, D.B. Grammatical representations of macromolecular structure. J. Comput. Biol. 2006, 13, 1077-1100.
67. Sakakibara, Y.; Brown, M.; Hughey, R.; Mian, I.S.; Sjölander, K.; Underwood, R.C.; Haussler, D. Stochastic context-free grammars for tRNA modeling. Nucleic Acids Res. 1994, 22, 5112-5120.
68. Searls, D.B. The language of genes. Nature 2002, 420, 211-217.
69. Gheorghe, M.; Mitrana, V. A formal language-based approach in biology. Comp. Funct. Genom. 2004, 5, 91-94.
70. Brendel, V.; Busse, H.G. Genome structure described by formal languages. Nucleic Acids Res. 1984, 12, 2561-2568.
71. Head, T. Formal language theory and DNA: An analysis of the generative capacity of specific recombinant behaviors. Bull. Math. Biol. 1987, 49, 737-759.
72. Searls, D.B. The linguistics of DNA. Am. Sci. 1992, 80, 579-591.
73. Searls, D.B. Investigating the Linguistics of DNA with Definite Clause Grammars. In Logic Programming: Proceedings North American Conference; Lusk, E., Overbeek, R., Eds.; MIT Press: Cambridge, MA, USA, 1989; pp. 189-208.
74. Searls, D.B., Artificial Intelligence and Molecular Biology; AAAI Press: Menlo Park, CA, USA, 1993; Chapter 2, pp. 47-120.
75. Abe, N.; Mamitsuka, H. Predicting protein secondary structure using stochastic tree grammars. Mach. Learn. 1997, 29, 275-301.
76. Przytycka, T.; Srinivasan, R.; Rose, G.D. Recursive domains in proteins. Protein Sci. 2002, 11, 409-417.
77. Collado-Vides, J. A transformational-grammar approach to the study of the regulation of gene expression. J. Theor. Biol. 1989, 136, 403-425.
78. Rosenblueth, D.A.; Thieffry, D.; huerta, A.M.; Salgado, H.; Collado-Vides, J. Syntactic recognition of regulatory regions in Escherichia coli. Comput. Appl. Biosci. 1996, 12, 415-422.
79. Leung, S.; Mellish, C.; Robertson, D. Basic gene grammars and DNA-chart parser for language processing of Escherichia coli promotor DNA sequences. Bioinformatics 2001, 17, 226-236.
80. Nevill-Manning, C.G. Inferring Sequential Structure. PhD thesis, University of Waikato, Waikato, New Zealand, 1996.
81. Nevill-Manning, C.G.; Witten, I.H. Identifying hierarchical structure in sequences: A linear-time algorithm. J. Artif. Intell. Res. 1997, 7, 67-82.
82. Sakakibara, Y. Learning context-free grammars using tabular representations. Pattern Recognit. 2005, 38, 1372-1383.
83. Nakamura, K.; Matsumoto, M. Incremental learning of context free grammars based on bottom-up parsing and search. Pattern Recognit. 2005, 38, 1384-1392.
84. Cherniavsky, N.; Ladner, R.E. Grammar-based Compression of DNA Sequences. Presented at the DIMACS Working Group on the Burrows-Wheeler Transform, DIMACS Center, Rutgers University, Piscataway, NJ, USA, August 19-20, 2004. http://www.cs.washington.edu/homes/nchernia/dnasequitur/dnasequitur.pdf (accessed on December 18, 2009).
85. Nawrocki, E.P.; Eddy, S.R. Computational Identification of Functional RNA Homologs in Metagenomic Data. 2009, NawrockiEddy09-preprint. Eddy Lab: Publications. ftp://selab.janelia.org/pub/publications/NawrockiEddy09/NawrockiEddy09-preprint.pdf (accessed on December 18, 2009).
86. Eddy, S.R. Computational analysis of RNAs. Cold Spring Harb. Sym. 2006, 71, 117-128.
87. Eddy, S.R. A memory-efficient dynamic programming algorithm for optimal alignment of a sequence to an RNA secondary structure. BMC Bioinf., doi:10.1186/1471-2105-3-18. http://www.biomedcentral.com/1471-2105/3/18/ (accessed on December 29, 2009).
88. Durbin, R.; Eddy, S.; Krogh, A.; Mitchison, G. Biological Sequence Analysis, Probabilistic Models of Proteins and Nucleic Acids; Cambridge University Press: New York, NY, USA, 1998.
89. Bareinboim, E.; Vasconcelos, A.T.R. Grammatical inference applied to linguistic modeling of biological regulation networks. RECIIS 2007, 1, Sup329-Sup333.