Clustering by compression

IEEE Transactions on Information Theory

Volumn 51, Issue 4, 2005, Pages 1523-1545

  Cilibrasi, Rudi ^a   Vitányi, Paul M B ^a,b,c  

^a CWI   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c CSIRO   (Australia)

Author keywords

Heterogenous data analysis; Hierarchical unsupervised clustering; Kolmogorov complexity; Normalized compression distance; Parameter free data mining; Quartet tree method; Universal dissimilarity distance

Indexed keywords

APPROXIMATION THEORY; COMPUTER PROGRAMMING LANGUAGES; DATA MINING; DATA REDUCTION; DATA STRUCTURES; OPTIMIZATION; THEOREM PROVING;

HETEROGENOUS DATA ANALYSIS; HIERARCHICAL UNSUPERVISED CLUSTERING; KOLMOGOROV COMPLEXITY; NORMALIZED COMPRESSION DISTANCE; PARAMETER FREE DATA MINING; QUARTET TREE METHOD; UNIVERSAL DISSIMILARITY DISTANCE;

DATA COMPRESSION;

EID: 17744364120     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2005.844059     Document Type: Article

References (44)

1. D. Benedetto, E. Caglioti, and V. Loreto, "Language trees and zipping," Phys. Rev. Lett., vol. 88, no. 4, pp. 048702-1-048702-4, 2002.
2. P. Ball, "Algorithm makes tongue tree," Nature, Science update, Jan. 22, 2002.
3. T. Belloni, M. Klein-Wolt, M. Méndez, M. van der Klis, and J. van Paradijs, "A model-independent analysis of the variability of GRS 1915 + 105,"Astron. Astrophys., vol. 355, pp. 271-290, 2000.
4. C. H. Bennett, P. Gács, M. Li, P. M. B. Vitányi, and W. Zurek, "Information distance," IEEE Trans. Inf. Theory, vol. 44, no. 4, pp. 1407-1423, Jul. 1998.
5. C. H. Bennett, M. Li, and B. Ma, "Chain letters and evolutionary histories," Scient. Amer., pp. 76-81, Jun. 2003.
6. D. Bryant, V. Berry, P. Kearney, M. Li, T. Jiang, T. Wareham, and H. Zhang, "A practical algorithm for recovering the best supported edges of an evolutionary tree," in Proc. 11th ACM-SIAM Symp. Discrete Algorithms, San Francisco, CA, Jan. 9-11, 2000, pp. 287-296.
7. Y. Cao, A. Janke, P. J. Waddell, M. Westerman, O. Takenaka, S. Murata, N. Okada, S. Pääbo, and M. Hasegawa, "Conflict among individual mitochondrial proteins in resolving the phylogeny of eutherian orders," J. Mol. Evo., vol. 47, pp. 307-322, 1998.
8. X. Chen, B. Francia, M. Li, B. McKinnon, and A. Seker, "Shared information and program plagiarism detection," IEEE Trans. Inf. Theory, vol. 50, no. 7, pp. 1545-1551, Jul. 2004.
9. R. Cilibrasi. (2003) The CompLearn Toolkit. [Online]. Available: http://complearn.sourceforge.net/
10. R. Cilibrasi, P. M. B. Vitányi, and R. de Wolf, "Algorithmic clustering of music based on string compression," Comp. Masic J., vol. 28, no. 4, pp. 49-67, 2004.
11. G. Cormode, M. Paterson, S. Sahinalp, and U. Vishkin, "Communication complexity of document exchange," in Proc. 11th ACM-SIAM Symp. Discrete Algorithms, San Francisco, CA, Jan. 9-11, 2000, pp. 197-206.
12. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
13. W. Chai and B. Vercoe, "Folk music classification using hidden Markov model," in Proc. Int. Conf. Artificial Intelligence, Las Vegas, NV, Jun. 2001.
14. M. Cooper and J. Foote, "Automatic music summarization via similarity analysis," in Proc. IRCAM, Paris, France, 2002, pp. 81-85.
15. R. Dannenberg, B. Thom, and D. Watson, "A machine learning approach to musical style recognition," in Proc. Int. Computer Music Conf., Thessaloniki, Greece, Sep. 25-30, 1997, pp. 344-347.
16. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley Interscience, 2001.
17. M. Grimaldi, A. Kokaram, and P. Cunningham. (2002) Classifying Music by Genre Using the Wavelet Packet Transform and a Round-Robin Ensemble. Trinity College, Dublin, U.K.. [Online]. Available: http://www.cs.tcd.ie/ publications/tech-reports/reports.02/TCD-CS-2002-64.pdf
18. A. Janke, O. Magnell, G. Wieczorek, M. Westerman, and U. Arnason, "Phylogenetic analysis of 18S rRNA and the mitochondrial genomes of wombat, vombatus ursinus, and the spiny anteater, tachyglossus acelaetus: Increased support for the marsupionta hypothesis," J. Mol. Evol., vol. 54, no. 1, pp. 71-80, 2002.
19. T. Jiang, P. Kearney, and M. Li, "A polynomial time approximation scheme for inferring evolutionary trees from quartet topologies and its application," SIAM J. Comput., vol. 30, no. 6, pp. 1942-1961, 2001.
20. E. Keogh, S. Lonardi, and C. A. Rtanamahatana, "Toward parameter-free data mining," in Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, Seattle, WA, Aug. 22-25, 2004, pp. 206-215.
21. J. K. Killian, T. R. Buckley, N. Steward, B. L. Munday, and R. L. Jirtle, "Marsupials and eutherians reunited: Genetic evidence for the theria hypothesis of mammalian evolution," Mammalian Genome, vol. 12, pp. 513-517, 2001.
22. M. Koppel, S. Argamon, and A. R. Shimoni, "Automatically catagorizing written texts by author gender," Literary and Linguistic Comput., vol. 17, no. 4, pp. 401-412, 2002.
23. A. Kraskov, H. Stögbauer, R. G. Adrsejak, and P. Grassberger. (2003) Hierarchical Clustering Based on Mutual Information. [Online]. Available: http://arxiv.org/abs/q-bio/0311039
24. J. B. Kruskal, "Nonmetric multidimensional scaling: A numerical method," Psychometrika, vol. 29, pp. 115-129, 1964.
25. T. G. Ksiazek et al., "A novel coronavirus associated with severe acute respiratory syndrome," New England J. Med., vol. 349, p. 709, Aug. 14, 2003.
26. C. P. Kurtzman and J. Sugiyama, "Ascomycetous yeasts and yeast-like taxa," in The Mycota VII, Systemtics and Evolution. Berlin, Germany: Springer-Verlag, 2001, pt. A, pp, 179-200.
27. C. P. Kurtzman, "Phylogenetic circumscription of saccharomyces, kluyveromyces and other members of the saccharomycetaceaea, and the proposal of the new genera lachnacea, nakaseomyces, naumovia, vanderwaltozyma and zygotorulaspora," FEMS Yeast Res., vol. 4, pp. 233-245, 2003.
28. P. S. Laplace, A Philosophical Essay on Probabilities. New York: Dover, 1951. English translation of the 1918 French original version.
29. M. Li, J. H. Badger, X. Chen, S. Kwong, P. Kearney, and H. Zhang, "An information-based sequence distance and its application to whole mitochondrial genome phylogeny," Bioinformatics, vol. 17, no. 2, pp. 149-154, 2001.
30. M. Li and P. M. B. Vitányi, "Algorithmic complexity," in International Encyclopedia of the Social & Behavioral Sciences, N. J. Smelser and P. B. Baltes, Eds. Oxford, U.K.: Pergamon, 2001/2002, pp. 376-382.
31. M. Li, X. Chen, X. Li, B. Ma, and P. M. B. Vitányi, "The similarity metric," IEEE Trans. Inf. Theory, vol. 50, no. 12, pp. 3250-3264, Dec. 2004.
32. M. Li and P. M. B. Vitányi, An Introduction to Kolmogorov Complexity and Its Applications, 2nd ed. New York: Springer-Verlag, 1997.
33. A. Londei, V. Loreto, and M. O. Belardinelli, "Music style and authorship categorization by informative compressors," in Proc. 5th Triannual Conf. European Society for the Cognitive Sciences of Music (ESCOM), Hannover, Germany, Sep. 8-13, 2003, pp. 200-203.
34. L. S. Oliveira, R. Sabourin, F. Bortolozzi, and C. Y. Suen, "Automatic recognition of handwritten numerical strings: A recognition and verification strategy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 11, pp. 1438-1454, Nov. 2002.
35. United Nations General Assembly Resolution 217 A (III) of 10 December 1948. Universal Declaration of Human Rights. [Online]. AvAilable: http://www.un.org/Overview/rights.html
36. A. Rokas, B. L. Williams, N. King, and S. B. Carroll, "Genome-scale approaches to resolving incongruence in molecular phylogenies," Nature, vol. 425, pp. 798-804, Oct. 2003.
37. D. Salomon, Data Compression. New York: Springer-Verlag, 1997.
38. N. Saitou and M. Nei, "The neighbor-joining method: A new method for reconstructing phylogenetic trees," Mol. Biol. Evol., vol. 4, pp. 406-425, 1987.
39. P. Scott. (2001) Music Classification Using Neural Networks. [Online]. Available: http://www.stanford.edu/class/ee373a/musicclassification.pdf
40. Ø. D. Trier, A. K. Jain, and T. Taxt, "Feature extraction methods for character recognition - A survey," Patt. Recogn., vol. 29, no. 4, pp. 641-662, 1996.
41. P. N. Yianilos. (1991) Normalized Forms for Two Common Metrics. NEC Res. Inst.. [Online]. Available: http://www.pnylab.com/pny/
42. A.C.-C. Yang, C.-K. Peng, H.-W. Yien, and A. L. Goldberger, "Information categorization approach to literary authorship disputes," Physica A, vol. 329, pp. 473-483, 2003.
43. G. Tzanetakis and P. Cook, "Music genre classification of audio signals," IEEE Trans. Speech and Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002.
44. S. Wehner. (2004) Analyzing Network Traffic and Worms Using Compression. CWI. [Online]. Available: http://homepages.cwi.nl/-wehner/worms/