Avoiding common pitfalls when clustering biological data

Science Signaling

Volumn 9, Issue 432, 2016, Pages

  Ronan, Tom ^a   Qi, Zhijie ^a   Naegle, Kristen M ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EPIDERMAL GROWTH FACTOR RECEPTOR; MESSENGER RNA; MICRORNA; MITOGEN ACTIVATED PROTEIN KINASE;

ACCURACY; ALGORITHM; BIOLOGY; CLUSTERING; DATA ANALYSIS; FOLLOW UP; GENE EXPRESSION; HUMAN; LEARNING; MICROARRAY ANALYSIS; MOLECULAR BIOLOGY; NOISE; PRIORITY JOURNAL; PROBABILITY; REVIEW; SIGNAL TRANSDUCTION; ANIMAL; FACTUAL DATABASE; INFORMATION PROCESSING; THEORETICAL MODEL;

ANIMALS; AUTOMATIC DATA PROCESSING; DATABASES, FACTUAL; HUMANS; MODELS, THEORETICAL;

EID: 84974809055     PISSN: 19450877     EISSN: 19379145     Source Type: Journal    
DOI: 10.1126/scisignal.aad1932     Document Type: Review

References (77)

1. A. K. Jain, M. N. Murty, P. J. Flynn, Data clustering: A review. ACM Comput Surv. 31, 264-323 (1999).
2. R. Xu, D. C. Wunsch II, Clustering algorithms in biomedical research: A review. IEEE Rev. Biomed. Eng. 3, 120-154 (2010).
3. B. Andreopoulos, A. An, X. Wang, M. Schroeder, A roadmap of clustering algorithms: Finding a match for a biomedical application. Brief. Bioinform. 10, 297-314 (2009).
4. T. Sørlie, C. M. Perou, R. Tibshirani, T. Aas, S. Geisler, H. Johnsen, T. Hastie, M. B. Eisen, M. van de Rijn, S. S. Jeffrey, T. Thorsen, H. Quist, J. C. Matese, P. O. Brown, D. Botstein, P. E. Lønning, A. L Børresen-Dale, Gene expression patterns of breast carcinomas distinguish tumor subclasses with clinical implications. Proc. Natl. Acad. Sci. U.S.A. 98, 10869-10874 (2001).
5. J. Lapointe, C. Li, J. P. Higgins, M. van de Rijn, E. Bair, K. Montgomery, M. Ferrari, L. Egevad, W. Rayford, U. Bergerheim, P. Ekman, A. M. DeMarzo, R. Tibshirani, D. Botstein, P. O. Brown, J. D. Brooks, J. R. Pollack, Gene expression profiling identifies clinically relevant subtypes of prostate cancer. Proc. Natl. Acad. Sci. U.S.A. 101, 811-816 (2004).
6. J. Lu, G. Getz, E. A. Miska, E. Alvarez-Saavedra, J. Lamb, D. Peck, A. Sweet-Cordero, B. L. Ebert, R. H. Mak, A. A. Ferrando, J. R. Downing, T. Jacks, H. R. Horvitz, T. R. Golub, MicroRNA expression profiles classify human cancers. Nature 435, 834-838 (2005).
7. R. G. W. Verhaak, K. A. Hoadley, E. Purdom, V. Wang, Y. Qi, M. D. Wilkerson, C. R. Miller, L. Ding, T. Golub, J. P. Mesirov, G. Alexe, M. Lawrence, M. O'Kelly, P. Tamayo, B. A. Weir, S. Gabriel, W. Winckler, S. Gupta, L. Jakkula, H. S. Feiler, J. G. Hodgson, C. D. James, J. N. Sarkaria, C. Brennan, A. Kahn, P. T. Spellman, R. K. Wilson, T. P. Speed, J. W. Gray, M. Meyerson, G. Getz, C. M. Perou, D. N. Hayes; Cancer Genome Atlas Research Network, Integrated genomic analysis identifies clinically relevant subtypes of glioblastoma characterized by abnormalities in PDGFRA, IDH1, and NF1. Cancer Cell 17, 98-110 (2010).
8. K. M. Naegle, F. M. White, D. A. Lauffenburger, M. B. Yaffe, Robust co-regulation of tyrosine phosphorylation sites on proteins reveals novel protein interactions. Mol. Biosyst. 8, 2771-2782 (2012).
9. A. Wolf-Yadlin, N. Kumar, Y. Zhang, S. Hautaniemi, M. Zaman, H.-D. Kim, V. Grantcharova, D. A. Lauffenburger, F. M. White, Effects of HER2 overexpression on cell signaling networks governing proliferation and migration. Mol. Syst. Biol. 2, 54 (2006).
10. M. Jain, R. Nilsson, S. Sharma, N. Madhusudhan, T. Kitami, A. L. Souza, R. Kafri, M. W. Kirschner, C. B. Clish, V. K. Mootha, Metabolite profiling identifies a key role for glycine in rapid cancer cell proliferation. Science 336, 1040-1044 (2012).
11. M. A. Miller, L Barkal, K. Jeng, A. Herrlich, M. Moss, L G. Griffith, D. A. Lauffenburger, Proteolytic Activity Matrix Analysis (PrAMA) for simultaneous determination of multiple protease activities. Integr. Biol. 3, 422-438 (2011).
12. V. K. Mootha, C. M. Lindgren, K.-F. Eriksson, A. Subramanian, S. Sihag, J. Lehar, P. Puigserver, E. Carlsson, M. Ridderstråle, E. Laurila, N. Houstis, M. J. Daly, N. Patterson, J. P. Mesirov, T. R. Golub, P. Tamayo, B. Spiegelman, E. S. Lander, J. N. Hirschhorn, D. Altshuler, L C. Groop, PGC-1α-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes. Nat. Genet. 34, 267-273 (2003).
13. A. Wolf-Yadlin, S. Hautaniemi, D. A. Lauffenburger, F. M. White, Multiple reaction monitoring for robust quantitative proteomic analysis of cellular signaling networks. Proc. Natl. Acad. Sci. U.S.A. 104, 5860-5865 (2007).
14. M. Köppen, The curse of dimensionality, 5th Online World Conf. Soft Comput. Ind. Appl. 1, 4-8 (2000).
15. M. Steinbach, L. Ertöz, V. Kumar, The challenges of clustering high dimensional data, in New Directions in Statistical Physics (Springer, Berlin, 2004), pp. 273-309.
16. A. Zimek, E. Schubert, H.-P. Kriegel, A survey on unsupervised outlier detection in high-dimensional numerical data. Stat. Anal. Data Min. 5, 363-387 (2012).
17. K. Beyer, J. Goldstein, R. Ramakrishnan, U. Shaft, When is "nearest neighbor" meaningful?, in Database Theory-ICDT'99 (Springer, Berlin, 1999), pp. 217-235.
18. C. C. Aggarwal, J. L Wolf, P. S. Yu, C. Procopiuc, J. S. Park, Fast algorithms for projected clustering. ACM SIGMOD Rec. 28, 61-72 (1999).
19. V. Pestov, On the geometry of similarity search: Dimensionality curse and concentration of measure. Inform. Process. Lett. 73, 47-51 (2000).
20. A. Hinneburg, C. C. Aggarwal, D. A. Keim, What is the nearest neighbor in high dimensional spaces? Proc. 26th VLDB Conf, 506-515 (2000).
21. A. Hinneburg, D. A. Keim, Optimal grid-clustering: Towards breaking the curse of dimensionality in high-dimensional clustering. Int. Conf. Very Large Databases, 506-517 (1999).
22. M. Ester, H.-P. Kriegel, J. Sander, X. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, Second Int. Conf. Knowl. Discov. Data Min., 226-231 (1996).
23. E.-Y. Kim, S.-Y. Kim, D. Ashlock, D. Nam, MULTI-K: Accurate classification of microarray subtypes using ensemble k-means clustering. BMC Bioinformatics 10, 260 (2009).
24. D. Amaratunga, J. Cabrera, Y.-S. Lee, Resampling-based similarity measures for high-dimensional data. J. Comput. Biol. 22, 54-62 (2015).
25. B. Byeon, K. Rasheed, Simultaneously removing noise and selecting relevant features for high dimensional noisy data. Proc. 7th Int. Conf. Mach. Learn. Appl. ICMLA 2008, 147-152 (2008).
26. C. Hou, F. Nie, D. Yi, D. Tao, Discriminative embedded clustering: A framework for grouping high-dimensional data. IEEE Trans. Neural Netw. Learn. Syst. 26, 1287-1299 (2014).
27. H.-P. Kriegel, P. Kröger, A. Zimek, Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering. ACM Trans. Knowl. Discov. Data 3, 1-58 (2009).
28. J. Tang, S. Alelyani, H. Liu, in Data Classification: Algorithms and Applications, C. C. Aggarwal, Ed. (Chapman and Hall/CRC Press, Boca Raton, FL, 2014), pp. 37-64.
29. K. Y. Yeung, W. L. Ruzzo, Principal component analysis for clustering gene expression data. Bioinformatics 17, 763-774 (2001).
30. L Parsons, E. Haque, H. Liu, Subspace clustering for high dimensional data: A review. ACM SIGKDD Explor. Newsl. 6, 90-105 (2004).
31. R. A. van denBerg, H. C. J. Hoefsloot, J. A. Westerhuis, A. K. Smilde, M. J. van der Werf, Centering, scaling, and transformations: Improving the biological information content of metabolomics data. BMC Genomics 7, 142 (2006).
32. K. M. Naegle, R. E. Welsch, M. B. Yaffe, F. M. White, D. A. Lauffenburger, MCAM: Multiple clustering analysis methodology for deriving hypotheses and insights from high-throughput proteomic datasets. PLOS Comput. Biol. 7, e1002119 (2011).
33. P. Tamayo, D. Slonim, J. Mesirov, Q. Zhu, S. Kitareewan, E. Dmitrovsky, E. S. Lander, T. R. Golub, Interpreting patterns of gene expression with self-organizing maps: Methods and application to hematopoietic differentiation. Proc. Natl. Acad. Sci. U.S.A. 96, 2907-2912 (1999).
34. S. Sharma, Applied Multivariate Techniques (John Wiley & Sons Inc., New York, 1996), Vol. 39, p. 512.
35. M. Halkidi, Y. Batistakis, M. Vazirgiannis, On clustering validation techniques. J. Intell. Inf. Syst. 17, 107-145 (2001).
36. L. Hubert, P. Arabie, Comparing partitions. J. Classif. 2, 193-218 (1985).
37. C. Ding, X. He, K-nearest-neighbor consistency in data clustering: Incorporating local information into global optimization, Proc. 2004 ACM Symp. Appl. Comput, 584-589 (2004).
38. J. Handl, J. Knowles, D. B. Kell, Computational cluster validation in post-genomic data analysis. Bioinformatics 21, 3201-3212 (2005).
39. T. Calihski, J. Harabasz, A dendrite method for cluster analysis. Commun. Stat. 3, 1-27 (1974).
40. J. C. Dunn, Well-separated clusters and optimal fuzzy partitions. J. Cybernetics 4, 95-104 (1974).
41. D. L. Davies, D. W. Bouldin, A cluster separation measure. IEEE Trans. Pattern Anal. Mach. Intell. 1, 224-227 (1979).
42. P. J. Rousseeuw, Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53-65 (1987).
43. R. Tibshirani, G. Walther, T. Hastie, Estimating the number of clusters in a data set via the gap statistic. J. R. Stat. Soc. B Met. 63, 411-423 (2001).
44. W. M. Rand, Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66, 846-850 (1971).
45. R. Sloutsky, N. Jimenez, S. J. Swamidass, K. M. Naegle, Accounting for noise when clustering biological data. Brief. Bioinform. 14, 423-436 (2013).
46. A. Ben-Hur, A. Elisseeff, I. Guyon, A stability based method for discovering structure in clustered data. Pac. Symp. Biocomput. 7, 6-17 (2002).
47. K. Y. Yeung, M. Medvedovic, R. E. Bumgarner, Clustering gene-expression data with repeated measurements. Genome Biol. 4, R34 (2003).
48. L. I. Kuncheva, D. P. Vetrov, Evaluation of stability of k-means cluster ensembles with respect to random initialization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1798-1808 (2006).
49. K. Naegle, N. R. Gough, M. B. Yaffe, Criteria for biological reproducibility: What does "n" mean? Sci. Signal. 8, fs7 (2015).
50. E. F. Ryder, P. Robakiewicz, Statistics for the molecular biologist: Group comparisons. Curr. Protoc. Mol. Biol. 67, A.31.1-A.31.22 (2001).
51. M. K. Kerr, G.A. Churchill, Bootstrapping cluster analysis: Assessing the reliability of conclusions from microarray experiments. Proc. Natl. Acad. Sci. U.S.A. 98, 8961-8965 (2001).
52. M. Medvedovic, K. Y. Yeung, R. E. Bumgarner, Bayesian mixture model based clustering of replicated microarray data. Bioinformatics 20, 1222-1232 (2004).
53. E. J. Cooke, R. S. Savage, P. D. W. Kirk, R. Darkins, D. L Wild, Bayesian hierarchical clustering for microarray time series data with replicates and outlier measurements. BMC Bioinformatics 12, 399 (2011).
54. Gene Ontology Consortium, Gene Ontology Consortium: Going forward. Nucleic Acids Res. 43, D1049-D1056 (2015).
55. Y. Benjamini, Y. Hochberg, Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. B Met. 57, 289-300 (1995).
56. C.-A. Tsai, H.-m. Hsueh, J. J. Chen, Estimation of false discovery rates in multiple testing: Application to gene microarray data. Biometrics 59, 1071-1081 (2003).
57. S. B. Pounds, Estimation and control of multiple testing error rates for microarray studies. Brief. Bioinform. 7, 25-36 (2006).
58. M. Aickin, H. Gensler, Adjusting for multiple testing when reporting research results: The Bonferroni vs Holm methods. Am. J. Public Health 86, 726-728 (1996).
59. A. L N. Fred, A. K. Jain, Data clustering using evidence accumulation, Proc. 16th Int. Conf. Pattern Recognit. 4, 276-280 (2002).
60. A. Strehl, J. Ghosh, Cluster ensembles-A knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res. 3, 583-617 (2002).
61. S. Mimaroglu, M. Yagci, CLICOM: Cliques for combining multiple clusterings. Expert Syst. Appl. 39, 1889-1901 (2012).
62. B. Desgraupes, Clustering indices. CRAN Packag., 1-10 (2013).
63. S. Monti, P. Tamayo, J. Mesirov, T. Golub, Consensus clustering: A resampling based method for class discovery and visualization of gene expression microarray data. Mach. Learn. 52, 91-118 (2003).
64. E. R. Dougherty, J. Barrera, M. Brun, S. Kim, R. M. Cesar, Y. Chen, M. Bittner, J. M. Trent, Inference from clustering with application to gene-expression microarrays. J. Comput. Biol. 9, 105-126 (2002).
65. R. Agrawal, J. Gehrke, D. Gunopulos, P. Raghavan, Automatic subspace clustering of high dimensional data for data mining applications. ACM SIGMOD Rec. 27, 94-105 (1998).
66. S. Goil, H. Nagesh, A. Choudhary, "MAFIA: Efficient and scalable subspace clustering for very large data sets" (Technical Report CPDC-TR-9906-010, Center for Parallel and Distributed Computing, Evanston, IL, 1999).
67. A. Zimek, J. Vreeken, The blind men and the elephant: On meeting the problem of multiple truths in data from clustering and pattern mining perspectives. Mach. Learn. 98, 121-155 (2015).
68. E. Levine, E. Domany, Resampling method for unsupervised estimation of cluster validity. Neural Comput. 13, 2573-2593 (2001).
69. P. Bellec, P. Rosa-Neto, O. C. Lyttelton, H. Benali, A. C. Evans, Multi-level bootstrap analysis of stable clusters in resting-state fMRI. Neuroimage 51, 1126-1139(2010).
70. T. Lange, V. Roth, M. L. Braun, J. M. Buhmann, Stability-based validation of clustering solutions. Neural Comput. 16, 1299-1323 (2004).
71. A. K. Jain, Data clustering: 50 years beyond K-means. Pattern Recogn. Lett. 31, 651-666 (2010).
72. P. Berkhin, "Survey of clustering data mining techniques" (Technical Report, Accrue Software Inc., San Jose, CA, 2002).
73. P. A. Jaskowiak, R. J. G. B. Campello, I. G. Costa, On the selection of appropriate distances for gene expression data clustering. BMC Bioinformatics 15 (Suppl. 2), S2 (2014).
74. R. Giancarlo, G. Lo Bosco, L. Pinello, Learning and intelligent. Optimization 6073, 125-138 (2010).
75. Y. Liu, Z. Li, H. Xiong, X. Gao, J. Wu, Understanding of internal clustering validation measures, 2010 IEEE Int. Conf. Data Min., 911-916 (2010).
76. I. B. Mohamad, D. Usman, Standardization and its effects on κ-means clustering algorithm. Res. J. Appl. Sci. Eng. Technol. 6, 3299-3303 (2013).
77. C. C. Aggarwal, A. Hinneburg, D. A. Keim, On the surprising behavior of distance metrics in high dimensional space Lect. Notes Comput. Sci. 1973, 420-434 (2001).