A prediction-based resampling method for estimating the number of clusters in a dataset

Genome Biology

Volumn 3, Issue 7, 2002, Pages

  Dudoit, Sandrine ^a,c   Fridlyand, Jane ^b,c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Both authors contributed equally to this work   (United States)

Author keywords

Acute Lymphoblastic Leukemia; Cluster Assignment; Cluster Procedure; Follicular Lymphoma; mRNA Sample

Indexed keywords

ALGORITHM; ARTICLE; BIOLOGY; CLASSIFICATION; CLUSTER ANALYSIS; COMPARATIVE STUDY; COMPUTER SIMULATION; DNA MICROARRAY; GENE EXPRESSION PROFILING; GENETICS; HUMAN; METABOLISM; METHODOLOGY; NEOPLASM; REPRODUCIBILITY;

ALGORITHMS; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; GENE EXPRESSION PROFILING; HUMANS; NEOPLASMS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; REPRODUCIBILITY OF RESULTS;

EID: 0037172724     PISSN: 14747596     EISSN: 1474760X     Source Type: Journal    
DOI: 10.1186/gb-2002-3-7-research0036     Document Type: Article

References (41)

1. Alizadeh AA, Eisen MB, Davis RE, Ma C, Lossos IS, Rosenwald A, Boldrick JC, Sabet H, Tran T, Yu X, et al: Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature. 2000, 403: 503-511. 10.1038/35000501. DOI: 10.1038/35000501
2. Alon U, Barkai N, Notterman DA, Gish K, Ybarra S, Mack D, Levine AJ: Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc Natl Acad Sci USA. 1999, 96: 6745-6750. 10.1073/pnas.96.12.6745. DOI: 10.1073/pnas.96.12.6745
3. Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh M, Downing JR, Caligiuri MA, et al: Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science. 1999, 286: 531-537. 10.1016/S0378-4371(00)00404-0. DOI: 10.1126/science.286.5439.531
4. Perou CM, Jeffrey SS, van de Rijn M, Rees CA, Eisen MB, Ross DT, Pergamenschikov A, Williams CF, Zhu SX, Lee JCF, et al: Distinctive gene expression patterns in human mammary epithelial cells and breast cancers. Proc Natl Acad Sci USA. 1999, 96: 9212-9217. 10.1073/pnas.96.16.9212. DOI: 10.1073/pnas.96.16.9212
5. Pollack JR, Perou CM, Alizadeh AA, Eisen MB, Pergamenschikov A, Williams CF, Jeffrey SS, Botstein D, Brown PO: Genome-wide analysis of DNA copy-number changes using cDNA microarrays. Nat Genet. 1999, 23: 41-46. 10.1038/12640. DOI: 10.1038/14385
6. Ross DT, Scherf U, Eisen MB, Perou CM, Spellman P, Iyer V, Jeffrey SS, de Rijn MV, Waltham M, Pergamenschikov A, et al: Systematic variation in gene expression patterns in human cancer cell lines. Nat Genet. 2000, 24: 227-234. 10.1038/73432. DOI: 10.1038/73432
7. Dudoit S, Fridlyand J: Bagging to Improve the Accuracy of a Clustering Procedure. Technical Report 600, Department of Statistics, University of California, Berkeley,. 2001, [http://www.stat.Berkeley.EDU/tech-reports/index.html]
8. Mardia KV, Kent JT, Bibby JM: Multivariate Analysis. San Diego: Academic Press;. 1979
9. Milligan GW: Clustering validation: results and implications for applied analyses. In Clustering and Classification. Edited by: Arabie P, Hubert LJ, Soete GD. 1996, River Edge, NJ. World Scientific Publishing, 341-375. DOI: 10.1142/9789812832153_0010
10. Eisen MB, Spellman PT, Brown PO, Botstein D: Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA. 1998, 95: 14863-14868. 10.1073/pnas.95.25.14863. DOI: 10.1073/pnas.95.25.14863
11. Fraley C, Raftery A: How Many Clusters? Which Clustering Method? - Answers via Model-based Cluster Analysis. Technical Report 329, Department of Statistics, University of Washington,. 1998, [http://www.stat.washington.edu/www/research/reports/1990s/#1998]
12. Milligan GW, Cooper MC: An examination of procedures for determining the number of clusters in a data set. Psychometrika. 1985, 50: 159-179. DOI: 10.1007/BF02294245
13. Breiman L: Bagging predictors. Machine Learning. 1996, 24: 123-140. 10.1023/A:1018054314350.
14. Breiman L: Arcing classifiers. Annls Statistics. 1998, 26: 801-824. 10.1214/aos/1024691079. DOI: 10.1214/aos/1024691079
15. Freund Y, Schapire RE: A decision-theoretic generalization of on-line learning and an application to boosting. J Computer System Sci. 1997, 55: 119-139. 10.1006/jcss.1997.1504. DOI: 10.1006/jcss.1997.1504
16. Kaufman L, Rousseeuw PJ: Finding Groups in Data: An Introduction to Cluster Analysis. New York: Wiley;. 1990
17. Sarle W: Cubic Clustering Criterion. Technical Report A-108, SAS Institute, Inc.,. 1983, [http://www.sas.com/service/library/onlinedoc/trindex.html]
18. Bock HH: On some significance tests in cluster analysis. J Classification. 1985, 2: 77-108. DOI: 10.1007/BF01908065
19. Hartigan J: Asymptotic distributions for clustering criteria. Annls Statistics. 1978, 6: 117-131. DOI: 10.1214/aos/1176344071
20. Jain AK, Dubes RC: Algorithms for Clustering Data. Englewood Cliffs, NJ:Prentice-Hall;. 1988
21. Calinski R, Harabasz J: A dendrite method for cluster analysis. Commun Statistics. 1974, 3: 1-27. DOI: 10.1080/03610928308827180
22. Davies D, Bouldin D: A cluster separation measure. IEEE Trans Pattern Analysis Machine Intelligence. 1979, 1: 224-227. DOI: 10.1109/TPAMI.1979.4766909
23. Krzanowski W, Lai Y: A criterion for determining the number of groups in a dataset using sum of squares clustering. Biometrics. 1985, 44: 23-34. DOI: 10.2307/2531893
24. Tibshirani R, Walther G, Hastie. T: Estimating the Number of Clusters in a Dataset via the Gap Statistic. Technical report, Department of Biostatistics, Stanford University,. March 2000, [http://www-stat.stanford.edu/~tibs/research.html]
25. Hartigan JA: Statistical theory in clustering. J Classification. 1985, 2: 63-76. DOI: 10.1007/BF01908064
26. Rand WM: Objective criteria for the evaluation of clustering methods. J Am Stat Assoc. 1971, 66: 846-850. DOI: 10.1080/01621459.1971.10482356
27. Fowlkes EB, Mallows CL: A method for comparing two hierarchical clusterings. J Am Stat Assoc. 1983, 78: 553-584. DOI: 10.1080/01621459.1983.10478008
28. Breckenridge J: Replicating cluster analysis: method, consistency and validity. Multivariate Behav Res. 1989, 24: 147-161. DOI: 10.1207/s15327906mbr2402_1
29. Dudoit S, Fridlyand J, Speed TP: Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc. 2002, 97: 77-87. 10.1198/016214502753479248. DOI: 10.1198/016214502753479248
30. Bittner M, Meltzer P, Chen Y, Jiang Y, Seftor E, Hendrix M, Radmacher M, Simon R, Yakhini Z, Ben-Dor A, et al: Molecular classification of cutaneous malignant melanoma by gene expression profiling. Nature. 2000, 406: 536-540. 10.1038/35020115. DOI: 10.1038/35020115
31. Tavazoie S, Hughes JD, Campbell MJ, Cho RJ, Church GM: Systematic determination of genetic network architecture. Nat Genet. 1999, 22: 281-285. 10.1038/10343. DOI: 10.1038/10343
32. McLachlan GJ, Bean R, Peel D: A mixture model-based approach to the clustering of microarray expression data. Bioinformatics. 2002, 18: 413-422. 10.1093/bioinformatics/18.3.413. DOI: 10.1093/bioinformatics/18.3.413
33. Ben-Hur A, Elisseeff A, Guyon I: A stability based method for discovering structure in clustered data. Pac Symp Biocomputing. 2002, 7: 6-17.
34. Leisch F: Bagged Clustering. Technical report, SFB Adaptive Information Systems and Modelling in Economics and Management Science, Vienna University of Economics and Business Administration, August. 1999, [http://www.ci.tuwien.ac.at/~leisch/papers/fl-techrep.html]
35. Yang YH, Buckley MJ, Dudoit S, Speed TP: Comparison of methods for image analysis on cDNA microarray data. J Comput Graph Stat. 2002, 11: 108-136. 10.1198/106186002317375640. DOI: 10.1198/106186002317375640
36. Yang YH, Dudoit S, Luu P, Speed TP: Normalization for cDNA microarray data. Microarrays: Optical Technologies and Informatics. 2001, 4266: 141-152. 10.1117/12.427982.
37. Lymphoma/Leukemia Molecular Profiling Project. [http://genome-www.stanford.edu/lymphoma]
38. Cancer genomics publications data sets. [http://www-genome.wi.mit.edu/cgi-bin/cancer/datasets.cgi]
39. NCI60 Cancer Microarray Project. [http://genome-www.stanford.edu/nci60]
40. National Human Genome Research Institute: Resources. [http://www.nhgri.nih.gov/DIR/Microarray/selected_publications.html]
41. Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman R: Missing value estimation methods for DNA microarrays. Bioinformatics. 2001, 17: 520-525. 10.1093/bioinformatics/17.6.520. DOI: 10.1093/bioinformatics/17.6.520