Computational cluster validation in post-genomic data analysis

Bioinformatics

Volumn 21, Issue 15, 2005, Pages 3201-3212

  Handl, Julia ^a   Knowles, Joshua ^a   Kell, Douglas B ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AB INITIO CALCULATION; ANALYTIC METHOD; BIOINFORMATICS; CLUSTER ANALYSIS; DATA ANALYSIS; GENETIC ALGORITHM; GENOMICS; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; MOLECULAR BIOLOGY; PRIORITY JOURNAL; REVIEW; SCIENTIFIC LITERATURE; STATISTICAL ANALYSIS; STRUCTURE ANALYSIS; VALIDATION PROCESS; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGY; CHROMOSOME MAP; COMPUTER PROGRAM; DNA MICROARRAY; GENE EXPRESSION PROFILING; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CHROMOSOME MAPPING; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; DATA INTERPRETATION, STATISTICAL; GENE EXPRESSION PROFILING; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; PATTERN RECOGNITION, AUTOMATED; SOFTWARE;

EID: 25144456056     PISSN: 13674803     EISSN: 13674811     Source Type: Journal    
DOI: 10.1093/bioinformatics/bti517     Document Type: Review

References (75)

1. Ankerst,M., Breunig,M., Kriegel,H.-P. and Sander,J. (1999) OPTICS: ordering points to identify clustering structure. In Delis,A. [i#et al.#1i] (eds), [i#Proceedings of the 1999 International Conference on Management of Data#1i]. ACM Press, New York, pp. 49-60.
2. Bandyopadhyay,S. and Manlik,U. (2001) Nonparametric genetic clustering: comparison of validity indices. [i#IEEE Trans. Syst. Man Cybernet.#1i], [b#31#1b], 120-125.
3. Ben-Dor,A., Friedman,M. and Yakhini,Z. (2002) Overabundance analysis and class discovery in gene expression data. [i#Technical report#1i], Agilent Laboratories, Palo Aeto.
4. Ben-Hur,A., Elisseeff,A. and Guyon,I. (2002) A stability based method for discovering structure in clustered data. In Aetman,R.B. [i#et al.#1i] (eds), [i#Pacific Symposium on Biocomputing#1i]. World Scientific Publishing Co., New Jersey.
5. Bezdek,J. and Pal,N. (1998) Some new indexes of cluster validity. [i#IEEE Trans. Syst. Man Cybernet.#1i], [b#28#1b], 301-315.
6. Bilu,Y. and Linial,M. (2002) The advantage of functional prediction based on clustering of yeast genes and its correlation with non-sequence based classification. [i#J. Comput. Biol.#1i], [b#9#1b], 193-210.
7. Bittner,M. [i#et al.#1i] (2000) Molecular classification of cutaneous malignant melanoma by gene expression profiling. [i#Nature#1i], [b#406#1b] 536-540.
8. Bolshakova,N. and Azuaje,F. (2003) Cluster validation techniques for genome expression data. [i#Signal Processing#1i], [b#83#1b], 825-833.
9. Bolshakova,N. [i#et al.#1i] (2005) An integrated tool for microarray data clustering and cluster validity assessment. [i#Bioinformatics#1i], [b#21#1b] 451-455.
10. Breckenridge,J. (1989) Replicating cluster analysis: Method, consistency and validity. [i#Multivar. Behav. Res.#1i], [b#24#1b], 147-161.
11. Breckenridge,J. (2000) Validating cluster analysis: Consistent replication and symmetry. [i#Multivar. Behav. Res.#1i], [b#35#1b], 261-285.
12. Datta,S. and Datta,S. (2003) Comparison and validation of statistical clustering techniques for microarray gene expression data. [i#Bioinformatics#1i], [b#19#1b], 459-466.
13. Davies,D.L. and Bouldin,D.W. (1979) A cluster separation measure. [i#IEEE Trans. Pattern Anal. Machine Intell.#1i], [b#1#1b], 224-227.
14. Ding,C. and He,C. (2004) K-nearest neighbor consistency in data clustering: Incorporating local information into global optimization. In Haddad,H.M. [i#et al.#1i] (eds), [i#Proceedings of the 2004 ACM Symposium on Applied Computing#1i]. ACM Press, New York, pp. 584-589.
15. Dubes,R. and Jain,A.K. (1979) Validity studies in clustering methodologies. [i#Pattern Recog. Lett.#1i], [b#11#1b], 235-254.
16. Duda,R.O., Hart,P.E. and Stork,D.G. (2001) [i#Pattern Classification#1i], 2nd edn. John Wiley and Sons Ltd.
17. Dunn,J.C. (1974) Well separated clusters and fuzzy partitions. [i#J. Cybernet.#1i], [b#4#1b], 95-104.
18. Edwards,A.L. (1967) [i#The Correlation Coefficient#1i]. W.H. Freeman, pp. 33-46.
19. Efron,B. and Tibshirani,R.J. (1993) [i#An Introduction to the Bootstrap#1i] Chapman and Hall.
20. Eisen,M.B. (1998) Cluster analysis and display of genome-wide expression patterns. [i#Proc. Natl Acad. Sci. USA#1i], [b#95#1b], 14863-14868.
21. Ester,M., Kriegel,H.P. and Sander,J. (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In Simoudis,E. [i#et al.#1i] (eds), [i#Proceedings of the Second International Conference on Knowledge Discovery and Data-Mining#1i]. AIII Press, Menlo Park.
22. Estivill-Castro,V. (2002) Why so many clustering algorithms: A position paper. [i#ACM SIGKDD Explor. Newslett.#1i], [b#4#1b], 65-75.
23. Everitt,B.S. (1993) [i#Cluster Analysis#1i]. Edward Arnold.
24. Fonseca,C.M. and Fleming,P.J. (1996) On the performance assessment and comparison of stochastic multiobjective optimizers. In Voigt,H.M. [i#et al.#1i] (eds), [i#Proceedings of the Fourth International Conference on Parallel Problem Solving from Nature#1i]. Springer-Verlag, Berlin, pp. 584-593.
25. Fridlyand,J. and Dudoit,S. (2001) Applications of resampling methods to estimate the number of clusters and to improve the accuracy of a clustering method. [i#Technical report#1i], Department of Statistics, Berkeley.
26. Gasch,A.P. and Eisen,M.B. (2002) Exploring the conditional coregulation of yeast gene expression through fuzzy [i#k#1i]-means clustering. [i#Genome Biol.#1i], [b#3#1b], 1-22.
27. Gat-Viks,I. [i#et al.#1i] (2003) Scoring clustering solutions by their biological relevance. [i#Bioinformatics#1i], [b#19#1b], 2381-2389.
28. Golub,T.R. [i#et al.#1i] (1999) Molecular classification of cancer: Class discovery and class prediction by gene expression. [i#Science#1i], [b#286#1b] 531-537.
29. Goodacre,R. [i#et al.#1i] (1998) Rapid identification of urinary tract infection bacteria using hyperspectral whole organism fingerprinting and artificial neural networks. [i#Microbiology#1i], [b#144#1b], 1157-1170.
30. Gordon,A.D. (1999) [i#Classification#1i]. 2nd edn. Chapman and Hall.
31. Halkidi,M. [i#et al.#1i] (2001) On clustering validation techniques. [i#J. Intell. Inform. Syst.#1i], [b#17#1b], 107-145.
32. Handl,J. and Knowles,J. (2005) Exploiting the trade-off - the benefits of multiple objectives in data clustering. In Coello,L.A. [i#et al.#1i] (eds), [i#Proceedings of the Third International Conference on Evolutionary Multicriterion Optimization#1i]. Springer-Verlag, Berlin, pp. 547-560.
33. Hastie,T. [i#et al.#1i] (2000) Gene shaving as a method for identifying distinct sets of genes with similar expression patterns. [i#Genome Biol.#1i] [b#1#1b], 1-21.
34. Hastie,T., Tibshirani,R. and Friedman,J. (2001) [i#The Elements of Statistical Learning: Data Mining, Inference and Prediction#1i]. Springer-Verlag.
35. Herrero,J. [i#et al.#1i] (2001) A hierarchical unsupervised growing neural network for clustering gene expression data. [i#Bioinformatics#1i] [b#17#1b], 126-136.
36. Hubert,A. (1985) Comparing partitions. [i#J. Classif.#1i], [b#2#1b], 193-198.
37. Jaccard,S. (1908) Nouvelles recherches sur la distribution florale. [i#Bull. Soc. Vaud. Sci. Nat.#1i], [b#44#1b], 223-270.
38. Jain,A.K. [i#et al.#1i] (1999) Data clustering: A review. [i#ACM Comput. Surv.#1i], [b#31#1b], 264-323.
39. Jardine,N. and Sibson,R. (1971) [i#Mathematical Taxonomy#1i]. John Wiley and Sons.
40. Kaplan,N. [i#et al.#1i] (2004) A functional hierarchical organization of the protein sequence space. [i#BMC Bioinformatics#1i], [b#5#1b].
41. Kell,D.B. and Oliver,S.G. (2004) Here is the evidence, now what is the hypothesis? The complementary roles of inductive and hypothesis-driven science in the post-genomic era. [i#Bioessays#1i], [b#26#1b], 99-105.
42. Kerr,M.K. and Churchill,G.A. (2001) Bootstrapping cluster analysis: assessing the reliability of conclusions from microarray experiments. [i#Proc. Natl Acad. Sci. USA#1i], [b#98#1b], 8961-8965.
43. Kohonen,T. (2001) Self-organizing maps. [i#Springer Series in Information Sciences#1i]. Vol. 30, Springer-Verlag.
44. Krasnogor,N. and Pelta,D.A. (2004) Measuring the similarity of protein structures by means of the universal similarity metric. [i#Bioinformatics#1i], [b#20#1b], 1015-1021.
45. Krieger,A.M. and Green,P. (1999) A cautionary note on using internal crossvalidation. [i#Psychometrika#1i], [b#64#1b], 341-353.
46. Lange,T. [i#et al.#1i] (2004) Stability-based validation of clustering solutions. [i#Neural comput.#1i], [b#16#1b], 1299-1323.
47. Lehmann,E.L. and D'Abrera,H.J.M. (1998) [i#Nonparametrics. Statistical Methods Based on Ranks#1i]. Prentice-Hall.
48. Levine,E. and Domany,E. (2001) Resampling method for unsupervised estimation of cluster validity. [i#Neural Comput.#1i], [b#13#1b], 2573-2593.
49. Li,C. and Wong,W.H. (2001) Model-based analysis of oligonucleotide arrays: Model validation, design issues and standard error application. [i#Genome Biol.#1i], [b#2#1b], 1-11.
50. MacQueen,L. (1967) Some methods for classification and analysis of multivariate observations. In de Cam,L.M. [i#et al.#1i] (eds), [i#Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability#1i]. University of California Press, Berkeley, pp. 281-297.
51. Madeira,S.C. and Oliveira,A.L. (2004) Biclustering algorithms for biological data analysis: A survey. [i#IEEE Trans. Comput. Biol. Bioinformatics#1i], [b#1#1b], 24-45.
52. McLachlan,G. and Krishman,T. (1997) [i#The EM Algorithm and Extensions#1i] John Wiley and Son Ltd.
53. McShane,L.M. [i#et al.#1i] (2002) Methods for assessing reproducibility of clustering patterns observed in analyses of microarray data. [i#Bioinformatics#1i], [b#18#1b], 1462-1469.
54. Mendes,D.J. [i#et al.#1i] (2003) Artificial gene networks for objective comparison of analysis algorithms. [i#Bioinformatics#1i], [b#19#1b], 122-129.
55. Michaud,D.J. [i#et al.#1i] (2003) eXPatGen: Generating dynamic expression patterns for the systematic evaluation of analytical methods. [i#Bioinformatics#1i], [b#19#1b], 1140-1146.
56. Milligan,G.W. and Cooper,M.C. (1986) A study of the comparability of external criteria for hierachical cluster ananlysis. [i#Multivar. Behav. Res.#1i], [b#21#1b], 441-458.
57. Pal,N.R. and Bezdek,J.C. (1995) On cluster validity for the fuzzy [i#c#1i] means model. [i#IEEE Trans. Fuzzy Syst.#1i], [b#3#1b], 370-379.
58. Pareto,V. (1971) [i#Manual of Political Economy, 1971 Translation of 1927 Edition#1i]. Augustus M. Kelley.
59. Quackenbush,J. (2001) Computational analysis of rnicroarray data. [i#Nat. Rev. Genet.#1i], [b#2#1b], 418-427.
60. Rand,W. (1971) Objective criteria for the evaluation of clustering methods. [i#J. Am. Stat. Assoc.#1i], [b#66#1b], 846-850.
61. Rayward-Smith,V.J., Osman,I.H., Reeves,C.R. and Srmlth,G.D. (1996) [i#Modern Heuristic Search Methods#1i]. John Wiley and Sons Ltd.
62. Romesburg,H.C. (1984) [i#Cluster Analysis for Researchers#1i]. Belmont.
63. Rousseeuw,P.J. (1987) Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. [i#J. Comput. Appl. Math.#1i], [b#20#1b] 53-65.
64. Shaw,A.D. [i#et al.#1i] (1997) Discrimination of the variety and region of origin of extra virgin olive oils using C-13 NMR and multivariate calibration with variable reduction. [i#Anal. Chim. Acta#1i], [b#384#1b], 357-374.
65. Slonim,D.K. (2002) From patterns to pathways: Gene expression data analysis comes of age. [i#Nat. Genet.#1i], [b#32#1b], 502-508.
66. De Smet,F. [i#et al.#1i] (2002) Adaptive quality-based clustering of gene expression profiles. [i#Bioinformatics#1i], [b#18#1b], 735-746.
67. Tamayo,P. [i#et al.#1i] (1999) Interpreting patterns of gene expression with self-organizing maps: Methods and application to hematopoietic differentiation. [i#Proc. Natl Acad. Sci. USA#1i], [b#96#1b], 2907-2912.
68. Tavazoie,S. [i#et al.#1i] (1999) Systematic determination of genetic network architecture. [i#Nat. Genet.#1i], [b#22#1b], 281-285.
69. Tibshirani,R., Walther,G., Botstein,D. and Brown,P. (2001a) Cluster validation by prediction strength. [i#Technical report#1i], Department of Statistics, Stanford University, CA.
70. Tibshirani,R. [i#et al.#1i] (2001b) Estimating the number of clusters in a data set via the gap statistic. [i#J. R. Stat. Soc. Ser. B#1i], [b#63#1b] 411-423.
71. Toronen,P. (2004) Selection of informative clusters from hierarchical cluster tree with gene classes. [i#BMC Bioinformatics#1i], [b#5#1b], 34.
72. van Rijsbergen,C. (1979) [i#Information Retrieval#1i], 2nd edn. Butterworths.
73. Vorhees,E. (1985) [i#The effectiveness and efficiency of agglomerative hierarchical clustering in document retrieval#1i]. PhD thesis, Department of Computer Science, Cornell University.
74. Yeung,K.Y. [i#et al.#1i] (2001a) Validating clustering for gene expression data. [i#Bioinformatics#1i], [b#17#1b], 309-318.
75. Yeung,K.Y. [i#et al.#1i] (2001b) Model-based clustering and data transformation for gene expression data. [i#Bioinformatics#1i], [b#17#1b], 977-987.