Comparative analysis of missing value imputation methods to improve clustering and interpretation of microarray experiments

BMC Genomics

Volumn 11, Issue 1, 2010, Pages

  Celton, Magalie ^a,b   Malpertuy, Alain ^c   Lelandais, Gaëlle ^a,d   de Brevern, Alexandre G ^a,d  

^a INSERM   (France)

^b SPO   (France)

^c Atragene Informatics   (France)

^d hôpital Robert Debré et Institut national de la transfusion sanguine   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPARATIVE STUDY; CONTROLLED STUDY; GENE CLUSTER; GENETIC ALGORITHM; GENETIC ASSOCIATION; GENETIC STABILITY; METHODOLOGY; MICROARRAY ANALYSIS; QUALITY CONTROL; SIMULATION; STATISTICAL ANALYSIS; ALGORITHM; BIOLOGY; CLUSTER ANALYSIS; DNA MICROARRAY; GENE EXPRESSION PROFILING; GENETICS; HUMAN; SACCHAROMYCES CEREVISIAE; STATISTICS;

ALGORITHMS; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; GENE EXPRESSION PROFILING; HUMANS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; SACCHAROMYCES CEREVISIAE;

EID: 77249129377     PISSN: None     EISSN: 14712164     Source Type: Journal    
DOI: 10.1186/1471-2164-11-15     Document Type: Article

References (84)

1. Liolios K, Tavernarakis N, Hugenholtz P, Kyrpides NC. The Genomes On Line Database (GOLD) v.2: a monitor of genome projects worldwide. Nucleic Acids Res 2006, (34 Database):D332-334. 10.1093/nar/gkj145, 1347507, 16381880.
2. Bernal A, Ear U, Kyrpides N. Genomes OnLine Database (GOLD): a monitor of genome projects world-wide. Nucleic Acids Res 2001, 29(1):126-127. 10.1093/nar/29.1.126, 29859, 11125068.
3. Muro S, Takemasa I, Oba S, Matoba R, Ueno N, Maruyama C, Yamashita R, Sekimoto M, Yamamoto H, Nakamori S, et al. Identification of expressed genes linked to malignancy of human colorectal carcinoma by parametric clustering of quantitative expression data. Genome Biol 2003, 4(3):R21. 10.1186/gb-2003-4-3-r21, 153461, 12620106.
4. Perou CM, Sorlie T, Eisen MB, Rijn M, Jeffrey SS, Rees CA, Pollack JR, Ross DT, Johnsen H, Akslen LA, et al. Molecular portraits of human breast tumours. Nature 2000, 406(6797):747-752. 10.1038/35021093, 10963602.
5. Statnikov A, Aliferis CF, Tsamardinos I, Hardin D, Levy S. A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics 2005, 21(5):631-643. 10.1093/bioinformatics/bti033, 15374862.
6. Imai K, Kawai M, Tada M, Nagase T, Ohara O, Koga H. Temporal change in mKIAA gene expression during the early stage of retinoic acid-induced neurite outgrowth. Gene 2005, 364:114-122. 10.1016/j.gene.2005.05.037, 16169686.
7. Raab RM. Incorporating genome-scale tools for studying energy homeostasis. Nutr Metab (Lond) 2006, 3:40. 10.1186/1743-7075-3-40, 1636640, 17081308.
8. Fellenberg K, Busold CH, Witt O, Bauer A, Beckmann B, Hauser NC, Frohme M, Winter S, Dippon J, Hoheisel JD. Systematic interpretation of microarray data using experiment annotations. BMC Genomics 2006, 7:319. 10.1186/1471-2164-7-319, 1774576, 17181856.
9. Hoheisel JD. Microarray technology: beyond transcript profiling and genotype analysis. Nat Rev Genet 2006, 7(3):200-210. 10.1038/nrg1809, 16485019.
10. DeRisi JL, Iyer VR, Brown PO. Exploring the metabolic and genetic control of gene expression on a genomic scale. Science 1997, 278(5338):680-686. 10.1126/science.278.5338.680, 9381177.
11. Clarke JD, Zhu T. Microarray analysis of the transcriptome as a stepping stone towards understanding biological systems: practical considerations and perspectives. Plant J 2006, 45(4):630-650. 10.1111/j.1365-313X.2006.02668.x, 16441353.
12. Zhang W, Rekaya R, Bertrand K. A method for predicting disease subtypes in presence of misclassification among training samples using gene expression: application to human breast cancer. Bioinformatics 2006, 22(3):317-325. 10.1093/bioinformatics/bti738, 16267079.
13. Alizadeh AA, Eisen MB, Davis RE, Ma C, Lossos IS, Rosenwald A, Boldrick JC, Sabet H, Tran T, Yu X, et al. Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature 2000, 403(6769):503-511. 10.1038/35000501, 10676951.
14. Pham T, Wells C, Crane D. Analysis of microarray gene expression data. Current Bioinformatics 2006, 1(1):37-53.
15. Asyali MH, Colak D, Demirkaya O, Inan MS. Gene expression profile classification: A review. Current Bioinformatics 2006, 1(1):55-73.
16. Wei JS, Greer BT, Westermann F, Steinberg SM, Son CG, Chen QR, Whiteford CC, Bilke S, Krasnoselsky AL, Cenacchi N, et al. Prediction of clinical outcome using gene expression profiling and artificial neural networks for patients with neuroblastoma. Cancer Res 2004, 64(19):6883-6891. 10.1158/0008-5472.CAN-04-0695, 1298184, 15466177.
17. Gruzdz A, Ihnatowicz A, Slezak D. Interactive gene clustering - a case study of breast cancer microarray data. Inf Syst Front 2006, 8:21-27.
18. Schuchhardt J, Beule D, Malik A, Wolski E, Eickhoff H, Lehrach H, Herzel H. Normalization strategies for cDNA microarrays. Nucleic Acids Res 2000, 28(10):E47. 10.1093/nar/28.10.e47, 105386, 10773095.
19. Everitt B. Cluster Analysis. 1974, Heinemann Educ.
20. Hartigan JA, Wong MA. k-means. Applied Statistics 1979, 28:100-115.
21. Kohonen T. Self-organized formation of topologically correct feature maps. Biol Cybern 1982, 43:59-69.
22. Kohonen T. Self-Organizing Maps. 2001, Springer, 3.
23. Mardia K, Kent J, Bibby J. Multivariate Analysis. 1979, Academic Press.
24. Wang D, Lv Y, Guo Z, Li X, Li Y, Zhu J, Yang D, Xu J, Wang C, Rao S, et al. Effects of replacing the unreliable cDNA microarray measurements on the disease classification based on gene expression profiles and functional modules. Bioinformatics 2006, 22(23):2883-2889. 10.1093/bioinformatics/btl339, 16809389.
25. Grużdź A, Ihnatowicz A, Śle{ogonek}zak D. Gene Expression Clustering: Dealing with the Missing Values. Intelligent Information Processing and Web Mining 2005, 521.
26. Fix E, Hodges J. Discriminatory analysis, nonparametric discrimination: Consistency properties. Technical Report 4, USAF School of Aviation Medicine 1951, Randolph Field, Texas.
27. Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman RB. Missing value estimation methods for DNA microarrays. Bioinformatics 2001, 17(6):520-525. 10.1093/bioinformatics/17.6.520, 11395428.
28. Kim KY, Kim BJ, Yi GS. Reuse of imputed data in microarray analysis increases imputation efficiency. BMC Bioinformatics 2004, 5:160. 10.1186/1471-2105-5-160, 528735, 15504240.
29. Bo TH, Dysvik B, Jonassen I. LSimpute: accurate estimation of missing values in microarray data with least squares methods. Nucleic Acids Res 2004, 32(3):e34. 10.1093/nar/gnh026, 374359, 14978222.
30. Oba S, Sato MA, Takemasa I, Monden M, Matsubara K, Ishii S. A Bayesian missing value estimation method for gene expression profile data. Bioinformatics 2003, 19(16):2088-2096. 10.1093/bioinformatics/btg287, 14594714.
31. Bar-Joseph Z, Gerber GK, Gifford DK, Jaakkola TS, Simon I. Continuous representations of time-series gene expression data. J Comput Biol 2003, 10(3-4):341-356. 10.1089/10665270360688057, 12935332.
32. Schliep A, Schonhuth A, Steinhoff C. Using hidden Markov models to analyze gene expression time course data. Bioinformatics 2003, 19(Suppl 1):i255-263. 10.1093/bioinformatics/btg1036, 12855468.
33. Tuikkala J, Elo L, Nevalainen OS, Aittokallio T. Improving missing value estimation in microarray data with gene ontology. Bioinformatics 2006, 22(5):566-572. 10.1093/bioinformatics/btk019, 16377613.
34. Kim DW, Lee KY, Lee KH, Lee D. Towards clustering of incomplete microarray data without the use of imputation. Bioinformatics 2007, 23(1):107-113. 10.1093/bioinformatics/btl555, 17077099.
35. Hu J, Li H, Waterman MS, Zhou XJ. Integrative missing value estimation for microarray data. BMC Bioinformatics 2006, 7:449. 10.1186/1471-2105-7-449, 1622759, 17038176.
36. Jornsten R, Ouyang M, Wang HY. A meta-data based method for DNA microarray imputation. BMC Bioinformatics 2007, 8:109. 10.1186/1471-2105-8-109, 1852325, 17394658.
37. Gan X, Liew AW, Yan H. Microarray missing data imputation based on a set theoretic framework and biological knowledge. Nucleic Acids Res 2006, 34(5):1608-1619. 10.1093/nar/gkl047, 1409680, 16549873.
38. Hua D, Lai Y. An ensemble approach to microarray data-based gene prioritization after missing value imputation. Bioinformatics 2007, 23(6):747-754. 10.1093/bioinformatics/btm010, 17267438.
39. Wang X, Li A, Jiang Z, Feng H. Missing value estimation for DNA microarray gene expression data by Support Vector Regression imputation and orthogonal coding scheme. BMC Bioinformatics 2006, 7:32. 10.1186/1471-2105-7-32, 1403803, 16426462.
40. Feten G, Almoy T, Aastveit AH. Prediction of missing values in microarray and use of mixed models to evaluate the predictors. Stat Appl Genet Mol Biol 2005, 4:Article10.
41. Nguyen DV, Wang N, Carroll RJ. Evaluation of Missing Value Estimation for Microarray Data. Journal of Data Science 2004, 2:347-370.
42. Ouyang M, Welsh WJ, Georgopoulos P. Gaussian mixture clustering and imputation of microarray data. Bioinformatics 2004, 20(6):917-923. 10.1093/bioinformatics/bth007, 14751970.
43. Jornsten R, Wang HY, Welsh WJ, Ouyang M. DNA microarray data imputation and significance analysis of differential expression. Bioinformatics 2005, 21(22):4155-4161. 10.1093/bioinformatics/bti638, 16118262.
44. Sehgal MS, Gondal I, Dooley LS. Collateral missing value imputation: a new robust missing value estimation algorithm for microarray data. Bioinformatics 2005, 21(10):2417-2423. 10.1093/bioinformatics/bti345, 15731210.
45. Scheel I, Aldrin M, Glad IK, Sorum R, Lyng H, Frigessi A. The influence of missing value imputation on detection of differentially expressed genes from microarray data. Bioinformatics 2005, 21(23):4272-4279. 10.1093/bioinformatics/bti708, 16216830.
46. Tsiporkova E, Boeva V. Two-pass imputation algorithm for missing value estimation in gene expression time series. J Bioinform Comput Biol 2007, 5(5):1005-1022. 10.1142/S0219720007003053, 17933008.
47. Bras LP, Menezes JC. Dealing with gene expression missing data. Syst Biol (Stevenage) 2006, 153(3):105-119.
48. Bras LP, Menezes JC. Improving cluster-based missing value estimation of DNA microarray data. Biomol Eng 2007, 24(2):273-282. 10.1016/j.bioeng.2007.04.003, 17493870.
49. de Brevern AG, Hazout S, Malpertuy A. Influence of microarrays experiments missing values on the stability of gene groups by hierarchical clustering. BMC Bioinformatics 2004, 5:114. 10.1186/1471-2105-5-114, 514701, 15324460.
50. Wong DS, Wong FK, Wood GR. A multi-stage approach to clustering and imputation of gene expression profiles. Bioinformatics 2007, 23(8):998-1005. 10.1093/bioinformatics/btm053, 17308340.
51. Ogawa N, DeRisi J, Brown PO. New components of a system for phosphate accumulation and polyphosphate metabolism in Saccharomyces cerevisiae revealed by genomic expression analysis. Mol Biol Cell 2000, 11(12):4309-4321. 15074, 11102525.
52. Gasch AP, Spellman PT, Kao CM, Carmel-Harel O, Eisen MB, Storz G, Botstein D, Brown PO. Genomic expression programs in the response of yeast cells to environmental changes. Mol Biol Cell 2000, 11(12):4241-4257. 15070, 11102521.
53. Bohen SP, Troyanskaya OG, Alter O, Warnke R, Botstein D, Brown PO, Levy R. Variation in gene expression patterns in follicular lymphoma and the response to rituximab. Proc Natl Acad Sci USA 2003, 100(4):1926-1930. 10.1073/pnas.0437875100, 149935, 12571354.
54. Lucau-Danila A, Lelandais G, Kozovska Z, Tanty V, Delaveau T, Devaux F, Jacq C. Early expression of yeast genes affected by chemical stress. Mol Cell Biol 2005, 25(5):1860-1868. 10.1128/MCB.25.5.1860-1868.2005, 549374, 15713640.
55. Brock GN, Shaffer JR, Blakesley RE, Lotz MJ, Tseng GC. Which missing value imputation method to use in expression profiles: a comparative study and two selection schemes. BMC Bioinformatics 2008, 9:12. 10.1186/1471-2105-9-12, 2253514, 18186917.
56. Tuikkala J, Elo LL, Nevalainen OS, Aittokallio T. Missing value imputation improves clustering and interpretation of gene expression microarray data. BMC Bioinformatics 2008, 9:202. 10.1186/1471-2105-9-202, 2386492, 18423022.
57. Kim H, Golub GH, Park H. Missing value estimation for DNA microarray gene expression data: local least squares imputation. Bioinformatics 2005, 21(2):187-198. 10.1093/bioinformatics/bth499, 15333461.
58. Cox B, Kislinger T, Emili A. Integrating gene and protein expression data: pattern analysis and profile mining. Methods 2005, 35(3):303-314. 10.1016/j.ymeth.2004.08.021, 15722226.
59. Tamayo P, Slonim D, Mesirov J, Zhu Q, Kitareewan S, Dmitrovsky E, Lander ES, Golub TR. Interpreting patterns of gene expression with self-organizing maps: methods and application to hematopoietic differentiation. Proc Natl Acad Sci USA 1999, 96(6):2907-2912. 10.1073/pnas.96.6.2907, 15868, 10077610.
60. Eisen MB, Spellman PT, Brown PO, Botstein D. Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA 1998, 95(25):14863-14868. 10.1073/pnas.95.25.14863, 24541, 9843981.
61. Herrero J, Valencia A, Dopazo J. A hierarchical unsupervised growing neural network for clustering gene expression patterns. Bioinformatics 2001, 17(2):126-136. 10.1093/bioinformatics/17.2.126, 11238068.
62. Dopazo J, Carazo JM. Phylogenetic reconstruction using an unsupervised growing neural network that adopts the topology of a phylogenetic tree. J Mol Evol 1997, 44(2):226-233. 10.1007/PL00006139, 9069183.
63. Yin L, Huang CH, Ni J. Clustering of gene expression data: performance and similarity analysis. BMC Bioinformatics 2006, 7(Suppl 4):S19. 10.1186/1471-2105-7-S4-S19, 1780119, 17217511.
64. Fu X, Teng L, Li Y, Chen W, Mao Y, Shen IF, Xie Y. Finding dominant sets in microarray data. Front Biosci 2005, 10:3068-3077. 10.2741/1763, 15970561.
65. Tseng GC, Wong WH. Tight clustering: a resampling-based approach for identifying stable and tight patterns in data. Biometrics 2005, 61(1):10-16. 10.1111/j.0006-341X.2005.031032.x, 15737073.
66. Ben-Dor A, Shamir R, Yakhini Z. Clustering gene expression patterns. J Comput Biol 1999, 6(3-4):281-297. 10.1089/106652799318274, 10582567.
67. Qu Y, Xu S. Supervised cluster analysis for microarray data based on multivariate Gaussian mixture. Bioinformatics 2004, 20(12):1905-1913. 10.1093/bioinformatics/bth177, 15044244.
68. Yeung KY, Fraley C, Murua A, Raftery AE, Ruzzo WL. Model-based clustering and data transformations for gene expression data. Bioinformatics 2001, 17(10):977-987. 10.1093/bioinformatics/17.10.977, 11673243.
69. Yeung KY, Haynor DR, Ruzzo WL. Validating clustering for gene expression data. Bioinformatics 2001, 17(4):309-318. 10.1093/bioinformatics/17.4.309, 11301299.
70. Kim J, Kim H. Clustering of Change Patterns Using Fourier Coefficients. Bioinformatics 2007,
71. Huttenhower C, Flamholz AI, Landis JN, Sahi S, Myers CL, Olszewski KL, Hibbs MA, Siemers NO, Troyanskaya OG, Coller HA. Nearest Neighbor Networks: clustering expression data based on gene neighborhoods. BMC Bioinformatics 2007, 8:250. 10.1186/1471-2105-8-250, 1941745, 17626636.
72. Fu L, Medico E. FLAME, a novel fuzzy clustering method for the analysis of DNA microarray data. BMC Bioinformatics 2007, 8:3. 10.1186/1471-2105-8-3, 1774579, 17204155.
73. Lelandais G, Vincens P, Badel-Chagnon A, Vialette S, Jacq C, Hazout S. Comparing gene expression networks in a multi-dimensional space to extract similarities and differences between organisms. Bioinformatics 2006, 22(11):1359-1366. 10.1093/bioinformatics/btl087, 16527831.
74. Datta S, Datta S. Evaluation of clustering algorithms for gene expression data. BMC Bioinformatics 2006, 7(Suppl 4):S17. 10.1186/1471-2105-7-S4-S17, 1780133, 17217509.
75. Allison DB, Cui X, Page GP, Sabripour M. Microarray data analysis: from disarray to consolidation and consensus. Nat Rev Genet 2006, 7(1):55-65. 10.1038/nrg1749, 16369572.
76. Handl J, Knowles J, Kell DB. Computational cluster validation in post-genomic data analysis. Bioinformatics 2005, 21(15):3201-3212. 10.1093/bioinformatics/bti517, 15914541.
77. Wu LF, Hughes TR, Davierwala AP, Robinson MD, Stoughton R, Altschuler SJ. Large-scale prediction of Saccharomyces cerevisiae gene function using overlapping transcriptional clusters. Nat Genet 2002, 31(3):255-265. 10.1038/ng906, 12089522.
78. Thalamuthu A, Mukhopadhyay I, Zheng X, Tseng GC. Evaluation and comparison of gene clustering methods in microarray analysis. Bioinformatics 2006, 22(19):2405-2412. 10.1093/bioinformatics/btl406, 16882653.
79. Swift S, Tucker A, Vinciotti V, Martin N, Orengo C, Liu X, Kellam P. Consensus clustering and functional interpretation of gene-expression data. Genome Biol 2004, 5(11):R94. 10.1186/gb-2004-5-11-r94, 545785, 15535870.
80. Zhang X, Song X, Wang H, Zhang H. Sequential local least squares imputation estimating missing value of microarray data. Comput Biol Med 2008, 38:1112-1120. 10.1016/j.compbiomed.2008.08.006, 18828999.
81. Gollub J, Ball CA, Binkley G, Demeter J, Finkelstein DB, Hebert JM, Hernandez-Boussard T, Jin H, Kaloper M, Matese JC, et al. The Stanford Microarray Database: data access and quality assessment tools. Nucleic Acids Res 2003, 31(1):94-96. 10.1093/nar/gkg078, 165525, 12519956.
82. Ihaka R, Gentleman R. R: a language for data analysis and graphics. J Comput Graph Stat 1996, 5:299-314.
83. Quackenbush J. Computational analysis of microarray data. Nat Rev Genet 2001, 2(6):418-427. 10.1038/35076576, 11389458.
84. Meunier B, Dumas E, Piec I, Bechet D, Hebraud M, Hocquette JF. Assessment of hierarchical clustering methodologies for proteomic data mining. J Proteome Res 2007, 6(1):358-366. 10.1021/pr060343h, 17203979.