Large Datasets in Biomedicine: A Discussion of Salient Analytic Issues

Journal of the American Medical Informatics Association

Volumn 16, Issue 6, 2009, Pages 759-767

  Sinha, Anshu ^a   Hripcsak, George ^a   Markatou, Marianthi ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BIOINFORMATICS; BIOMEDICINE; DATA ANALYSIS; DATA BASE; DECISION SUPPORT SYSTEM; INFORMATION PROCESSING; STATISTICAL SIGNIFICANCE;

BIOMEDICAL RESEARCH; DATA INTERPRETATION, STATISTICAL; DATABASES, FACTUAL; HUMANS; INFORMATION MANAGEMENT; INTERDISCIPLINARY COMMUNICATION; MODELS, STATISTICAL;

EID: 70350465146     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M2780     Document Type: Article

References (72)

1. Kettenring J.R. A Perspective on Cluster Analysis. Stat Anal Data Min 1 (2008) 52-53
2. Gilks W.R. A rapid two-stage modeling technique for exploring large datasets. Appl Stat 352 (1986) 183-194
3. Dempster A.P. A high dimensional two sample significance test. Ann Math Stat 294 (1958) 995-1,010
4. Heithoff K.S., and Lohr K.N. Effectiveness and Outcomes in Health Care. Proceedings of the Invitational Conference by the Institute of Med, Division of Health Care Sciences (1990), National Academies Press, Washington, DC, United States
5. Kettenring J.R. Massive datasets. Reflections on a Workshop (2001), Telcordia Technologies, Inc
6. Huber P.J. Huge datasets. In: Dutter, and Grossmann (Eds). Compstat (1994), Verlag, Heidelberg 7 Proceedings. Physica
7. Huber P.J. Massive datasets workshop: Four years after. J Comput Graph Stat 83 (1999) 635-652
8. Sohn S.Y. Meta analysis of classification algorithms for pattern recognition. IEEE T Patterns Anal 2111 (1999) 1137-1144
9. Galperin M.Y. The molecular biology database collection: 2007 Update. Nucleic Acids Res 35 (2007) D3-D4
10. st Century (2000)
11. rd edn (2006), Springer-Verlag, New York
12. Shortliffe E.H. Computer-based medical consultations: MYCIN (1976), Elsevier, North Holland, N.Y
13. Clancey W.J., and Shortliffe E.H. Readings in Medical Artificial Intelligence: The First Decade (1984), Addison-Wesley, Longman Publishing, Co, Inc, Boston, MA, United States
14. Murtaugh F., Starck J.L., and Berry M.W. Overcoming the curse of dimensionality in clustering by means of the wavelet transform. Comput J 43 (2000) 107-120
15. Melton G.B., Parsons S., Morrison F.P., et al. Inter-patient distance metrics using SNOMED CT defining relationships. J Biomed Inform 396 (2006) 697-705
16. Friedman J., Hastie T., and Tibshirani R. Elements of Statistical Learning: Prediction, Inference and Data Mining (2001), Springer, New York
17. th International Conference on Database Theory (1999) 217-235
18. Koller D., and Sahami M. Toward optimal feature selection. Proceedings of the Thirteenth International Conference on Machine Learning (1996) 284-292
19. Kittler J. Pattern recognition and signal processing. In: Sijthoff, and Noordhoff (Eds). Feature Set Search (1978), Algorithms, Alphen aan den Rijn, Netherlands 41-60
20. Skalak D. Prototype and feature selection by sampling and random mutation hill climbing algorithms. Proceedings of the Eleventh International Conference on Machine Learning (1994) 293-301
21. Weston J., Muckerjee S., Chapelle O., et al. Feature selection for SVMs. Proceedings of NIPS (2000)
22. nd edn (2002), Springer, New York
23. Saeys Y., Inza I., and Larranaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 2319 (2007) 2507-2517
24. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J Mach Learn Rev 1 (2003; 3Mar) 157-182
25. Friedman J.H., and Stuetzle W. Projection pursuit regression. J Am Stat Assoc 76 (1981) 817-823
26. Pestov V. On the geometry of similarity search: Dimensionality curse and concentration of measure. Info Process Lett 73 (2000) 41-51
27. Benjamini Y., and Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Stat Soc B 57 (1995) 289-300
28. Efron B. Large-Scale simultaneous hypothesis testing: The choice of a null hypothesis. J Am Stat Assoc 99 465 (2004) 96-104
29. Efron B., Tibshirani R., Storey J.D., and Tusher V. Empirical Bayes analysis of a microarray experiment. J Am Stat Assoc 96 (2001) 1151-1160
30. Efron B. Correlation and Large-Scale simultaneous significance testing. J Am Stat Assoc 102 (2007) 93-103
31. Storey J.D. A direct approach to false discovery rates. J R Stat Soc B 64 (2002) 479-498
32. Genovese C., and Wasserman L. Operating characteristics and extensions of the false discovery rate procedure. J R Stat Soc B 64 (2002) 499-517
33. Cao H., Hripcsak G., and Markatou M. A statistical methodology for analyzing co-occurence data from a large sample. J Biomed Inform 403 (2007) 343-352
34. Chuang J.H., Hripcsak G., and Jenders R.A. Considering clustering: A methodological review of clinical decision support system studies. Proc AMIA Symp (2000) 146-150
35. Diggle P.J., Liang K.Y., and Zeger S.L. Analysis of Longitudinal Data (1994), Oxford, Science Press, Clarendon Press, Oxford
36. Clarke R., Ressom H.W., Wang A., et al. The properties of high-dimensional data spaces: Implications for exploring gene and protein expression data. Nat Rev Cancer 81 (2008) 37-49
37. Klebanov L., and Yakovlev A. Diverse correlation structures in gene expression data and their utility in improving statistical inference. Ann Appl Stat 12 (2007) 538-559
38. Xiao Y., Frisina R., Gordon A., Klebanov L., and Yakovlev A. Multivariate search for differentially expressed gene combinations. BMC Bioinform 5 (2004) 164
39. Szabo A., Boucher K., Jones D., et al. Multivariate exploratory tools for microarray data analysis. Biostatistics 4 (2003) 555-567
40. Wright G.W., and Simon R.M. A random variance model for detection of differential gene expression in small microarray experiments. Bioinform 19 (2003) 2448-2455
41. Benjamini Y., and Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann Stat 29 (2001) 1165-1188
42. Romano J.P., and Wolf M. Control of generalized error rates in multiple testing. Ann Stat 35 (2007) 1378-1408
43. Wu W.B. On false discovery control under dependence. Ann Stat 361 (2008) 364-380
44. Yekultieli D., and Benjamini Y. Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics. J Stat Plan Infer 82 (1999) 171-196
45. Storey J.D. The positive false discovery rate: A Bayesian interpretation and the Q-value. Ann Stat 316 (2003) 2013-2035
46. Farcomeni A. Some results on the control of the false discovery rate under dependence. Scand J Stat 34 (2007) 275-297
47. Kettenring J.R. The practice of cluster analysis. J Classif 23 (2006) 3-30
48. Qiu X., Brooks A.I., Klebanov L., and Yakovlev N. The effects of normalization on the correlation structure of microarray data. BMC Bioinform 6 (2005) 120
49. Klebanov L., Chen L., and Yakovlev A. Revisiting adverse effects of cross-hybridization in Affymetrix gene expression data: Do they matter for correlation analysis?. Biol Direct 2 (2007) 28
50. Fisher R.A. On the mathematical foundations of theoretical statistics. Philos Trans Roy Soc London Ser A 222 (1922) 309-368
51. Fisher R.A. Theory of statistical estimation. Proc Cambr Philos Soc 22 (1925) 700-725
52. Shannon C.E. A mathematical theory of communication. Bell Syst Tech J 27 (1948) 379-423 and 623-56
53. Kullback S., and Leibler R.A. On information and sufficiency. Math Stat A 22 (1951) 79-86
54. Kullback S. Information Theory and Statistics (1959), Wiley, New York
55. Sotoca J.M., Sánchez J.S., and Mollineda R.A. A review of data complexity measures and their applicability to pattern classification problems. Actas del III Taller Nacional de Mineria de Datos y Aprendizaje. TAMIDA (2005) 77-83
56. Little R.J.A., and Rubin D.B. Statistical Analysis with Missing Data (1987), Wiley, New York
57. Huber P.J. Robust Statistics (1981), Wiley, New York
58. Dasu T., and Johnson T. Hunting of the snark; finding data glitches using data mining methods. MIT Workshop of Information Quality (1999) 89-98
59. Dasu T., and Johnson T. Exploratory Data Mining and Data Cleaning (2003), Wiley, New York
60. Louie B., Mork P., Martin-Sanchez F., Halevy A., and Tarczy-Hornoch P. Data integration and genomic medicine. J Biomed Inform 401 (2007) 5-16
61. Brazhnik O., and Jones J.F. Anatomy of data integration. J Biomed Inform 403 (2007) 252-269
62. MAQC Consortium. The microarray quality control MAQC. Project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol 249 (2006) 1151-1161
63. Huttenhower C., Hibbs M., Myers C., and Troyanskaya O.G. A scalable method for integration and functional analysis of multiple microarray datasets. Bioinform 22 (2006) 2890-2897
64. Choi J.K., Yu U., Kim S., and Yoo O.J. Combining multiple microarray studies and modeling interstudy variation. Bioinform 19S (2003) 1 i84-90
65. Rhodes D.R., Yu J., Shanker K., et al. Large-scale meta-analysis of cancer microarray data identifies common transcriptional profiles of neoplastic transformation and progression. Proc Natl Acad Sci USA 101 (2004) 9309-9314
66. Hu P., Greenwood C.M.T., and Beyene J. Integrative analysis of multiple gene expression profiles with quality-adjusted effect size models. BMC Bioinform 6 (2005) 128
67. Mulligan M.K., Ponomarev I., Hitzmann, et al. Toward understanding the genetics of alcohol drinking through transcriptome meta-analysis. Proc Natl Acad Sci USA 10316 (2006) 6368-6373
68. Troyanskaya O.G., Dolinski K., Owen A.B., Altman R.B., and Botstein D. A Bayesian framework for combining heterogeneous data sources for gene function prediction in Saccharomyces cerevisiae. Proc Natl Acad Sci U S A 100 14 (2003 Jul 8) 8348-8353 Epub 2003 Jun 25
69. Lee I., Date S.V., Adai A.T., and Marcotte E.M. A probabilistic functional network of yeast genes. Science 1 (2004) 1555-1558
70. Pavlidis P., Weston J., Cai J., and Noble W.S. Learning gene functional classifications from multiple data types. J Comput Biol 92 (2002) 401-411
71. Clare A., and King R.D. Predicting gene function in Saccharomyces cerevisiae. Bioinform 19S (2003) 2 ii42-9
72. nd edn (2007), American College of Physicians, Philadelphia, PA