Data mining methodological weaknesses and suggested fixes

Conferences in Research and Practice in Information Technology Series

Volumn 61, Issue , 2006, Pages 9-16

  Maindonald, John ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Comparison of algorithms; Data mining; Observational data; Predictive accuracy; Reject inference; Selection bias; Statistics; Target population

Indexed keywords

ACCURACY ASSESSMENT; COMPUTING TOOLS; CROSS VALIDATION; EXPERIMENTAL STUDIES; MINING ACTIVITIES; MODEL SELECTION; OBSERVATIONAL DATA; PARAMETER ESTIMATE; PREDICTIVE ACCURACY; REJECT INFERENCE; SELECTION BIAS; SOURCE POPULATION; TEST DATA;

INFERENCE ENGINES; PARAMETER ESTIMATION; POPULATION STATISTICS; STATISTICS;

DATA MINING;

EID: 84870549537     PISSN: 14451336     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (29)

1. Ambroise, C and McLachlan, G J, 2002. Selection bias in gene extraction on the basis of microarray gene-expression data. PNAS, 99: 6262-6266.
2. Elkan, C 2001. Magical Thinking in Data Mining: Lessons From CoIL Challenge 2000 (postscript) (pdf). In Proceedings of the Seventh International Conference on Knowledge Discovery and Data Mining (KDD'01), pp. 426-431. http://www-cse.ucsd.edu/users/elkan/kddcoil.pdf
3. Freedman, D 1979. From association to causation: some remarks on the history of statistics. Statistical Science 14: 243-258.
4. Gentleman, R and Lang, D T 2004. Statistical Analyses and Reproducible Research. Bioconductor Project Working Papers. Working Paper 2. http://www.bepress.com/bioconductor/paper2
5. Hand, D J 2006. Classifier technology and the illusion of progress. Statistical Science 21: 1-14.
6. Heckman, J J 1979. Sample selection bias as a specification factor. Econometrics 47: 153-161.
7. Johnson, A L and Johnson, B C. 1997. Literate programming using noweb. Linux Journal, 64-69, October 1997. http://members.shaw.ca/andrew-johnson/noweb_lj.pdf
8. Keogh, E 2006. The UCR Time Series Data Mining Archive http://www.cs.ucr.edu/~eamonn/TSDMA/index.html Riverside CA. University of California - Computer Science & Engineering Department.
9. Keogh, E, Xi, X, Wei, L & Ratanamahatana, C A 2006. The UCR Time Series Classification/ Clustering Homepage www.cs.ucr.edu/~eamonn/time_series_data/
10. Lawlor, D A, Davey Smith, D F and Ebrahim, S 2004. Commentary: The hormone replacement - coronary heart disease conundrum: is this the death of observational epidemiology? International Journal of Epidemiology 33: 464-467.
11. Lawlor, D A, Davey Smith, D F and Ebrahim, S 2004. Socioeconomic position and Hormone Replacement Therapy use: explaining the discrepancy in evidence from observational and randomized controlled trials. American Journal of Public Health 94: 2149-2154.
12. Leavitt, S D and Dubner, S J, 2005. Freakonomics. A Rogue Economist Explores the Hidden Side of Everything. William Morrow.
13. Leisch F 2006. Sweave User Manual. http://www.ci.tuwien.ac.at/~leisch/Sweave.
14. Maindonald, J H 2005. Data, science and new computing technology. New Zealand Journal of Science 62: 126-128.
15. Maindonald, J H 2006. Statistical Commentary on Data Mining: Course Materials. http://www.maths.anu.edu.au/~johnm/courses/dm/
16. Maindonald, J H, 2003. The role of models in predictive validation. Invited Paper. 54th session of the ISI, Berlin, 2003. http://www.maths.anu.edu.au/~johnm/dm/isi2003-models.pdf
17. Maindonald, J H and Braun, W J, 2nd edn, 2006, in press. Data Analysis and Graphics Using R - An Example-Based Approach. Cambridge University Press. http://wwwmaths.anu.edu.au/~johnm/r-book.html
18. Maindonald, J H and Burden, C J 2005. Selection bias in plots of microarray or other data that have been sampled from a high-dimensional space. In R May and A J Roberts, eds, Proceedings of 12th Computational Techniques and Applications Conference CTAC-2004, volume 46, pp. C59-C74. http://anziamj.austms.org.au/V46/CTAC2004/Main.
19. Meyer, M C and Finney, T 2005. Who wants airbags? Chance 18: 3-16. http://www.stat.uga.edu/~mmeyer/airbags.htmSeealsohttp://wwwmaths.anu.edu.au/~johnm/datasets/airbags/
20. Newman, D J, Hettich, S, Blake, C L and Merz, C J 1998. UCI Repository of machine learning databases http://www.ics.uci.edu/~mlearn/MLRepository.html Irvine, CA: University of California, Department of Information and Computer Science.
21. R Core Development Team. An Introduction to R. http://cran.r-project.org
22. Ripley, B D 1996. Pattern Recognition and Neural Networks. Cambridge University Press.
23. Rosenbaum, P R 2002. Observational Studies, 2nd edn. Springer-Verlag.
24. Writing Group for the Women's Health Initiative Investigators 2002. Risks and benefits of estrogen plus progestin in healthy postmenopausal women: principal results from the Women's Health Initiative randomized controlled trial. Journal of the American Medical Association 288: 321-333.
25. Salzberg, S L 1997. On comparing classifiers: pitfalls to avoid and a recommended approach. Data Mining. and Knowledge Discovery 1: 317-327.
26. Stampfer M J and Colditz G A 1991. Estrogen replacement therapy and coronary heart disease: a quantitative assessment of the epidemiologic evidence. Preventative Medicine 20: 47-63.
27. Swan, N, Fry, R, McPherson, A, Trevena, L and Davis, S 2006. Hormone Replacement Therapy -Part Two - Radio National Summer. http://www.abc.gov.au/rn/healthreport/stories/2006/1530042.htm#
28. Varas-Lorenzo C, Garcia-Rodriguez L A, Perez-Gutthann S, Duque-Oliart A 2000. Hormone replacement therapy and incidence of acute myocardial infarction. A population-based nested casecontrol study. Circulation 101: 2572-2578.
29. Zhu, X, Ambroise, C, and McLachlan, G J 2006. Selection bias in working with the top genes in supervised classification of tissue samples. Statistical Methodology 3: 29-41.