Data mining methods in the prediction of Dementia: A real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests

BMC Research Notes

Volumn 4, Issue , 2011, Pages

  Maroco, João ^a   Silva, Dina ^b   Rodrigues, Ana ^c   Guerreiro, Manuela ^b   Santana, Isabel ^c   De Mendonça, Alexandre ^b  

^a INSTITUTO SUPERIOR DE PSICOLOGIA APLICADA   (Portugal)

^b INSTITUTO DE MEDICINA MOLECULAR   (Portugal)

^c CENTRO HOSPITALAR E UNIVERSITÁRIO DE COIMBRA   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 80051660823     PISSN: None     EISSN: 17560500     Source Type: Journal    
DOI: 10.1186/1756-0500-4-299     Document Type: Article

References (73)

1. Global prevalence of dementia: a Delphi consensus study. Ferri CPM, Brayne C, Lancet Neurology 2005 366 2112 2117 (Pubitemid 41797645)
2. Practice parameter: Early detection of dementia: Mild cognitive impairment (an evidence-based review)-Report of the Quality Standards Subcommittee of the American Academy of Neurology. Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST, Neurology 2001 56 1133 1142 11342677
3. Mild cognitive impairment (MCI) in medical practice: a critical review of the concept and new diagnostic procedure. Report of the MCI Working Group of the European Consortium on Alzheimer's Disease. Portet F, Ousset PJ, Visser PJ, Frisoni GB, Nobili F, Scheltens P, Vellas B, Touchon J, J Neurol Neurosurg Psychiatry 2006 77 714 718 10.1136/jnnp.2005.085332 16549412 (Pubitemid 43837193)
4. Mild cognitive impairment-Focus on diagnosis. de Mendonca A, Guerreiro M, Ribeiro F, Mendes T, Garcia C, Journal of Molecular Neuroscience 2004 23 143 147 10.1385/JMN:23:1-2:143 15126699 (Pubitemid 41359196)
5. Research criteria for the diagnosis of Alzheimer"s disease: revising the NINCDS-ADRDA criteria. Dubois B, Feldman HH, Jacova C, Dekosky ST, Barberger-Gateau P, Cummings J, Delocourte A, Galasko D, Gauthier S, Jicha G, et al. Lancet Neurology 2007 6 734 746 10.1016/S1474-4422(07)70178-3 17616482 (Pubitemid 47058377)
6. Preclinical Alzheimer's disease: diagnosis and prediction of progression. Chong MS, Sahadevan S, Lancet Neurology 2005 4 576 579 10.1016/S1474-4422(05) 70168-X 16109364 (Pubitemid 41139979)
7. Annual conversion to Alzheimer disease among patients with memory complaints attending an outpatient memory clinic: The influence of amnestic mild cognitive impairment and the predictive value of neuropsychological testing. Lehrner J, Gufler R, Guttmann G, Maly J, Gleiss A, Auff E, Dal-Bianco P, Wiener Klinische Wochenschrift 2005 117 629 635 10.1007/s00508-005-0428-6 16416345 (Pubitemid 41494965)
8. Clinical predictors of progression to Alzheimer disease in amnestic mild cognitive impairment. Fleisher AS, Sowell BB, Taylor C, Gamst AC, Petersen RC, Thal LJ, Alzheimers Disease C, Neurology 2007 68 1588 1595 10.1212/01.wnl. 0000258542.58725.4c 17287448 (Pubitemid 46717983)
9. Alzheimer's Disease Cooperative Study. Clinical predictors of progression to Alzheimer disease in amnestic mild cognitive impairment. Fleisher AS, Sowell BB, Taylor C, Gamst AC, Petersen RC, Thal LJ, Neurology 2007 68 1588 1595 10.1212/01.wnl.0000258542.58725.4c 17287448 (Pubitemid 46717983)
10. Preclinical dementia: an Italian multicentre study on amnestic mild cognitive impairment. Perri R, Serra L, Carlesimo GA, Caltagirone C, Early Diag Grp Italian I, Dementia and Geriatric Cognitive Disorders 2007 23 289 300 10.1159/000100871 17356272 (Pubitemid 46631934)
11. Amnestic syndrome of the medial temporal type identifies prodromal AD-A longitudinal study. Sarazin M, Berr C, De Rotrou J, Fabrigoule C, Pasquier F, Legrain S, Michel B, Puel M, Volteau M, Touchon J, et al. Neurology 2007 69 1859 1867 10.1212/01.wnl.0000279336.36610.f7 17984454 (Pubitemid 350071147)
12. Comparison between neural networks and multiple logistic regression to predict acute coronary syndrome in the emergency room. Michael G, Jonas B, Jakob F, Ulf E, Lars E, Mattias O, 2006
13. A comparison of regression trees, logistic regression, generalized additive models, and multivariate adaptive regression splines for predicting AMI mortality. Peter CA, Statistics in Medicine 2007 26 2937 2957 10.1002/sim.2770 17186501 (Pubitemid 46939420)
14. Comparing classification accuracy of neural networks, binary logit regression and discriminant analysis for insolvency prediction of life insurers. Goss EP, Ramchandani H, Journal of Economics and Finance 1995 19 1 18
15. The Efficiency of Logistic Regression Compared to Normal Discriminant Analysis. Efron B, Journal of the American Statistical Association 1975 70 892 898 10.2307/2285453
16. Comparing linear discriminant function with logistic regression for the two-group classification problem. Fan X, Wang L, Journal of Experimental Education 1999 67 265 286 10.1080/00220979909598356
17. Linear discriminant analysis versus logistic regression: a comparison of classification errors in the two-group case. Lei PW, Koehly LM, The Journal of Experimental Education 2003 72 25 49 10.1080/00220970309600878 (Pubitemid 38213585)
18. Comparison of Logistic Regression and Linear. Discriminant Analysis: A Simulation Study. Pohar M, Blas M, Turk S, Metodoloki zvezki 2004 1 143 161
19. Redes neurales vs modelos estadísticos: Simulaciones sobre tareas de prediccián y clasificacián. Pitarque A, Roy JF, Ruiz JC, Psicolágica 1998 19 387 400 20385444
20. Efficient training of RBF networks for classification. Nabney IT, International Journal of Neural Systems 2004 14 201 208 10.1142/ S0129065704001930 15243952
21. Application of classification tree and neural network algorithms to the identification of serological liver marker profiles for the diagnosis of hepatocellular carcinoma. Poon TC, Chan AT, Zee B, Ho SK, Mok TS, Leung TW, Johnson PJ, Oncology 2001 61 275 283 10.1159/000055334 11721174 (Pubitemid 33135836)
22. Advantages and disadvantages of neural networks for predicting clinical outcomes. Suka M, Oeda S, Ichimura T, Yoshida K, Takezawa J, IMECS 2007: International Multiconference of engineers and computer scientists 2007 I & II 839 844
23. RBF network classification of ECGs as a potential marker for sudden cardiac death. Kestler HA, Schwenker F, Radial basis function networks 2: new advances in design archive Heidelberg, Germany: Physica-Verlag GmbH 2001 162 214
24. Radial basis function neural networks classification for the recognition of idiopathic pulmonary fibrosis in microscopic images. Maglogiannis I, Sarimveis H, Kiranoudis CT, Chatziioanno AA, Oikonomou N, V A, IEEE Trans Inf Technol Biomed 2008 12 42 54 18270036 (Pubitemid 351266642)
25. Assessment of the performances of multilayer perceptron neural networks in comparison with recurrent neural networks and two statistical methods for diagnosing coronary artery disease. Sut N, Senocak M, Expert Systems 2007 24 131 142 10.1111/j.1468-0394.2007.00425.x (Pubitemid 46898181)
26. Improvements in Personnel Selection with Neural Nets: A Pilot Study in the field of Aviation Psychology. Sommer M, Olbrich A, Arendasy M, The International Journal of Aviation Psychology 2004 14 103 115 10.1207/s15327108ijap1401-6 (Pubitemid 38203198)
27. Support vector machines in DSC-based glioma imaging: Suggestions for optimal characterization. Zollner FG, Emblem KE, Schad LR, Magn Reson Med 2010
28. Applications of Support Vector Machines in Chemistry. Ivanciuc O, Reviews in Computational Chemistry Weinheim: John Wiley & Sons, Inc, Lipkowitz KB, Cundari TR, 2007 23 291 400
29. Comparing performances of logistic regression, classification and regression tree, and neural networks for predicting coronary artery disease. Kurt I, Ture M, Kurum AT, Expert Systems with Applications 2008 34 366 374 10.1016/j.eswa.2006.09.004 (Pubitemid 46766626)
30. Misclassification Rates for Four Methods of Group Classification: Impact of Predictor Distribution, Covariance Inequality, Effect Size, Sample Size, and Group Size Ratio. Finch H, Schneider MK, Educational and Psychological Measurement 2006 66 240 257 10.1177/0013164405278579 (Pubitemid 43344141)
31. Classification Accuracy of Neural Networks vs. Discriminant Analysis, Logistic Regression, and Classification and Regression Trees: Three- and Five-Group Cases. Finch H, Schneider MK, Methodology 2007 3 47 57
32. Comparison of three statistical classifiers on a prostate cancer data. Gelnarova E, Safarik L, Neural Network World 2005 15 311 318 (Pubitemid 41274837)
33. A note on comparing classifiers. Duin RPW, Pattern Recognition Letters 1996 17 529 536 10.1016/0167-8655(95)00113-1 (Pubitemid 126380803)
34. The support vector machine under test. Meyer D, Leischa F, Hornik K, Neurocomputing 2003 55 169 186 10.1016/S0925-2312(03)00431-4 (Pubitemid 37336675)
35. Classification of patients with pain based on neuropathic pain symptoms: Comparison of an artificial neural network against an established scoring system. Behrman M, Linder R, Assadi AH, Stacey BR, Backonja MM, European Journal of Pain 2007 11 370 376 10.1016/j.ejpain.2006.03.001 16624601 (Pubitemid 46366761)
36. The Use of Multiple Measurements in Taxonomic Problems. Fisher R, Annals of Eugenics 1936 7 179 188 10.1111/j.1469-1809.1936.tb02137.x
37. McLachlan GJ, Discriminant Analysis and Statistical Pattern Recognition London: Wiley Interscience 2004
38. Hosmer DW, Lemeshow S, Applied Logistic Regression New York: Chichester, Wiley 2 2000
39. Neural networks. Yang ZR, Methods Mol Biol 2010 609 197 222 10.1007/978-1-60327-241-4-12 20221921
40. Bishop C, Neural Networks for Pattern Recognition Oxford: Oxford: University Press 1995
41. Support-Vector Networks. Cortes C, Vapnik V, Machine Learning 1995 20 273 297
42. Support Vector Machines in R. Karatzoglou A, Meyer D, Hornik K, Journal of Statistical Software 2006 15 1 28 (Pubitemid 43535923)
43. Support vector machines: Hype or hallelujah? Bennett KP, Campbell C, SIGKDD Explorations 2000 2
44. Breiman L, Friedman JH, Olshen RA, Stone CJ, Classification and regression trees Monterey, Calif., USA: Wadsworth, Inc 1984
45. An exploratory technique for investigation large quantities of categorical data. Kass G, Applied Statistics 1980 29 119 127 10.2307/2986296
46. Split selection methods for classification trees. Loh W-Y, Shih Y-S, Statistica Sinica 1997 7 815 840
47. Random forests. Breiman L, Machine Learning 2001 45 123 140 10.1023/A:1010950718922 (Pubitemid 33635982)
48. Classification and Regression by randomForest. Liaw A, Wiener M, R News 2002 2/3 (December) 18 22
49. APA, Diagnostic and statistical manual of mental disorders Washington, DC: American Psychiatric Association 4 2000 Text revision
50. Doença de Alzheimer, problemas do diagnástico clínico. Garcia C, Tese de Doutoramento Universidade de Lisboa., Faculdade de Medicina de Lisboa 1984
51. Benton AL, Hamsher K, Multilingual Aphasia Examination Department of Neurology, University of Iowa Hospitals, Iowa City 1976
52. Wechsler D, Manual for the Wechsler Adult Intelligence Scale - Revised Psychological Corporation, New York 1981
53. Freedman M, Leach L, Kaplan E, Winocur G, Shulman K, Delis DC, Clock-drawing: a neuropsychological analysis New York: NY: Oxford University Press 1994
54. Wechsler D, Stone CP, Wechsler memory scale New York: Psychological Corporation 1945
55. Verbal learning and memory deficits in Mild Cognitive Impairment. Ribeiro F, Guerreiro M, de Mendonça A, Journal of Clinical and Experimental Neuropsychology 2007 29 187 197 10.1080/13803390600629775 17365254
56. Support Vector Machines: The Interface to libsvm in package e1071. Meyer D, R News 2001 1/3 23 26
57. A Tutorial on Support Vector Machines for Pattern Recognition. Burges C, Data Mining and Knowledge Discovery 1998 2 121 167 10.1023/A:1009715923555 (Pubitemid 128126769)
58. Application and comparison of classification algorithms for recognition of Alzheimer's disease in electrical brain activity (EEG). Lehmann C, Koenig T, Jelic V, Prichep L, John RE, Wahlund LO, Dodge Y, Dierks T, Journal of Neuroscience Methods 2007 161 342 350 10.1016/j.jneumeth.2006.10.023 17156848 (Pubitemid 46466939)
59. Use of a Probabilistic Neural Network to Estimate the Risk of Mortality after Cardiac Surgery. Orr RK, Medical Decision Making 1997 17 178 185 10.1177/0272989X9701700208 9107613 (Pubitemid 27157033)
60. On the misuses of artificial neural networks for prognostic and diagnostic classification in oncology. Schwarzer G, Vach W, Schumacher M, Statistics in Medicine 2000 19 541 561 10.1002/(SICI)1097-0258(20000229)19: 4<541::AID-SIM355>3.0.CO;2-V 10694735 (Pubitemid 30126883)
61. Effects of Sample Size in Classifier Design. Fukunaga K, Hayes RR, IEEE Transactions on Pattern Analysis and Machine Intelligence 1989 11 873 885 10.1109/34.31448
62. Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners. Raudys SJ, Jain AK, IEEE Transactions on Pattern Analysis and Machine Intelligence 1991 13 252 264 10.1109/34.75512
63. Neural networks and logistic regression. Part II. Vach W, Roner R, Schumacher M, Computational Statistics and Data Analysis 1996 21 683 701 10.1016/0167-9473(95)00033-X
64. Use of SVM methods with surface-based cortical and volumetric subcortical measurements to detect Alzheimer's disease. Oliveira PP Jr, Nitrini R, Busatto G, Buchpiguel C, Sato JR, Amaro E Jr, J Alzheimers Dis 2010 19 1263 1272 20061613
65. Feature selection and performance evaluation of support vector machine (SVM)-based classifier for differentiating benign and malignant pulmonary nodules by computed tomography. Zhu Y, Tan Y, Hua Y, Wang M, Zhang G, Zhang J, J Digit Imaging 2010 23 51 65 10.1007/s10278-009-9185-9 19242759
66. Comparing performances of logistic regression and neural networks for predicting melatonin excretion patterns in the rat exposed to ELF magnetic fields. Jahandideh S, Abdolmaleki P, Movahedi MM, Bioelectromagnetics 2010 31 164 171 19771546
67. Novel application of a statistical technique, Random Forests, in a bacterial source tracking study. Smith A, Sterba-Boatwright B, Mott J, Water Res 2010 44 4067 4076 10.1016/j.watres.2010.05.019 20566209
68. Are random forests better than support vector machines for microarray-based cancer classification? Statnikov A, Aliferis CF, AMIA Annu Symp Proc 2007 686 690
69. Classification and regression tree analysis in public health: Methodological review and comparison with logistic regression. Lemon SC, Roy J, Clark MA, Friedmann PD, Rakowski W, Annals of Behavioral Medicine 2003 26 172 181 10.1207/S15324796ABM2603-02 14644693 (Pubitemid 38001837)
70. A review of evidence of health benefit from artificial neural networks in medical intervention. Lisboa PJ, Neural Networks 2002 15 11 39 10.1016/S0893-6080(01)00111-3 11958484 (Pubitemid 34234792)
71. Michie D, Spiegelhalter DJ, Taylor CC, Machine learning, neural and statistical classification New York: Ellis Horwood 1994
72. A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms. Lim T-S, Loh W-Y, Shih Y-S, Machine Learning 2000 40 203 228 10.1023/A:1007608224229
73. A note on comparing classifiers. Duin RPW, Pattern Recognition Letters 1996 17 529 536 10.1016/0167-8655(95)00113-1 (Pubitemid 126380803)