A comparison of two-group classification methods

Educational and Psychological Measurement

Volumn 71, Issue 5, 2011, Pages 870-901

  Holden, Jocelyn E ^a   Finch, W Holmes ^a   Kelley, Ken ^b  

^a BALL STATE UNIVERSITY   (United States)

^b UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

boosting; classification analysis; classification and regression trees; discriminant analysis; generalized additive models; logistic regression; mixture discriminant analysis; Monte Carlo simulation study; multivariate adaptive regression splines; neural networks

Indexed keywords

EID: 80053193380     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164411398357     Document Type: Article

References (63)

1. Arabie P.,Hubert L.J.,De Sote G.Clustering and classification.River Edge, NJ: World Scientific; 1996:.
2. Bailly J.S.,Arnaud M.,Puech C.Boosting: A classification method for remote sensing.International Journal of Remote Sensing.2007;7:1687-1710.
3. Baker F.B.Stability of two hierarchical grouping techniques.Case 1: Sensitivity to data errors.Journal of the American Statistical Association.1974;69:440-445.
4. Berk R.A.Statistical learning from a regression perspective.New York: Springer; 2008:.
5. Blashfield R.K.Mixture model tests of cluster analysis: Accuracy of four agglomerative hierarchical methods.Psychological Bulletin.1976;83:377-388.
6. Breckenridge J.M.Validating cluster analysis: Consistent replication and symmetry.Multivariate Behavioral Research.2000;35:261-285.
7. Breiman L.Random forests.Machine Learning.2001;45:5-32.
8. Breiman L.,Friedman J.,Olshen R.A.,Stone C.J.Classification and regression trees.Monterey, CA: Wadsworth & Brooks/Cole; 1984:.
9. Buhlmann P.,Hothorn T.Boosting algorithms: Regularization, prediction and model fitting.Statistical Science.2007;22:477-505.
10. Buhlmann P.,Yu B.Boosting with the L2 loss: Regression and classification.American Statistical Association.2003;98:324-339.
11. Chhikara R.S.,McKeon J.Linear discriminant analysis with misallocation in training samples.Journal of the American Statistical Association.1984;79:899-906.
12. Clayton K.,Blumberg F.,Auld D.P.British Journal of Educational Technology.2010:349-364.
13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed). Hillsdale, NJ: Lawrence Erlbaum.
14. Curram S.P.,Mingers J.Neural networks, decision tree induction and discriminant analysis: An empirical comparison.Journal of the Operational Research Society.1994;45:440-450.
15. deCraen S.,Commandeur J.F.,Frank L.E.,Heiser W.J.Effects of group size and lack of sphericity on the recovery of clusters in k-means cluster analysis.Multivariate Behavioral Research.2006;41:127-145.
16. Dempster A.P.,Laird N.M.,Rubin D.B.Maximum likelihood from incomplete data via the EM algorithm.Journal of the Royal Statistical Society: Series B (Methodological).1977;39:1-38.
17. Do A, Q,Grudnitski G.A neural network analysis of the effect of age on housing values.The Journal of Real Estate Research.1992;8:253-264.
18. Dudoit S.,Fridlyand D.,Speed T.P.Comparison of discrimination methods for the classification of tumors using gene expression data.Journal of the American Statistical Association.2002;97:77-87.
19. Finch H.,Schneider M.K.Misclassification rates for four methods of group classification: Impact of predictor distribution, covariance inequality, effect size, sample size and group.Educational and Psychological Measurement.2006;66:240-257.
20. Finch H.,Schneider M.K.Classification accuracy of neural networks vs.discriminant analysis, logistic regression and classification and regression trees.Three- and five-group cases.Methodology.2007;3:47-57.
21. Freund, Y., & Schapire. R. E. (1997). Experiments with a new boosting algorithm. Machine Learning: Proceedings of the Thirteenth International conference, 1996.
22. Garson G.D.Neural networks: An introductory guide for social scientists.London: Sage; 1998:.
23. Grassi M.,Villani S.,Marinoni A.Classification methods for the identification of "case" in epidemiological diagnosis of asthma.European Journal of Epidemiology.2001;17:19-29.
24. Grayson D.A.Statistical diagnosis and the influence of diagnostic error.Biometrics.1987;43:975-984.
25. Hastie T.,Tibshirani R.,Friedman J.The elements of statistical learning: Data mining, inference, and prediction.New York: Springer; 2001:.
26. Harrell, F. E., & Lee, K. I. (1985). A comparison of the discrimination of discriminant analysis and logistic regression under multivariate normality. In P. K. Sen (Ed.), Biostatistics: Statistics in biomedical, public health and environmental sciences (pp. 333-343). New York, NY: Elsevier Science.
27. Hart A.Using neural networks for classification tasks: Some experiments on datasets and practical advice.Journal of the Operational Research Society.1992;43:215-226.
28. Hastie T.,Tibshirani R.Discriminant analysis by Gaussian mixtures.Journal of the Royal Statistical Society: Series B (Methodological).1996;58:155-176.
29. Holden J.E.,Kelley K.The effects of initially misclassified data on the effectiveness of discriminant function analysis and finite mixture modeling.Educational and Psychological Measurement.2010;70:36-55.
30. Hothorn T.,Hornik K.,Zeileis A.Unbiased recursive partitioning: A conditional inference framework.Journal of Computational and Graphical Statistics.2006;15:651-674.
31. Keogh B.K.Revisiting classification and identification.Learning Disability Quarterly.2005;28:100-102.
32. Krzanowski W.J.The performance of Fisher's linear discriminant function under non-optimal conditions.Technometrics.1976;19:191-200.
33. Kuhnert P.M.,Mengersen K.,Tesar P.Bridging the gap between different statistical approaches: An integrated framework for modeling.International Statistical Review.2003;71:335-368.
34. Lachenbruch P.A.Discriminant analysis when the initial samples are misclassified.Technometrics.1966;8:657-662.
35. Lachenbruch P.A.Discriminant analysis when the initial samples are misclassified II: Non-random misclassification models.Technometrics.1974;16:419-424.
36. Lachenbruch P.A.Note on initial misclassification effects on the quadratic discriminant function.Technometrics.1979;21:129-132.
37. LeBlanc M.,Tibshirani R.Combining estimates on regression and classification.Journal of the American Statistical Association.1996;91:1641-1650.
38. Lee T.,Chiu C.,Chou Y,Lu C.Mining the customer credit using classification and regression tree and multivariate adaptive regression splines.Computational Statistics and Data Analysis.2006;50:1113-1130.
39. Lei P,Koehly L.M.Journal of Experimental Education.2003:25-49.
40. Lillvist A.Observations of social competence of children in need of special support based on traditional disability categories versus a functional approach.Early Child Development and Care.2010;18:1129-1142.
41. Liu D.,Chun Y.The effects of different classification models on error propagation in land cover change detection.International Journal of Remote Sensing.2009;20:5345-5364.
42. Mammarella I.C.,Lucangeli D.,Cornoldi C.Spatial working memory and arithmetic deficits in children with nonverbal learning difficulties.Journal of Learning Disabilities.2010;43:455-468.
43. Marshall D.B.,English D.J.Neural network modeling of risk assessment in child protective services.Psychological Methods.2000;5:102-124.
44. McLachlan G.J.Asymptotic results for discriminant analysis when initial samples are misclassified.Technometrics.1972;14:415-422.
45. Moisen G.G.,Frescino T.S.Comparing five modeling techniques for predicting forest characteristics.Ecological Modeling.2002;157:209-225.
46. Nguyen N.,Cripps A.Predicting housing value: A comparison of multiple regression analysis and artificial neural networks.Journal of Real Estate Research.2001;22:313-336.
47. Preatoni D.G.,Nodari M.,Chirchella R.,Tosi G.,Wauters L.A.,Martinoli A.Identifying bats from time-expanded recordings of search calls: Comparing classification methods.Journal of Wildlife Management.2005;69:1601-1614.
48. Rausch J.R.,Kelley K.A comparison of linear and mixture models for discriminant analysis under nonnormality.Behavior Research Methods.2009;41:85-98.
49. Ripley B.D.Neural networks and related methods for classification.Journal of the Royal Statistical Society: Series B (Methodological).1994;3:409-456.
50. Reibnegger G.,Weiss G.,Werner-Felmayer G.,Judmaier G.,Wachter H.Neural networks as a tool for utilizing laboratory information: Comparison with linear discriminant analysis and with classification and regression trees.Proceedings of the National Academy of Science.1991;88:11426-11430.
51. Russell J.A.A discriminant analysis of the factors associated with the career plans of string music educators.Journal of Research in Music Education.2008;56:204-219.
52. Schumacher M.,Robner R.,Vach W.Neural networks and logistic regression: Part I.Computational Statistics and Data Analysis.1996;21:661-682.
53. Simonoff J.S.Smoothing methods in statistics.New York, NY: Springer; 1996:.
54. Smith A.E.,Mason A.K.Cost estimation predictive modeling: Regression versus neural network.The Engineering Economist.1997;42:137-161.
55. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed). Boston, MA: Pearson and Allyn and Bacon.
56. Tibshirani R.,LeBlanc M.A strategy for binary description and classification.Journal of Computational and Graphical Statistics.1992;1:3-20.
57. Ture M.,Kurt I.,Kurum A.T.,Ozdamar K.Comparing classification techniques for predicting essential hypertension.Expert Systems With Applications.2005;29:583-588.
58. WallerN.G.JonesJ.A.(2009).Correlation weights in multiple regression.Psychometrika, 75, 58-69.Retrieved from http://www.springerlink.com/content/e3572021626270x6/.
59. West P.M.,Brockett P.L.,Golden L.L.A comparative analysis of neural networks and statistical methods for predicting consumer choice.Marketing Science.1997;16:370-391.
60. Williams C.J.,Lee S.S.,Fisher R.A.,Dickerman L.H.A comparison of statistical methods for prenatal screening for down syndrome.Applied Stochastic Models in Business and Industry.1999;15:89-101.
61. Wood S.N.Generalized additive models.New York: Chapman & Hall; 2006:.
62. Yoon Y.,Swales G.,Margavio T.M.A comparison of discriminant analysis versus artificial neural networks.Journal of the Operational Research Society.1993;44:51-60.
63. Zigler E.,Phillips L.Psychiatric diagnosis: A critique.Journal of Abnormal and Social Psychology.1961;63:607-618.