Model validation software for classification models using repeated partitioning: MVREP

Computer Methods and Programs in Biomedicine

Volumn 72, Issue 1, 2003, Pages 81-87

  Li, Wei ^a   Arena, Vincent C ^a   Sussman, Nancy B ^b   Mazumdar, Sati ^a  

^a UNIVERSITY OF PITTSBURGH GRADUATE SCHOOL OF PUBLIC HEALTH   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Classification models; Model validation; Prediction error; Repartitioning

Indexed keywords

COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA REDUCTION; MATHEMATICAL MODELS;

SAMPLING DISTRIBUTIONS;

COMPUTER SOFTWARE;

ARTICLE; CLASSIFICATION; COMPUTER PROGRAM; DISEASE MODEL; MODEL; PREDICTION; STRUCTURE ACTIVITY RELATION; TOXICITY; VALIDATION PROCESS;

ANIMALS; CLASSIFICATION; COMPUTER SIMULATION; HUMANS; LOGISTIC MODELS; MICE; RISK ASSESSMENT; SOFTWARE; TOXICOLOGY;

EID: 0038162183     PISSN: 01692607     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0169-2607(02)00119-0     Document Type: Article

References (21)

1. H.G. Claycamp, N.B. Sussman, O.T. Macina, H.S. Rosenkranz, Artificial networks as statistical tools in SAR/QSAR modeling, in Papers from the 1999 AAAI Spring Symposium, Technical Report SS-99-01, AAAI Press, Menlo Park CA, 1999.
2. N.B. Sussman, S. Yu, V.C. Arena, S. Mazumdar, B.P. Thampatty, Decision tree (CART) SAR models for developmental toxicity based on the FDA/TERIS database, in Proceedings of the Second International ICSC Symposium on Advances in Intelligent Data Analysis, Wales, UK, June 19-22, 2001.
3. S. Mazumdar, V.C. Arena, W. Li, N.B. Sussman, K.S. Chiang, S. Yu, Hierarchical model for toxicological risk assessment. To appear in Proceedings of 2001 Joint Statistical Meetings, Atlanta, GA, August 5-9, 2001.
4. Breiman L. Bagging predictors. Mach. Learning. 24:1996;123-140.
5. W. DuMouchel, Hierarchical Bayes linear models for meta-analysis, Technical Report 27, National Institute of Statistical Sciences, 1994.
6. Breiman L., Friedman J., Olshen R., Stone C. Classification and Regression Trees. 1984;CRC Press.
7. Bishop C.M. Neural Networks for Pattern Recognition. 1995;Clarendon Press, Oxford, England.
8. p. Technometrics. 15:1973;661-675.
9. H. Akaike, Information theory and an extension of the maximum likelihood principle, in Second International Symposium on Information Theory, Akademiai Kiado, Budapest, 1973, pp. 267-281.
10. Schwartz G. Estimating the dimension of a model. Ann. Stat. 6:1978;461-464.
11. Efron B., Tibshirani R. An Introduction to the Bootstrap, Sec. 17.4. 1993;Chapman & Hall, New York.
12. Stone M. Cross-validation choice and assessment of statistical predictions. J. R. Stat. Soc. B. 36:1974;111-147.
13. Stone M. An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. J. R. Stat. Soc. B. 39:1977;44-47.
14. Allen D.M. The relationship between variable selection and data augmentation and a model of prediction. Technometrics. 16:1974;125-127.
15. Geisser S. The predictive sample reuse method with applications. J. Am. Stat. Assoc. 70:1975;320-328.
16. Efron B. Estimating the error rate of a prediction rule: some improvement on cross-validation. J. Am. Stat. Assoc. 78:1983;316-331.
17. Efron B., Tibshirani R. Improvement on cross-validation: the 0.632 bootstrap method. J. Am. Stat. Assoc. 92:1997;548-560.
18. V.C. Arena, N.B. Sussman, K.S. Chiang, S. Mazumdar, O.T. Macina, W. Li, Structure-activity relationships using bagging, Technical Report - Methods 34, University of Pittsburgh, Department of Biostatistics, 2000.
19. SAS, version 8, SAS Institute Inc., Cary NC, 2001.
20. Chernoff N., Kavlock R.J. An in vivo teratology screen utilizing pregnant mice. J. Toxicol. Environ. Health. 10:1982;541-550.
21. Molecular Modeling Pro, version 3, ChemSW, Fairfield CT, 1996.