Variable and threshold selection to control predictive accuracy in logistic regression

Journal of the Royal Statistical Society. Series C: Applied Statistics

Volumn 63, Issue 4, 2014, Pages 657-672

  Kuk, Anthony Y C ^a   Li, Jialiang ^a,b   John Rush, A ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b DUKE NUS MEDICAL SCHOOL   (Singapore)

Author keywords

Antidepression trials; Cross validation; Indeterminate class; Logistic regression; Model selection; Negative predictive value; Positive predictive value

Indexed keywords

EID: 84905029267     PISSN: 00359254     EISSN: 14679876     Source Type: Journal    
DOI: 10.1111/rssc.12058     Document Type: Article

References (25)

1. DeLong, E. R., DeLong, D. M. and Clarke-Pearson, D. L. (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44, 837-845.
2. Fava, M., Rush, A. J., Alpert, J. E., Balasubramani, G. K., Wisniewski, S. R., Carmin, C. N., Biggs, M. M., Zisook, S., Leuchter, A., Howland, R., Warden, D. and Trivedi, M. H. (2008) Difference in treatment outcome in outpatients with anxious versus nonaxious depression: a STAR*D report. Am. J. Psychiatr., 165, 342-351.
3. Fava, M., Rush, A. J., Trivedi, M. H., Nierenberg, A. A., Thase, M. E., Sackheim, H. A., Quitkin, F. M., Wisniewski, S., Lavori, P. W., Rosenbaum, J. F. and Kupfer, D. J. (2003) Background and rationale for the sequenced treatment alternatives to relieve depression (STAR*D) study. Psychiatr. Clin. Nth Am., 26, 457-494.
4. Friedman, J., Hastie, T. and Tibshirani, R. (2010) Regularization paths for generalized linear models via coordinate descent. J. Statist. Softwr., 33, 1-22.
5. Hajek, J. and Sidak, Z. (1967) Theory of Rank Tests. New York: Academic Press.
6. Huang, Y., Fong, Y., Wei, J. and Feng, Z. (2011) Borrowing information across populations in estimating positive and negative predictive values. Appl. Statist., 60, 633-653.
7. Huang, Y. and Pepe, M. S. (2009) Semiparametric methods for evaluating risk prediction markers in case-control studies. Biometrika, 96, 991-997.
8. Huang, Y., Pepe, M. S. and Feng, Z. (2007) Evaluating the predictiveness of a continuous marker. Biometrics, 63, 1181-1188.
9. Kuk, A. Y. C., Li, J. and Rush, J. A. (2010) Recursive subsetting to identify patients in the STAR*D: a method to enhance the accuracy of early prediction of treatment outcome and to inform personalized care. J. Clin. Psychiatr., 71, 1502-1508.
10. Mercaldo, N. D., Lau, K. F. and Zhou, X. H. (2007) Confidence intervals for predictive values with an emphasis to case-control study. Statist. Med., 26, 2170-2183.
11. Moskowitz, C. S. and Pepe, M. S. (2004) Quantifying and comparing the predictive accuracy of continuous prognostic factors for binary outcomes. Biostatistics, 5, 113-127.
12. Pfeiffer, R. M. and Gail, M. H. (2011) Two criteria for evaluating risk prediction models. Biometrics, 67, 1057-1065.
13. Prentice, R. L. and Pyke, R. (1979) Logistic disease incidence models and case-control studies. Biometrika, 66, 403-411.
14. van der Putten, P., de Ruiter, M. and van Someren, M. (2000) CoIL Challenge 2000 tasks and results: predicting and explaining caravan policy ownership. In CoIL Challenge 2000: the Insurance Company Case(eds P. van der Putten and M. van Someren ). Amsterdam: Sentient Machine Research.
15. Ripley, B. (2011) tree: classification and regression trees. R Package Version 1.0-29. (Available from http://CRAN.R-project.org/package=tree.)
16. Rush, A. J., Bernstein, I. H., Trivedi, M. H., Carmody, T. J., Wisniewski, S., Mundt, J. C., Shores-Wilson, K., Biggs, M. M., Woo, A., Nierenberg, A. A. and Fava, M. (2006) An evaluation of the Quick Inventory of Depressive Symptomatology and the Hamilton Rating Scale for Depression: a STAR*D report. Biol. Psychiatr., 59, 493-501.
17. Rush, A. J., Fava, M., Wisniewski, S. R., Lavori, P. W., Trivedi, M. H., Sackheim, H. A., Thase, M. E., Nierenberg, A. A., Quitkin, F. M., Kashner, T. M., Kupfer, D. J., Rosenbaum, J. F., Alpert, J., Stewart, J. W., McGrath, P. J., Biggs, M. M., Shores-Wilson, K., Lebowitz, B. D., Ritz, L., Niederehe, G. and STAR*D Investigators Group (2004) Sequenced treatment alternatives to relieve depression (STAR*D): rationale and design. Contr. Clin. Trials, 25, 119-142.
18. Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., Thase, M. E., Kocsis, J. H. and Keller, M. B. (2003) The 16-item Quick Inventory of Depressive Symptomatology (QIDS) Clinician Rating (QIDS-C) and Self-Report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol. Psychiatr., 54, 573-583.
19. Steinberg, D. M., Fine, J. and Chapell, R. (2008) Sample size for positive and negative predictive values in diagnostic research. Biostatistics, 10, 94-105.
20. Stone, M. (1977) An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. J. R. Statist. Soc. B, 39, 44-47.
21. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267-288.
22. Trivedi, M. H., Rush, A. J., Ibrahim, H. M., Carmody, T. J., Biggs, M. M., Suppes T., Crismon, M. L., Shores-Wilson, K., Toprac, M. G., Dennehy, E. B., Witte, B. and Kashner, T. M. (2004) The Inventory of Depressive Symptomatology, Clinician Rating (IDS-C) and Self-Report (IDS-SR), and the Quick Inventory of Depressive Symptomatology, Clinician Rating (QIDS-C) and Self-Report (QIDS-SR) in public sector patients with mood disorders, a psychometric evaluation. Psychol. Med., 34, 73-82.
23. Wieand, S., Gail, M. H., James, B. R. and James, K. L. (1989) A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data. Biometrika, 76, 585-592.
24. Wood, S. N. (2006) Generalized Additive Models: an Introduction with R. Boca Raton: Chapman and Hall-CRC.
25. Zou, H. and Hastie, T. (2005) Regularization and variable selection via the elastic net. J. R. Statist. Soc. B, 67, 301-320.