A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC

Journal of Pediatric Psychology

Volumn 39, Issue 2, 2014, Pages 204-221

  Youngstrom, Eric A ^a,b  

^a The University of North Carolina at Chapel Hill   (United States)

^b UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

Author keywords

diagnostic efficiency; evidence based medicine; receiver operating characteristic analysis; sensitivity and specificity

Indexed keywords

CHECKLIST; CHILD; CHILD PSYCHOLOGY; HUMAN; MOOD DISORDERS; PARENT; PROCEDURES; PSYCHOLOGICAL RATING SCALE; RECEIVER OPERATING CHARACTERISTIC; STATISTICAL ANALYSIS;

CHECKLIST; CHILD; DATA INTERPRETATION, STATISTICAL; HUMANS; MOOD DISORDERS; PARENTS; PSYCHIATRIC STATUS RATING SCALES; PSYCHOLOGY, CHILD; ROC CURVE;

EID: 84897784657     PISSN: 01468693     EISSN: 1465735X     Source Type: Journal    
DOI: 10.1093/jpepsy/jst062     Document Type: Article

References (34)

1. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington, VT: University of Vermont.
2. Barrera, M., & Garrison-Jones, C. V. (1988). Properties of the Beck Depression Inventory as a screening instrument for adolescent depression. Journal of Abnormal Child Psychology, 16, 263-273.
3. Bayes, T., & Price, R. (1763). An Essay Towards Solving a Problem in the Doctrine of Chance. By the late Rev. Mr. Bayes, communicated by Mr. Price, in a letter to John Canton, M. A. and F. R. S. Philosophical Transactions of the Royal Society of London, 53, 370-418.
4. Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M.,.. de Vet, H. C. W. (2003). Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. British Medical Journal, 326, 41-44.
5. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
7. Cyranowski, J. M., Frank, E., Young, E., & Shear, K. (2000). Adolescent onset of the gender difference in lifetime rates of major depression. Archives of General Psychiatry, 57, 21-27.
8. DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988). Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics, 44, 837-845.
9. Ferdinand, R. F. (2008). Validity of the CBCL/YSR DSM-IV scales Anxiety Problems and Affective Problems. Journal of Anxiety Disorders, 22, 126-134.
10. Gigerenzer, G., & Hoffrage, U. (1995). How to improve Bayesian reasoning without instruction: Frequency formats. Psychological Review, 102, 684-704.
11. Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148, 839-843.
12. Hasselbad, V., & Hedges, L. V. (1995). Meta-analysis of screening and diagnostic tests. Psychological Bulletin, 117, 167-178. doi:10.1037/0033-2909. 117.1.167
13. Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression (2nd ed.). New York, NY: Wiley.
14. Jenkins, M. M., Youngstrom, E. A., Washburn, J. J., & Youngstrom, J. K. (2011). Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Professional Psychology: Research and Practice, 42, 121-129. doi:10.1037/a0022506
15. Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P.,.. Ryan, N. (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36, 980-988.
16. Kraemer, H. C. (1992). Evaluating medical tests: Objective and quantitative guidelines. Newbury Park, CA: Sage.
17. Kruschke, J. K. (2011). Doing Bayesian data analysis: A tutorial with R and BUGS. New York, NY: Academic Press.
18. Lengua, L. J., Sadowski, C. A., Friedrich, W. N., & Fisher, J. (2001). Rationally and empirically derived dimensions of children's symptomatology: Expert ratings and confirmatory factor analyses of the CBCL. Journal of Consulting and Clinical Psychology, 69, 683-698.
19. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA: Sage Publications.
20. McFall, R. M., & Treat, T. A. (1999). Quantifying the information value of clinical assessment with signal detection theory. Annual Review of Psychology, 50, 215-241. doi:10.1146/annurev.psych.50.1.215
21. Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota Press.
22. Pepe, M. S. (2003). The statistical evaluation of medical tests for classification and prediction. New York, NY: Wiley.
23. Pulleyblank, R., Chuma, J., Gilbody, S. M., & Thompson, C. (2013). Decision curve analysis for assessing the usefulness of tests for making decisions to treat: An application to tests for prodromal psychosis. Psychological Assessment. doi:10.1037/a0032394
24. Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., & Muller, M. (2011). pROC: An open-source package for R and Sθ to analyze and compare ROC curves. BMC Bioinformatics, 12, 77. doi:10.1186/1471- 2105-12-77
25. Steer, R. A., Cavalieri, T. A., Leonard, D. M., & Beck, A. T. (1999). Use of the Beck Depression Inventory for primary care to screen for major depression disorders. General Hospital Psychiatry, 21, 106-111.
26. Straus, S. E., Glasziou, P., Richardson, W. S., & Haynes, R. B. (2011). Evidence-based medicine: How to practice and teach EBM (4th ed.). New York, NY: Churchill Livingstone.
27. Swets, J. A., Dawes, R. M., & Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1, 1-26.
28. Tillman, R., & Geller, B. (2005). A brief screening tool for a prepubertal and early adolescent bipolar disorder phenotype. American Journal of Psychiatry, 162, 1214-1216.
29. Warnick, E. M., Bracken, M. B., & Kasl, S. (2008). Screening efficiency of the child behavior checklist and strengths and difficulties questionnaire: A systematic review. Child and Adolescent Mental Health, 13, 140-147. doi:10.1111/j.1475-3588.2007.00461.x
30. Whiting, P. F., Rutjes, A. W., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B.,.. Bossuyt, P. M. (2011). QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine, 155, 529-536. doi:10.1059/0003-4819
31. Youngstrom, E. A. (2013). Future directions in psychological assessment: Combining evidence-based medicine innovations with psychology's historical strengths to enhance utility. Journal of Clinical Child & Adolescent Psychology, 42, 139-159. doi:10.1080/15374416.2012.736358
32. Youngstrom, E. A., Meyers, O. I., Demeter, C., Kogos Youngstrom, J., Morello, L., Piiparinen, R.,.. Findling, R. L. (2005). Comparing diagnostic checklists for pediatric bipolar disorder in academic and community mental health settings. Bipolar Disorders, 7, 507-517.
33. Youngstrom, E. A., Meyers, O. I., Youngstrom, J. K., Calabrese, J. R., & Findling, R. L. (2006). Comparing the effects of sampling designs on the diagnostic accuracy of eight promising screening algorithms for pediatric bipolar disorder. Biological Psychiatry, 60, 1013-1019. doi:10.1016/j.biopsych. 2006.06.023
34. Zhou, X.-H., Obuchowski, N. A., & McClish, D. K. (2002). Statistical methods in diagnostic medicine. New York, NY: Wiley.