The Receiver-Operating Characteristic (ROC) analysis: Fundamentals and applications in clinical psychology

Journal of Cognitive and Behavioral Psychotherapies

Volumn 9, Issue 1, 2009, Pages 49-66

  Pintea, Sebastian ^a   Moldovan, Ramona ^a  

^a BABE BOLYAI UNIVERSITY   (Romania)

Author keywords

Area under the curve (AUC); Clinical psychology; Depression; Diagnostic performance; Receiver Operating Characteristics (ROC); ROC analysis; Sensitivity; Specificity

Indexed keywords

EID: 65549162609     PISSN: 15847101     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders (4th edition, text revision). Washington, DC: APA.
2. Avenevoli, S., Knight, E., Kessler, R. C., & Merikangas, K. R. (2008). Epidemiology of depression in children and adolescents. In Abela, J.R.Z., & Hankin, B.L. (Eds.). Handbook of depression in children and adolescents. New York: The Guilford Press.
3. Ballesteros, J., Bobes, J., Bulbena, A., Luque, A., Dal-Re, R., Ibarra, N., & Guemes, I. (2007). Sensitivity to change, discriminative performance, and cutoff criteria to define remission for embedded short scales of the Hamilton depression rating scale (HAMD). Journal of Affective Disorders, 102, 93-99.
4. Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York: Guilford Press.
5. Benazzi, F. (2008). Defining mixed depression. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 32, 932-939.
6. Brown, C. D., & Davis, H. T. (2006). Receiver operating characteristics curves and related decision measures: A tutorial. Chemometrics and Intelligent Systems, 80, 24-38.
7. Chiu, Y. C., Li, C. L., Lin, K. N., Chiu, Y. F., Liu, & H. C. (2008). Sensitivity and specificity of the clock drawing test, incorporating Rouleau scoring system, as a screening instrument for questionable and mild dementia: Scale development. International Journal of Nursing Studies, 45, 75-84.
8. Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgment. Science, 243, 1668-1674.
9. Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27, 861-874.
10. Giaquinto, S., & Parnetti, L. (2006). Early detection of dementia in clinical practice. Mechanisms of Ageing and Development, 127, 123-128.
11. Hien, D., Matzner, F., First, M.B., Spitzer, R.L., Williams, J.B.W., and Gibbon, M. (1994, 1998, 2004). Interviu clinic structurat pentru tulburǎrile clinice ale sugarului, copilului şi adolescentului. Adaptare în limba românǎ David, D. (coordonator). Editura RTS Cluj-Napoca.
12. Horwitz, J. E., Lynch, J. K., McCaffrey, R. J., & Fisher, J. M. (2008). Screening for neuropsychological impairment using Reitan and Wolfson's preliminary neuropsychological test battery. Archive of Clinical Neuropsychology, 23, 393-398.
13. Ivarsson, T., & Larsson, B. (2008). The Obsessive-Compulsive Symptom (OCS) scale of the Child Behavior Checklist: A comparison between Swedish children with Obsessive-Compulsive Disorder from a specialized unit, regular outpatients and a school sample. Journal of Anxiety Disorders, in-press
14. Jokinen, J., Nordstrom, A. L., & Nordstrom, P. (2008). ROC analysis of dexamethasone suppression test threshold in suicide prediction after attempted suicide. Journal of Affective Disorders, 106, 145-152.
15. Kendler, K. S. (1995). Genetic epidemiology in psychiatry. Taking both genes and environment seriously. Archives of General Psychiatry, 52, 895-899.
16. Kills Small, N. J., Simons, J. S., & Stricherz, M. (2007). Assessing criterion validity of the Simple Screening Instrument for Alcohol and Other Drug Abuse (SSI-AOD) in a college population. Addictive Behaviors, 32, 2425-2431.
17. Lèowe, B., Spitzer, R. L., Grèafe, K., Kroenke, K., Quenter, A., & Zipfel, S. (2004). Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians diagnoses. Journal of Affective Disorders, 78, 131-140.
18. McFall, R. M., & Treat, T. A. (1999). Quantifying the information value of clinical assesement with Signal Detection Theory. Annual Review of Psychology, 50, 215-241
19. Netemeyer, R. G., Williamson, D. A., Burton, S., Biswas, D., Jindal, S., Landreth, S., Mills, G., & Primeaux, S. (2002). Psychometric properties of shortened versions of the Automatic Thoughts Questionnaire. Educational and Psychological Measurement, 62, 111-129.
20. O'Brien, A., Gaudino-Goering, E., Shawaryn, M., Komaroff, E., Moore, N. B., & DeLuca, J. (2007). Relationship of the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) to functional, emotional, and neuropsychological outcomes. Archives of Clinical Neuropsychology, 22, 933-948.
21. Ong, J. C., Kuo, T. F., & Manber, R. (2008). Who is at risk for dropout from group cognitive-behavior therapy for insomnia? Journal of Psychosomatic Research, 64, 419-425.
22. Parker, G., Fletcher, K., Barrett, M., Synnott, H., Breakspear, M., Hyett, M., & Hadzi-Pavlovic, D. (2008). Screening for bipolar disorder: The utility and comparative properties of the MSS and MDQ measures. Journal of Affective disorders, 109, 83-89.
23. Serrano-Duenas, M., & Serrano, M S. (2008). Concurrent validation of the 21-item and 6-item Hamilton Depression Rating Scale versus the DSM-IV diagnostic criteria to assess depression in patients with Parkinson's disease: An exploratory analysis. Parkinsonism and Related Disorders, 14, 233-238.
24. Shapiro, E. S., Solari, E., & Petscher, Y. (2008). Use of a measure of reading comprehension to enhance prediction on the state high stakes assessment. Learning and Individual Differences, In Press, Uncorrected Proof, Available online 26 Match 2008
25. Sharifi, F., Mousavinasab, N., Mazloomzadeh, S., Jaberi, Y., Saeini, M., Dinmohammadi, M., & Angomshoaa, A. (2008). Cutoff point of waist circumference for the diagnisis of metabolic syndrome in an Iranian population. Obesity Research & Clinical Practice, In Press, Corrected Proof, Available online 23 May 2008
26. Stafford, L., Berk, M., Jackson, H. J. (2007). Validity of the Hospital Anxiety and Depression Scale and Patient Health Questionnaire-9 to screen for depression in patients with coronary artery disease. General Hospital Psychiatry, 29, 417-424.
27. Stephan, C., Wesseling, S., Schink, T., & Jung, K. (2003). Comparison of Eight Computer Programs for Receiver-Operating Characteristic Analysis. Clinical Chemistry, 49, 433-439.
28. Streiner, D. L., Cairney, J. (2007). What's under the ROC? An introduction to Receiver Operating Characteristics Curves. The Canadian Journal of Psychiatry, 52, 121-128.
29. Walsh, T. L., Homa, K., Hanscom, B., Lourie, J., Sepulveda, M. G., & Abdu, W. (2006). Screening for depressive symptoms in patients with chronic spinal pain using the SF-36 Health Survey. The Spine Journal, 6, 316-320.
30. Westin, L. (2001). Receiver operating characteristic (ROC) analysis: Evaluating discriminance effects among decision support systems, retreived 05.16.2008 from source http://www.cs.umu.se/research/reports/ 2001/018/part1.pdf.