Confidence and accuracy in assessments of short-term risks presented by forensic psychiatric patients

Journal of Forensic Psychiatry and Psychology

Volumn 21, Issue 1, 2010, Pages 1-22

  Desmarais, Sarah L ^a,c   Nicholls, Tonia L ^a,b,c   Don read, J ^b   Brink, Johann ^a,b,c  

^a BC Mental Health & Addiction Services   (Canada)

^b SIMON FRASER UNIVERSITY   (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Confidence; Forensic psychiatric patients; Predictive validity; START; Structured professional judgment; Violence risk assessment

Indexed keywords

ACCURACY; ARTICLE; AUTOMUTILATION; FEMALE; FORENSIC PSYCHIATRY; HEALTH PERSONNEL ATTITUDE; HUMAN; MAJOR CLINICAL STUDY; MALE; MEDICAL DECISION MAKING; MEDICAL PRACTICE; PRIORITY JOURNAL; PROFESSIONAL COMPETENCE; PROGNOSIS; RISK ASSESSMENT; SUICIDE; VIOLENCE;

EID: 75649152412     PISSN: 14789949     EISSN: 14789957     Source Type: Journal    
DOI: 10.1080/14789940903183932     Document Type: Article

References (59)

1. American Psychological Association Presidential Task Force on Evidence-Based Practice (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285.
2. Arkes, H.R. (1981). Impediments to accurate clinical judgment and possible ways to minimize their impact. Journal of Consulting and Clinical Psychology, 49, 323-330.
3. Arkes, H.R., Christensen, C., Lai, C., & Blumer, C. (1987). Two methods of reducing overconfidence. Organizational Behavior and Human Decision Processes, 39, 133-144.
4. Borum, R. (1996). Improving the clinical practice of violence risk assessment. American Psychologist, 51, 945-956.
5. Brink, J., & Livingston, J. (2004). Testing the utility and acceptance of the STAR. In C.D. Webster, M.-L. Martin, J. Brink, T.L. Nicholls, & C. Middleton (Eds.), Manual for the Short-Term Assessment of Risk and Treatability (START) (Version 1.0, Consultation Edition) (pp. 88-94). Hamilton, Canada: St. Joseph's Healthcare; Coquitlam, Canada: Forensic Psychiatric Services Commission.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Erlbaum.
7. Crocker, A.G., Garcia, A., Israel, M., Hindle, Y., Gagnon, D., Venegas, C., et al. (n.d.). Implementing and using a systematic risk assessment scheme to increase patient safety on a risk management unit for individuals with severe mental illness: A demonstration project. Edmonton, Canada: Canadian Patient Safety Institute. Retrieved December 2, 2008, from http://www.patientsafetyinstitute.ca/ uploadedFiles/Research/Final%20Report(6).pdf.
8. Dawson, N.V., Conners, A.F., Speroof, T., Kemka, A., Shaw, P., & Arkes, H.R. (1993). Homodynamic assessment in managing the critically ill: Is physician confidence warranted? Medical Decision Making, 13, 258-266.
9. Dernevik, M., Falkheim, M., Holmquist, R., & Sandell, R. (2001). Implementing risk assessment procedures in a forensic psychiatric setting: Clinical judgement revisited. In D.P. Farrington, C.R. Hollin, & M. McMurran (Eds.), Sex and violence: The psychology of crime and risk assessment (pp. 83-101). New York: Routledge.
10. Desmarais, S.L., Hucker, S., Brink, J., & De Freitas, K. (2008). A Canadian example of insanity defence reform: Accused found not criminally responsible before and after the Winko decision. International Journal of Forensic Mental Health, 7, 1-14.
11. Desmarais, S.L., Nicholls, T.L., & Brink, J. (2008, July). Psychometric properties of the START in practice: Increasing the ecological validity of risk assessment research. Paper presented at the meetings of the International Association of Forensic Mental Health Services, Vienna, Austria.
12. de Vogel, V., & de Ruiter, C. (2004). Differences between clinicians and researchers in assessing risk of violence in forensic psychiatric patients. The Journal of Forensic Psychiatry & Psychology, 15, 145-164.
13. Douglas, K.S., & Kropp, P.R. (2002). A prevention-based paradigm for violence risk assessment: Clinical and research applications. Criminal Justice and Behavior, 29, 617-658.
14. Douglas, K.S., & Ogloff, J.R.P. (2003). The impact of confidence on the accuracy of structured professional and actuarial violence risk judgments in a sample of forensic psychiatric patients. Law and Human Behavior, 27, 573-587.
15. Douglas, K.S., & Skeem, J.L. (2005). Violence risk assessment: Getting specific about being dynamic. Psychology, Public Policy, and Law, 11, 347-383.
16. Dunning, D., Griffin, D.W., Milojkovic, J.D., & Ross, L. (1990). The overconfidence effect in social prediction. Journal of Personality and Social Psychology, 58, 568-581.
17. Dvoskin, J.A., & Heilbrun, K. (2001). Risk assessment and release decision-making: Toward resolving the great debate. Journal of the American Academy of Psychiatry and the Law, 29, 6-10.
18. Einhorn, H.J., & Hogarth, R.M. (1978). Confidence in judgment: Persistence of the illusion of validity. Psychological Review, 85, 395-416.
19. Elbogen, E.B. (2002). The process of violence risk assessment: A review of descriptive research. Aggression and Violent Behavior, 7, 591-604.
20. Ennis, B.J., & Litwack, T.R. (1974). Psychiatry and the presumption of expertise: Flipping coins in the courtroom. California Law Review, 62, 693-752.
21. Faust, D. (1986). Research on human judgment and its application to clinical practice. Professional Psychology: Research and Practice, 17, 420-430.
22. Faust, D., & Ziskin, J. (1988). The expert witness in psychology and psychiatry. Science, 241, 31-35.
23. Garb, H.N. (1986). The appropriateness of confidence ratings in clinical judgment. Journal of Clinical Psychology, 42, 190-197.
24. Grove, W.M., & Meehl, P.E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law, 2, 293-323.
25. Hanley, J.A., & McNeil, B.J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148, 839-843.
26. Harvey, N. (1997). Confidence in judgement. Trends in Cognitive Sciences, 1, 78-82.
27. Hilton, Z., Harris, G.T., & Rice, M.E. (2006). Sixty-six years of research on the clinical versus actuarial prediction of violence. Counseling Psychologist, 34, 400-409.
28. Hilton, Z., & Simmons, J.L. (2001). The influence of actuarial risk assessment in clinical judgments and tribunal decisions about mentally disordered offenders in maximum security. Law and Human Behavior, 25, 393-408.
29. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 237-251.
30. Kahneman, D., & Tversky, A. (1982). On the study of statistical intuition. Cognition, 11, 123-141.
31. Lichtenstein, S., & Fischhoff, B. (1980). Training for calibration. Organizational Behavior and Human Performance, 26, 149-171.
32. McNeil, B.J., & Hanley, J.A. (1984). Statistical approaches to the analysis of Receiver Operating Characteristic (ROC) curves. Medical Decision Making, 4, 137-150.
33. McNiel, D.E., Sandberg, D.A., & Binder, R.L. (1998). The relationship between confidence and accuracy in clinical assessments of psychiatric patients' potential for violence. Law and Human Behavior, 22, 655-669.
34. Mills, J.F., & Kroner, D.G. (2006). The effect of discordance among violence and general recidivism risk estimates on predictive accuracy. Criminal Behaviour and Mental Health, 16, 155-166.
35. Nicholls, T.L., Brink, J., Desmarais, S.L., Webster, C.D., & Martin, M.-L. (2006). The Short-Term Assessment of Risk and Treatability (START): A prospective validation study in a forensic psychiatric sample. Assessment, 13, 313-327.
36. Nicholls, T.L., Brink, J., Greaves, C., Lussier, P., & Verdun-Jones, S. (2009). Forensic psychiatric inpatients and aggression: An exploration of incidence, prevalence, severity, and interventions by patient gender. International Journal of Law and Psychiatry, 32, 23-30.
37. Nicholls, T.L., Desmarais, S.L., Douglas, K.S., & Kropp, R.K. (2006). Violence risk assessments with perpetrators of intimate partner abuse. In J. Hamel & T.L. Nicholls (Eds.), Family interventions in domestic violence: A handbook of gender-inclusive theory and treatment (pp. 275-301). London: Springer.
38. Nicholls, T.L., Gagnon, N., Crocker, A.G., Brink, J., Desmarais, S.L., & Webster, C. (2007). START Outcomes Scale (SOS). Vancouver, Canada: BC Mental Health & Addiction Services.
39. Nicholls, T.L., Webster, C.D., Brink, J., & Martin, M.-L. (2008). Short-term assessment of risk and treatability. In B. Cutler & P. Zapf (Eds.), Encyclopedia of psychology and law (pp. 744-746). Thousand Oaks, CA: Sage.
40. Nonstad, K., Nesset, M.B., Pedersen, T.W., Kroppan, E., Nottestad, J.A., Almvik, R., et al. (under review). The predictive validity and other properties of the Short Term Assessment of Risk and Treatability (START).
41. Ogloff, J.R.P., & Daffern, M. (2006). The dynamic appraisal of situational aggression: An instrument to assess risk for imminent aggression in psychiatric inpatients. Behavioral Sciences and the Law, 24, 799-813.
42. Pulford, B.D., & Colman, A.M. (1997). Overconfidence: Feedback and item difficulty effects. Personality and Individual Differences, 23, 125-133.
43. Quinsey, V.L., Jones, G.B., Book, A.S., & Barr, K.N. (2006). The dynamic prediction of antisocial behavior among forensic psychiatric patients: A prospective field study. Journal of Interpersonal Violence, 21, 1539-1565.
44. Rabinowitz, J., & Garelik-Wyler, R. (1999). Accuracy and confidence in clinical assessments of psychiatric inpatients risk of violence. International Journal of Law and Psychiatry, 22, 99-106.
45. Rogers, R. (2000). The uncritical acceptance of risk assessment in forensic practice. Law and Human Behavior, 24, 595-605.
46. Ruscio, J. (2000). The role of complex thought in clinical prediction: Social accountability and the need for cognition. Journal of Consulting and Clinical Psychology, 68, 145-154.
47. Silver, J.M., & Yudofsky, S.C. (1991). The overt aggression scale: Overview and guiding principles. Journal of Neuropsychiatry & Clinical Neurosciences, 3, S22-S29.
48. Smith, D., & Agate, J. (2004). Solutions for overconfidence: Evaluation of an instructional module for counsellor trainees. Counsellor Education & Supervision, 44, 31-43.
49. Smith, D., & Dumont, F. (1997). Eliminating overconfidence in psychodiagnosis: Strategies for training and practice. Clinical Psychology: Science and Practice, 4, 335-345.
50. Tolman, A.O., & Rotzien, A.L. (2007). Conducting risk evaluations for future violence: Ethical practice is possible. Professional Psychology: Research and Practice, 38, 71-79.
51. Trafimow, D., & Sniezek, J.A. (1994). Perceived expertise and its effect on confidence. Organizational Behavior & Human Decision Processes, 57, 290-302.
52. Webster, C.D., Douglas, K.S., Eaves, D., & Hart, S.D. (1997). HCR-20: Assessing risk for violence (Version 2). Vancouver, Canada: Mental Health, Law, & Policy Institute, Simon Fraser University.
53. Webster, C.D., Martin, M.-L., Brink, J., Nicholls, T.L., & Desmarais, S.L. (2009). Manual for the Short-Term Assessment of Risk and Treatability (START) (Version 1.1). Coquitlam, Canada: BC Mental Health & Addiction Services; Hamilton, Canada: St. Joseph's Healthcare.
54. Webster, C.D., Martin, M.-L., Brink, J., Nicholls, T.L., & Middleton, C. (2004). Manual for the Short-Term Assessment of Risk and Treatability (START) (Version 1.0, Consultation Edition). Hamilton, Canada: St. Joseph's Healthcare; Coquitlam, Canada: Forensic Psychiatric Services Commission.
55. Webster, C.D., Nicholls, T.L., Martin, M.-L., Desmarais, S.L., & Brink, J. (2006). Short-Term Assessment of Risk and Treatability (START): The case for a new violence risk structured professional judgment scheme. Behavioral Sciences and the Law, 24, 747-766.
56. Wedding, D., & Faust, D. (1989). Clinical judgment and decision making in neuropsychology. Archives of Clinical Neuropsychology, 4, 233-265.
57. Whittemore, K.E. (1999). Releasing the mentally disordered offender: Disposition decisions for individuals found unfit to stand trial and not criminally responsible. Unpublished doctoral dissertation, Simon Fraser University, Burnaby, Canada.
58. Wilson, C.M., Desmarais, S.L., Nicholls, T.L., & Brink, J. (under review). The role of client strengths in assessments of short-term violence risk.
59. Yudofsky, S.C., Silver, J.M., Jackson, W., Endicott, J., & Williams, D. (1986). The Overt Aggression Scale for the objective rating of verbal and physical aggression. American Journal of Psychiatry, 143, 45-49.