When forensic examiners disagree: Bias, or just inaccuracy?

Psychology, Public Policy, and Law

Volumn 19, Issue 1, 2013, Pages 40-55

  Mossman, Douglas ^a  

^a UNIVERSITY OF CINCINNATI COLLEGE OF MEDICINE   (United States)

Author keywords

Bias; Competence to stand trial; Diagnostic accuracy; Expert opinion; Receiver operating characteristic

Indexed keywords

EID: 84883495405     PISSN: 10768971     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029242     Document Type: Article

References (45)

1. Albert, P. S. (2007). Random effects modeling approaches for estimating ROC curves from repeated ordinal tests without a gold standard. Biometrics, 63, 593-602. doi:10.1111/j.1541-0420.2006.00712.x
2. Audi, R. (2004). Perception and consciousness. In I. Niiniluoto, M. Sintonen, & J. Wolenski, Eds.). Handbook of epistemology (pp. 57-108). Dordrecht, the Netherlands: Kluwer Academic Publishers.
3. Audi, R. (2010). Epistemology: A contemporary introduction to the theory of knowledge (3rd ed.). New York, NY: Taylor & Francis.
4. Bolstad, W. M. (2007). Introduction to Bayesian statistics (2nd ed.). Hoboken, NJ: Wiley. doi:10.1002/9780470181188
5. Buchanan, A. (2006). Competency to stand trial and the seriousness of the charge. Journal of the American Academy of Psychiatry and the Law, 34, 458-465.
6. Buchanan, A. (2008). Commentary: Facts and values in competency assessment. Journal of the American Academy of Psychiatry and the Law, 36, 352-353.
7. Cochrane, R. E., Grisso, T., & Frederick, R. I. (2001). The relationship between criminal charges, diagnoses, and psycholegal opinions among federal pretrial defendants. Behavioral Sciences & the Law, 19, 565-582. doi:10.1002/bsl.454
8. Cooper, V. G., & Zapf, P. A. (2003). Predictor variables in competency to stand trial decisions. Law and Human Behavior, 27, 423-436. doi:10.1023/A:1024089117535
9. Dusky v. United States, 362 U.S. 402 (1960).
10. Gelfand, A. E., & Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 389-409.
11. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741. doi:10.1109/TPAMI.1984.4767596
12. Golding, S. L., Roesch, R.,&Schreiber, J. (1984). Assessment and conceptualization of competency to stand trial: Preliminary data on the Interdisciplinary Fitness Interview. Law and Human Behavior, 8, 321-334.doi:10.1007/BF01044699
13. Goldstein, R. L.,&Stone, M. (1977). When doctors disagree: Differing views on competency. Bulletin of the American Academy of Psychiatry and the Law, 8, 90-97.
14. Gowensmith, W. N., Murrie, D. C.,&Boccaccini, M. T. (2012). Field reliability of competence to stand trial opinions: How often do evaluators agree, and what do judges decide when evaluators disagree? Law and Human Behavior, 36, 130-139. doi:10.1037/h0093958
15. Gruszauskas, N. P., Drukker, K., Giger, M. L., Chang, R. F., Sennett, C. A., Moon, W. K.,&Pesce, L. L. (2009). Breast US computer-aided diagnosis system: Robustness across urban populations in South Korea and the United States. Radiology, 253, 661-671. doi:10.1148/radiol. 2533090280
16. Gwet, K. L. (2008). Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology, 61, 29-48. doi:10.1348/000711006X126600
17. Hanley, J. E. (1988). The robustness of the "binormal" assumptions used in fitting ROC curves. Medical Decision Making, 8, 197-203. doi:10.1177/0272989X8800800308
18. Heilbrun, K. (2009). Evaluation for risk of violence in adults. New York, NY: Oxford University Press.
19. Hubbard, D. W. (2007). How to measure anything: Finding the value of intangibles in business. Hoboken, NJ: John Wiley & Sons, Inc.
20. Kahneman, D. (2011). Thinking, fast and slow. New York, NY: Farrar, Straus, and Giroux.
21. Kim, S. Y., Hwang, Y. J., Han, Y. H., Seo, J. W., Lee, J. Y., Kim, Y. H.,..Lee, S. S. (2007). An ROC study of chest radiographs: 2K Versus 4K high-resolution soft-copy images. Journal of Digital Imaging, 20, 347-351. doi:10.1007/s10278-006-1048-z
22. Lexcen, F. J., Hawk, G. L., Harrick, S.,&Blank, M. B. (2006). Use of video conferencing for psychiatric and forensic evaluations. Psychiatric Services, 57, 713-715. doi:10.1176/appi.ps.57.5.713
23. Lunn, D., Spiegelhalter, D., Thomas, A.,&Best, N. (2009). The BUGS project: Evolution, critique and future directions. Statistics in Medicine, 28, 3049-3067. doi:10.1002/sim.3680
24. Marcus, D. K., Poythress, N. G., Edens, J. F.,&Lilienfeld, S. O. (2010). Adjudicative competence: Evidence that impairment in "rational understanding" is taxonic. Psychological Assessment, 22, 716-722. doi: 10.1037/a0020131
25. Melton, G. B., Petrila, J., Poythress, N. G.,&Slobogin, C. (2007). Psychological evaluations for the courts: A handbook for mental health professionals and lawyers (3rd ed.). New York, NY: The Guilford Press.
26. Merris, R. (2003). Combinatorics (2nd ed.). Hoboken, NJ: John Wiley&Sons. doi:10.1002/0471449687
27. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A.,&Teller, E. (1953). Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1091. doi:10.1063/1.1699114
28. Mossman, D.,&Berger, J. O. (2001). Intervals for posttest probabilities: A comparison of 5 methods. Medical Decision Making, 21, 498-507.
29. Mossman, D., Bowen, M. D., Vanness, D. J., Bienenfeld, D., Correll, T., Kay, J.,..Lehrer, D. S. (2010). Quantifying the accuracy of forensic examiners in the absence of a "gold standard." Law and Human Behavior, 34, 402-417. doi:10.1007/s10979-009-9197-5
30. Mossman, D. (1994). Assessing predictions of violence: Being accurate about accuracy. Journal of Consulting and Clinical Psychology, 62, 783-792. doi:10.1037/0022-006X.62.4.783
31. Mossman, D. (2008). Conceptualizing and characterizing accuracy in assessments of competence to stand trial. Journal of the American Academy of Psychiatry and the Law, 36, 340-351.
32. Murrie, D. C., Boccaccini, M., Zapf, P. A., Warren, J. I.,&Henderson, C. E. (2008). Clinician variation in findings of competence to stand trial. Psychology, Public Policy, and Law, 14, 177-193. doi:10.1037/a0013578
33. Murrie, D. C., Boccaccini, M. T., Turner, D., Meeks, M., Woods, C.,&Tussey, C. (2009). Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation? Psychology, Public Policy, and Law, 15, 19-53. doi:10.1037/a0014897
34. Nicholson, R. A., & Kugler, K. E. (1991). Competent and incompetent criminal defendants: A quantitative review of comparative research. Psychological Bulletin, 109, 355-370. doi:10.1037/0033-2909.109.3.355
35. Otto, R. K., & Douglas, K. S. (Eds.) (2009). Handbook of violence risk assessment. New York, NY: Routledge and Taylor&Francis Group.
36. Poythress, N. G., Nicholson, R. A., Otto, R. K., Edens, J. F., Bonnie, R. J., Monahan, J.,&Hoge, S. K. (1999). The MacArthur Competence Assessment Tool-Criminal Adjudication (MacCAT-CA) professional manual. Odessa, FL: PAR.
37. Poythress, N. G., & Stock, H. V. (1980). Competency to stand trial: A historical review and some new data. Psychiatry and Law, 8, 131-146.
38. Qu, Y., Tan, M., & Kutner, M. H. (1996). Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics, 52, 797-810. doi:10.2307/2533043
39. Rice, M. E., & Harris, G. T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen's d and r. Law and Human Behavior, 29, 615-620. doi:10.1007/s10979-005-6832-7
40. Roesch, R., & Golding, S. L. (1980). Competency to stand trial. Urbana, IL: University of Illinois Press.
41. Rogers, R., Jackson, R. L., Sewell, K. W.,&Harrison, K. S. (2004). An examination of the ECST-R as a screen for feigned incompetency to stand trial. Psychological Assessment, 16, 139-145. doi:10.1037/1040-3590.16.2.139
42. Skeem, J. L., Golding, S., Cohn, N.,&Berge, G. (1998). The logic and reliability of expert opinion on competence to stand trial. Law and Human Behavior, 22, 519-547. doi:10.1023/A:1025787429972
43. Somoza, E.,&Mossman, D. (1992). Comparing and optimizing diagnostic tests: An information-theoretical approach. Medical Decision Making, 12, 179-188. doi:10.1177/0272989X9201200303
44. Warren, J. I., Murrie, D. C., Stejskal, W., Collwell, L. H., Morris, J., Chauhan, P.,&Deitz, P. (2006). Opinion formation in evaluation of competence to stand trial: Results from 8,146 evaluations. Behavioral Sciences and the Law, 24, 113-132. doi:10.1002/bsl.699
45. Zapf, P. A., & Roesch, R. (2006). Competency to stand trial: A guide for evaluators. In A. K. Hess & I. B. Weiner (Eds.), Handbook of forensic psychology (3rd ed., pp. 305-331). New York, NY: Wiley.