Clinical Decision-Making in Community Children’s Mental Health: Using Innovative Methods to Compare Clinicians With and Without Training in Evidence-Based Treatment

Child and Youth Care Forum

Volumn 44, Issue 1, 2015, Pages 133-157

  Baker Ericzén, Mary J ^a   Jenkins, Melissa M ^b   Park, Soojin ^a   Garland, Ann F ^a,c  

^a RADY CHILDREN'S HOSPITAL   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF SAN DIEGO   (United States)

Author keywords

Behavior disorders; Clinical decision making; Clinician training; Community based services; Evidence based treatment (EBT); Naturalistic decision making (NDM)

Indexed keywords

EID: 84939872911     PISSN: 10531890     EISSN: 15733319     Source Type: Journal    
DOI: 10.1007/s10566-014-9274-x     Document Type: Article

References (79)

1. Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., et al. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist,34(3), 341–382. doi:10.1177/0011000005285875.
2. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (Revised) (4th ed.). Washington, DC: American Psychiatric Association.
3. Anzai, Y. (1991). Learning and use of representations for physics expertise. Towards a general theory of expertise (pp. 64–92).
4. Bakalis, N., Bowman, G., & Porock, D. (2003). Decision making in Greek and English registered nurses in coronary care units. International Journal of Nursing Studies,40(7), 749–760.
5. Baker-Ericzén, M., Hurlburt, M., Brookman-Frazee, L., Jenkins, M., & Hough, R. (2010a). Comparing child, parent and family characteristics in usual care and empirically supported treatment research samples for children with disruptive behavior disorders. Journal of Emotional and Behavioral Disorders,18(2), 82–99. doi:10.1177/1063426609336956.
6. Baker-Ericzén, M., Jenkins, M., & Brookman-Frazee, L. (2010b). Clinician and parent perspectives on parent and family contextual factors that impact community mental health services for children with behavior problems. Child and Youth Care Forum,. doi:10.1007/s10566-010-9111-9.
7. Becker, K. D., & Stirman, S. W. (2011). The science of training in evidence-based treatments in the context of implementation programs: Current status and prospects for the future. Administration and Policy in Mental Health and Mental Health Services Research (1–6).
8. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice,17(1), 1–30.
9. Benner, P., Tanner, C., & Chesla, C. (1992). From beginner to expert: Gaining a differentiated clinical world in critical care nursing. Advances in Nursing Science,14(3), 13–28.
10. Boshuizen, H. P. A., & Schmidt, H. G. (1992). On the role of biomedical knowledge in clinical reasoning by experts, intermediates and novices. Cognitive Science,16, 153–184.
11. Burns, K. (2005). Mental models and normal errors. In H. Montgomery, R. Lipshitz, & B. Brehmer (Eds.), How professionals make decisions (pp. 15–28). Mahwah, NJ: Lawrence Erlbaum Associates.
12. Chapman, G. B., & Sonnenberg, F. A. (2000). Decision making in health care: Theory, psychology, and applications. Cambridge, UK: Cambridge University Press.
13. Chorpita, B. F., Becker, K. D., & Daleiden, E. L. (2007). Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry,46(5), 647–652.
14. Chorpita, B. F., & Daleiden, E. L. (2014). Structuring the collaboration of science and service in pursuit of a shared vision. Journal of Clinical Child and Adolescent Psychology,43, 323–338. doi:10.1080/15374416.2013.828297.
15. Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research,7(1), 5–20.
16. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement,20(1), 37–46.
17. Cohen, M. S., Freeman, J. T., & Thompson, B. B. (1997). Training the naturalistic decision maker. In C. E. Zsambok & G. Klein (Eds.), Naturalistic decision making (pp. 257–268). Mahwah, NJ: Erlbaum.
18. Dawes, R. M. (2006). Experience and validity of clinical judgment: The illusory correlation. Behavioral Sciences and the Law,7(4), 457–467.
19. Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgment. Science,243, 1668–1674.
20. Elliot, T. (2005). Expert decision-making in naturalistic environments: A summary of research. Australia: Defence Science and Technology Organisation, Systems Sciences Laboratory.
21. Elstein, A. S., & Schwarz, A. (2002). Clinical problem solving and diagnostic decision making: Selective review of the cognitive literature. British Medical Journal,324, 729–732.
22. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis, revised edition: Verbal reports as data. Cambridge, MA: Bradford books/MIT Press.
23. Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology,37(1), 215–237.
24. Feltovich, P. J., Spiro, R. J., & Coulson, R. L. (1997). Issues of expert flexibility in contexts characterized by complexity and change. Cambridge, MA: The MIT Press.
25. Fonteyn, M. E., Kuipers, B., & Grobe, S. J. (1993). A description of think aloud method and protocol analysis. Qualitative Health Research,3(4), 430–441. doi:10.1177/104973239300300403.
26. Galanter, C. A., & Patel, V. L. (2005). Medical decision making: A selective review for child psychiatrists and psychologists. Journal of Child Psychology and Psychiatry,46(7), 675–689.
27. Garb, H. N. (1989). Clinical judgment, clinical training, and professional experience. Psychological Bulletin,105(3), 387–396.
28. Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research,37(1–2), 15–26. doi:10.1007/s10488-010-0279-y.
29. Garland, A. F., Hough, R. L., McCabe, K. M., Yeh, M., Wood, P. A., & Aarons, G. A. (2001). Prevalence of psychiatric disorders in youths across five sectors of care. Journal of the American Academy of Child and Adolescent Psychiatry,40(4), 409–418.
30. Glaser, R. E., & Chi, M. T. H. (1988). Overview. In M. T. H. Chi, R. E. Glaser, & M. J. Farr (Eds.), The nature of expertise. Hillsdale, NJ: Lawrence Erlbaum Associates.
31. Grasso, B. C., Rothschild, J. M., Genest, R., & Bates, D. W. (2003). What do we know about medication errors in inpatient psychiatry? Joint Commission Journal on Quality and Patient Safety,29(8), 391–400.
32. Grove, W. M. (2005). Clinical versus statistical prediction: The contribution of Paul E. Meehl. Journal of clinical psychology,61(10), 1233–1244.
33. Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment,12(1), 19–30.
34. Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (1998). Multisystemic treatment of antisocial behaviour in children and adolescents. New York: Guilford Press.
35. Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review,30(4), 448–466. doi:10.1016/j.cpr.2010.02.005.
36. Hogan, M. F. (2003). New freedom commission report: The president’s new freedom commission: recommendations to transform mental health care in America. Psychiatric Services,54(11), 1467.
37. Hutton, R. J. B., & Klein, G. (1999). Expert decision making. Systems Engineering,2, 32–45.
38. Jenkins, M. M. (2012). Cognitive de-biasing and the assessment of pediatric bipolar disorder [Dissertation]. Chapel Hill: Psychology, University of North Carolina at Chapel Hill.
39. Jenkins, M. M., Youngstrom, E. A., Washburn, J., & Youngstom, J. K. (2011). Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Professional Psychology: Research and Practice,18, 121–129. doi:10.1037/a0022506.
40. Jensen, A. L., & Weisz, J. R. (2002). Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnoses for clinic-referred children and adolescents. Journal of Consulting and Clinical Psychology,70(1), 158–168. doi:10.1037/0022-006X.70.1.158.
41. Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist,64(6), 515–526.
42. Klein, G. A. (1993). A recognition-primed decision (RPD) model of rapid decision making. In G. A. Klein, J. Orasanu, R. Calderwood, & C. E. Zsambok (Eds.), Decision making in action: Models and methods (pp. 138–147). Norwood, NJ: Ablex.
43. Klein, G. (1997). Developing expertise in decision making. Thinking and Reasoning,3(4), 337–352.
44. Klein, G. (2008). Naturalistic decision making. Human Factors: The Journal of the Human Factors and Ergonomics Society,50(3), 456–460. doi:10.1518/001872008X288385.
45. Leffler, J. M., Jackson, Y., West, A. E., McCarty, C. A., & Atkins, M. S. (2012). Training in evidence-based practice across the professional continuum. Professional Psychology: Research and Practice. doi:10.1037/a0029241.
46. Lewczyk, C. M., Garland, A. F., Hurlburt, M. S., Gearity, J., & Hough, R. L. (2003). Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. Journal of the American Academy of Child and Adolescent Psychiatry,42(3), 349–356. doi:10.1097/00004583-200303000-00016.
47. Lloyd, F. J., & Reyna, V. F. (2009). Clinical gist and medical education: Connecting the dots. Journal of the American Medical Association,302(12), 1332–1333.
48. Mass, J. (2003). Evidence-based assessment of children with behavioral and emotional disorders. Report of Emotional and Behavioral Disorders in Youth,3, 31–34.
49. McHugh, R. K., Murray, H. W., & Barlow, D. H. (2009). Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: The promise of transdiagnostic interventions. Behaviour Research and Therapy,47(11), 946–953.
50. Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota Press.
51. Meehl, P. E. (1986). Causes and effects of my disturbing little book. Journal of Personality Assessment,50(3), 370–375.
52. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: Sage.
53. Nath, S. B., & Marcus, S. C. (2006). Medical errors in psychiatry. Harvard review of psychiatry,14(4), 204–211.
54. Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
55. Ollendick, T. H., & King, N. J. (2004). Empirically supported treatments for children and adolescents: Advances toward evidence-based practice. In P. M. Barrett & T. H. Ollendick (Eds.), Handbook of interventions that work with children and adolescents: Prevention and treatment (pp. 3–25). West Sussex, England: Wiley.
56. Pappadopulos, E., Jensen, P. S., Schur, S. B., MacIntyre, J. C., I. I., Ketner, S., Van Orden, K., et al. (2002). “Real World” atypical antipsychotic prescribing practices in public child and adolescent inpatient settings. Schizophrenia Bulletin,28(1), 111–121.
57. Patel, V. L., & Arocha, J. F. (2001). The Nature of constraints on collaborative decision making in health care settings. In E. Salas & G. Klein (Eds.), Linking expertise and naturalistic decision making (pp. 383–405). Mahwah, NJ: Lawrence Erlbaum Associates.
58. Patel, V. L., Arocha, J. F., & Kaufman, D. R. (1994). Diagnostic reasoning and medical expertise. The Psychology of Learning and Motivation: Advances in Research and Theory,31, 187–252.
59. Patel, V. L., Arocha, J. F., & Kaufman, D. R. (2001). A primer on aspects of cognition for medical informatics. Journal of the American Medical Informatics Association,8(4), 324–343.
60. Patel, V. L., Kaufman, D. R., & Arocha, J. F. (2002). Emerging paradigms of cognition in medical decision-making. Journal of Biomedical Informatics,35(1), 52–75.
61. Redelmeier, D. A. (2005). The cognitive psychology of missed diagnoses. Annals of Internal Medicine,142(2), 115–120.
62. Sackett, D. L., Rosenberg, W. M. C., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. British Medical Journal,312, 71–72.
63. Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research,38(1), 32–43. doi:10.1007/s10488-010-0321-0.
64. Serfaty, D., MacMillan, J., Entin, E. E., & Entin, E. B. (1997). The decision-making expertise of battle commanders. Naturalistic Decision Making, 233–246.
65. Silverman, W. K., & Hinshaw, S. P. (2008). The second special issue on evidence-based psychosocial treatments for children and adolescents: A 10-year update. Journal of Clinical Child and Adolescent Psychology,37(1), 1–7.
66. Simon, H. A. (1992). What is an “explanation” of behavior? Psychological Science,3(3), 150–161. doi:10.1111/j.1467-9280.1992.tb00017.x.
67. Spring, B. (2008). Health decision making: Lynchpin of evidence-based practice. Medical Decision Making,28(6), 866–874.
68. Stahl, C., & Klauer, K. C. (2008). A simplified conjoint recognition paradigm for the measurement of gist and verbatim memory. Journal of Experimental Psychology: Learning, Memory, and Cognition,34(3), 570–586. doi:10.1037/0278-7393.34.3.570.
69. Tabachnick, B., & Fidell, L. (2007). Using multivariate statistics (5th ed.). Boston: Allyn and Bacon.
70. Trask, E. V., & Garland, A. F. (2012). Are children improving? Results from outcome measurement in a large mental health system. Administration and Policy in Mental Health and Mental Health Services Research,39(3), 210–220.
71. Tversky, A., & Kahneman, D. (1974). Judgement under uncertainty: Heuristics and Biases. Science,185, 1124–1131.
72. Van Someren, M. W., Barnard, Y. F., & Sandberg, J. A. C. (1994). The think aloud method: A practical guide to modelling cognitive processes. London: Academic Press.
73. Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology,78(2), 144–155.
74. Webster-Stratton, C. (1984). Randomized trial of two parent-training programs for families with conduct-disordered children. Journal of Consulting and Clinical Psychology,52(4), 666–678.
75. Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-based treatments and case examples. Cambridge, UK: Cambridge University Press.
76. Weisz, J. R., & Jensen, A. L. (2001). Child and adolescent psychotherapy in research and practice contexts: Review of the evidence and suggestions for improving the field. European Journal of Child and Adolescent Psychiatry,10, 12–18.
77. Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist,61(7), 671–689. doi:10.1037/0003-066X.61.7.671.
78. Whyte, G. (2001). Perspectives on naturalistic decision making from organizational behavior. Journal of Behavioral Decision Making,14(5), 383–384.
79. Witteman, C. L. M., & van der Bercken, J. H. L. (2007). Intermediate effects in psychodiagnostic classification. European Journal of Psychological Assessment,23, 56–61.