Principles for Training in Evidence-Based Psychology: Recommendations for the Graduate Curricula in Clinical Psychology

Clinical Psychology: Science and Practice

Volumn 21, Issue 4, 2014, Pages 410-424

  Beck, J Gayle ^a   Castonguay, Louis G ^b   Chronis Tuscano, Andrea ^c   Klonsky, E David ^d   Mcginn, Lata K ^e   Youngstrom, Eric A ^f  

^a University of Memphis   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

^d UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^e YESHIVA UNIVERSITY   (United States)

^f UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

Clinical Psychology; Doctoral training; Evidence based training

Indexed keywords

EID: 84916600411     PISSN: 09695893     EISSN: 14682850     Source Type: Journal    
DOI: 10.1111/cpsp.12079     Document Type: Article

References (104)

1. Aguilera, A., Garza, M. J., & Munoz, R. F. (2010). Group cognitive-behavioral therapy for depression in Spanish: Culture-sensitive manualized treatment in practice. Journal of Clinical Psychology, 66, 857-867. doi:10.1002/jclp.20706
2. American Psychological Association. (2005). Policy statement on evidence-based practice in psychology. Retrieved from http://www.apapracticecentral.org/ce/courses/ebpstatement.pdf
3. APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285. doi:10.1037/0003-066X.61.4.271
4. Arkes, H. R. (1991). Costs and benefits of judgment errors: Implications for debiasing. Psychological Bulletin, 110, 486-498. doi:10.1037/0033-2909.110.3.486
5. Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 258-297). New York, NY: Wiley.
6. Barkham, M., & Margison, F. (2007). Practice-based evidence as a complement to evidence-based practice: From dichotomy to chiasmus. In C. Freeman & M. Power (Eds.), Handbook of evidence-based psychotherapies: A guide for research and practice (pp. 443-476). Chichester, UK: Wiley.
7. Barkham, M., Stiles, W. B., Lambert, M. J., & Mellor-Clark, J. (2010). Building a rigorous and relevant knowledge-base for the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 21-61). Chichester, UK: Wiley.
8. Barratt, A. (2008). Evidence based medicine and shared decision making: The challenge of getting both evidence and preferences into health care. Patient Education and Counseling, 73, 407-412. doi:10.1016/j.pec.2008.07.054
9. Bauer, R. M. (2007). Evidence-based practice in psychology: Implications for research and research training. Journal of Clinical Psychology, 63, 685-694. doi:10.1002/jclp.20374
10. Benish, S. G., Quintana, S., & Wampold, B. E. (2011). Culturally adapted psychotherapy and the legitimacy of myth: A direct-comparison meta-analysis. Journal of Counseling Psychology, 58, 279-289. doi:10.1037/a0023626
11. Bernal, G., & Domenech Rodríguez, M. M. (Eds.). (2012). Cultural adaptations: Tools for evidence-based practice with diverse populations. Washington, DC: American Psychological Association.
12. Blatt, S. J., Quinlan, D. M., Pilkonis, P. A., & Shea, M. T. (1995). Impact of perfectionism and need for approval on the brief treatment of depression: The National Institute of Mental Health Treatment of Depression Collaborative Research Program revisited. Journal of Consulting and Clinical Psychology, 63, 125-132. doi:10.1037/0022-006X.63.1.125
13. Bohart, A. C., & Greaves Wade, A. (2013). The client in psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 219-257). New York, NY: Wiley.
14. Bonilla, J., Bernal, G., Santos, A., & Santos, D. (2004). A revised Spanish version of the Beck Depression Inventory: Psychometric properties with a Puerto Rican sample of college students. Journal of Clinical Psychology, 60, 119-130. doi:10.1002/jclp.10195
15. Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., & de Vet, H. C. W. (2003). Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. British Medical Journal, 326, 41-44. doi:10.1136/bmj.326.7379.41
16. Camara, W., Nathan, J., & Puente, A. (1998). Psychological test usage in professional psychology: Report of the APA practice and science directorates. Washington, DC: American Psychological Association.
17. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105. doi:10.1037/h0046016
18. Castonguay, L. G. (2013). Psychotherapy outcome: A problem worth re-revisiting 50 years later. Psychotherapy, 50, 52-67. doi:10.1037/a0030898
19. Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and application. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 85-133). New York, NY: Wiley.
20. Castonguay, L. G., Boswell, J. F., Constantino, M. J., Goldfried, M. R., & Hill, C. E. (2010). Training implications of harmful effects of psychological treatments. American Psychologist, 65, 34-49. doi:10.1037/a0017330
21. Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., .. Woody, S. R. (1998). Update on empirically validated therapies, II. The Clinical Psychologist, 51(1), 3-16.
22. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18. doi:10.1037/0022-006X.66.1.7
23. Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685-716. doi:10.1146/annurev.psych.52.1.685
24. Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., Pope, K. S., Crits-Christoph, P., .. McCurry, S. (1996). An update on empirically validated therapies. The Clinical Psychologist, 49, 5-18.
25. Collins, F. L., Jr., Leffingwell, T. R., & Belar, C. D. (2007). Teaching evidence-based practice: Implications for psychology. Journal of Clinical Psychology, 63, 657-670. doi:10.1002/jclp.20378
26. Comas-Díaz, L. (1981). Effects of cognitive and behavioral group treatment on the depressive symptomatology of Puerto Rican women. Journal of Consulting and Clinical Psychology, 49, 627-632. doi:10.1037/0022-006X.49.5.627
27. Craig, J. V., & Smyth, R. L. (2002). The evidence-based practice manual for nurses. New York, NY: Elsevier Health Sciences.
28. Crits-Christoph, P. (1998). Training in empirically validated treatments: The Division 12 APA Task Force recommendations. In K. S. Dobson & K. D. Craig (Eds.), Empirically supported therapies: Best practice in professional psychology (pp. 3-25). Thousand Oaks, CA: Sage.
29. Croskerry, P. (2002). Achieving quality in clinical decision making: Cognitive strategies and detection of bias. Academic Emergency Medicine, 9, 1184-1204. doi:10.1197/aemj.9.11.1184
30. Croskerry, P. (2003). The importance of cognitive errors in diagnosis and strategies to minimize them. Academic Medicine, 78, 775-780. doi:10.1097/00001888-200308000-00003
31. Davis, S. D., Lebow, D. L., & Sprenkle, D. H. (2012). Common factors of change in couple's therapy. Behavior Therapy, 43, 36-48. doi:10.1016/j.beth.2011.01.009
32. De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of child psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483-509. doi:10.1037/0033-2909.131.4.483
33. Dixon, M. R., Jackson, J. W., Small, S. L., Horner-King, M. J., Lik, N. M., Garcia, Y., & Rosales, R. (2009). Creating single-subject design graphs in Microsoft Excel 2007. Journal of Applied Behavioral Analysis, 42, 277-293. doi:10.1901/jaba.2009.42-277
34. Evidence-Based Medicine Working Group. (1992). Evidence-based medicine: A new approach to teaching the practice of medicine. Journal of the American Medical Association, 268, 2420-2425. doi:10.1001/jama.1992.03490170092032
35. Follette, W. C., & Greenberg, L. E. (2006). Technique factors in treating dysphoric disorders. In L. G. Castonguay & L. E. Beutler (Eds.), Principles of therapeutic change that work (pp. 83-109). New York, NY: Oxford University Press.
36. Frisch, M. B. (1998). Quality of life therapy and assessment in health care. Clinical Psychology: Science and Practice, 5, 19-40. doi:10.1111/j.1468-2850.1998.tb00132.x
37. Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
38. Gigerenzer, G., & Hoffrage, U. (1995). How to improve Bayesian reasoning without instruction: Frequency formats. Psychological Review, 102, 684-704. doi:10.1037/0033-295X.102.4.684
39. Gilbert, R., Burls, A., & Glasziou, P. (2008). Clinicians also need training in use of research evidence. Lancet, 371, 472-473. doi:10.1016/S0140-6736(08)60231-7
40. Gray, G. E. (2004). Concise guide to evidence-based psychiatry. Arlington, VA: American Psychiatric Publishing.
41. Griner, D., & Smith, T. B. (2006). Culturally adapted mental health intervention: A meta-analytic review. Psychotherapy: Theory, Research, Practice, Training, 43, 531-548. doi:10.1037/0033-3204.43.4.531
42. Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19-30. doi:10.1037/1040-3590.12.1.19
43. Hayes, S. C., Barlow, D. H., & Nelson-Gray, R. O. (1999). The scientist practitioner: Research and accountability in the age of managed care (2nd ed.). Boston, MA: Allyn and Bacon.
44. Hays, P. A., & Iwamasa, G. Y. (Eds.). (2006). Culturally responsive cognitive-behavioral therapy: Assessment, practice, and supervision. Washington, DC: American Psychological Association.
45. Health Service Psychology Education Collaborative. (2013). Professional psychology in health care services: A blueprint for education and training. American Psychologist, 68, 411-426. doi:10.1037/a0033265
46. Hill, C. E., & Lambert, M. J. (2004). Methodological issues in studying psychotherapy process and outcomes. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed., pp. 84-135). New York, NY: John Wiley & Sons.
47. Hill, C. E., Stahl, J., & Roffman, M. (2007). Training novice psychotherapists: Helping skills and beyond. Psychotherapy: Theory, Research, Practice, Training, 44, 364-370. doi:10.1037/0033-3204.44.4.364
48. Hoagwood, K. E., & Cavaleri, M. A. (2010). Ethical issues in child and adolescent psychosocial treatment research. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed.). New York, NY: Guilford Press.
49. Hoge, M. A., Tondora, J., & Stuart, G. W. (2003). Training in evidence-based practice. Psychiatric Clinics of North America, 26, 851-865. doi:10.1016/S0193-953X(03)00066-2
50. Howard, M. O., Allen-Meares, P., & Ruffolo, M. C. (2007). Teaching evidence-based practice: Strategic and pedagogical recommendations for schools of social work. Research on Social Work Practice, 17, 561-568. doi:10.1177/1049731507300191
51. Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61, 678-685. doi:10.1037/0022-006X.61.4.678
52. Huey, S. J., & Polo, A. J. (2008). Evidence-based psychosocial treatments for ethnic minority youth. Journal of Clinical Child & Adolescent Psychology, 37, 262-301. doi:10.1080/15374410701820174
53. Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29-51. doi:10.1146/annurev.clinpsy.3.022806.091419
54. Jaeschke, R., Guyatt, G. H., & Sackett, D. L. (1994a). Users' guides to the medical literature. III. How to use an article about a diagnostic test: A. Are the results of the study valid? Journal of the American Medical Association, 271, 389-391.
55. Jaeschke, R., Guyatt, G. H., & Sackett, D. L. (1994b). Users' guides to the medical literature: III. How to use an article about a diagnostic test: B. What are the results and will they help me in caring for my patients? Journal of the American Medical Association, 271, 703-707.
56. Jenkins, M. M., Youngstrom, E. A., Washburn, J. J., & Youngstrom, J. K. (2011). Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Professional Psychology: Research and Practice, 42, 121-129. doi:10.1037/a0022506
57. Kazdin, A. E. (1999). The meanings and measurement of clinical significance. Journal of Consulting and Clinical Psychology, 67, 332-339.
58. Kazdin, A. E., & Rabbit, S. M. (2013). Novel models for delivering mental health services and reducing the burdens of mental illness. Clinical Psychological Science, 1, 170-191. doi:10.1177/2167702612463566
59. Kraemer, H. C. (1992). Evaluating medical tests: Objective and quantitative guidelines. Newbury Park, CA: Sage.
60. Lambert, M. J., & Brown, G. S. (1996). Data-based management for tracking outcome in private practice. Clinical Psychology: Science and Practice, 3, 172-178. doi:10.1111/j.1468-2850.1996.tb00068.x
61. Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172. doi:10.1037/0022-006X.69.2.159
62. Levy, L. H. (1962). The skew in clinical psychology. American Psychologist, 17, 244-249. doi:10.1037/h0048838
63. Lilienfeld, S. O. (2007). Psychological treatments that cause harm. Perspectives on Psychological Science, 2, 53-70. doi:10.1111/j.1745-6916.2007.00029.x
64. van Loon, A., van Schaik, A., Dekker, J., & Beekman, A. (2013). Bridging the gap for ethnic minority adult outpatients with depression and anxiety disorders by culturally adapted treatments. Journal of Affective Disorders, 147, 9-16. doi:10.1016/j.jad.2012.12.014
65. Luborsky, L. (1984). Principles of psychoanalytic psychotherapy. New York, NY: Basic Books.
66. Lueger, R. J. (2002). Practice-informed research and research-informed psychotherapy. Journal of Clinical Psychology, 58, 1265-1276. doi:10.1002/jclp.10110
67. Masters, K. S., France, C. R., & Thorn, B. E. (2009). Enhancing preparation among entry-level clinical health psychologists: Recommendations for "best practices" from the first meeting of the Council of Clinical Health Psychology Training Programs (CCHPTP). Training and Education in Professional Psychology, 3, 193-201. doi:10.1037/a0016049
68. McFall, R. M. (2012). Psychological clinical science accreditation system: FAQs and facts. The Behavior Therapist, 35, 11-15.
69. McFall, R. M., & Treat, T. A. (1999). Quantifying the information value of clinical assessment with signal detection theory. Annual Review of Psychology, 50, 215-241. doi:10.1146/annurev.psych.50.1.215
70. McGinn, T., Jervis, R., Wisnivesky, J., Keitz, S., & Wyer, P. C. (2008). Tips for teachers of evidence-based medicine: Clinical prediction rules (CPRs) and estimating pretest probability. Journal of General Internal Medicine, 23, 1261-1268. doi:10.1007/s11606-008-0623-z
71. Meats, E., Brassey, J., Heneghan, C., & Glasziou, P. (2007). Using the Turning Research Into Practice (TRIP) database: How do clinicians really search? Journal of the Medical Library Association, 95, 156-163. doi:10.3163/1536-5050.95.2.156
72. Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota Press.
73. Moher, D., Schulz, K. F., & Altman, D. G. (2001). The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. The Lancet, 357, 1191-1194. doi:10.1016/S0140-6736(00)04337-3
74. Newman, M. G., Castonguay, L. G., Borkovec, T. D., Fisher, A. J., Boswell, J. F., Szkodny, L. E., & Nordberg, S. S. (2011). A randomized controlled trial of cognitive-behavioral therapy for generalized anxiety disorder with integrated techniques from emotion-focused and interpersonal therapies. Journal of Consulting and Clinical Psychology, 79, 171-181. doi:10.1037/a0022489
75. Norcross, J. C. (Ed.). (2011). Psychotherapeutic relationships that work. New York, NY: Oxford University Press.
76. Norcross, J. C., Hogan, T. P., & Koocher, G. P. (2008). Clinician's guide to evidence based practices: Mental health and the addictions. London, UK: Oxford University Press.
77. Ono, Y., Furukawa, T. A., Shimizu, E., Okamoto, Y., Nakagawa, A., Fujisawa, D., & Nakajima, S. (2011). Current status of research on cognitive therapy/cognitive behavior therapy in Japan. Psychiatry and Clinical Neurosciences, 65(2), 121-129. doi:10.1111/j.1440-1819.2010.02182.x
78. Pachankis, J. E. (2009). The use of cognitive-behavioral therapy to promote authenticity. Pragmatic Case Studies in Psychotherapy, 5, 28-38.
79. Pachankis, J., & Goldfried, M. (2004). Clinical issues in working with lesbian, gay, and bisexual clients. Psychotherapy: Theory, Research, Practice, Training, 41, 227-246. doi:10.1037/2329-0382.1.S.45
80. Pagoto, S. L., Spring, B., Coups, E. J., Mulvaney, S., Coutu, M. F., & Ozakinci, G. (2007). Barriers and facilitators of evidence-based practice perceived by behavioral science health professionals. Journal of Clinical Psychology, 63, 695-705. doi:10.1002/jclp.20376
81. Powsner, S. M., & Tufte, E. R. (1994). Graphical summary of patient status. The Lancet, 344, 368-389. doi:10.1016/S0140-6736(94)91406-0
82. Routh, D. K. (1994). Clinical psychology since 1917: Science, practice, and organization. New York, NY: Plenum Press.
83. Sackett, D. L. (1969). Clinical epidemiology. American Journal of Epidemiology, 8, 125-128.
84. Sackett, D. L., Haybes, R. B., Guyatt, G., & Tugwell, P. (1991). Clinical epidemiology: A basic science for clinical medicine (2nd ed.). Boston, MA: Little, Brown.
85. Sackett, D. L., Haynes, R. B., & Tugwell, P. (1985). Clinical epidemiology: A basic science for clinical medicine (1st ed.). Boston, MA: Little, Brown.
86. Sackett, D. L., Straus, S. E., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (2000). Evidence based medicine: How to practice and teach EBM (2nd ed.). London, UK: Churchill Livingstone.
87. Sanderson, W. C., & McGinn, L. K. (1997). Psychological treatments of anxiety disorder patients with comorbidity. In S. Wetzler & W. C. Sanderson (Eds.), Treatment strategies for patients with psychiatric comorbidity (pp. 75-103). New York, NY: Wiley.
88. Schon, D. A. (1983). The reflective practitioner: How professionals think in action. New York, NY: Basic Books.
89. Shakow, D., Hilgard, E. R., Kelly, E. L., Luckey, B., Sanford, R. N., & Shaffer, L. F. (1947). Recommended graduate training programs in clinical psychology. American Psychologist, 2, 539-558.
90. Silverman, W. A. (1998). Where's the evidence: Debates in modern medicine. New York, NY: Oxford University Press.
91. Silverman, W. K., & Hinshaw, S. P. (2008). The second special issue on evidence-based psychosocial treatments for children and adolescents: A 10-year update. Journal of Clinical Child & Adolescent Psychology, 37, 1-7. doi:10.1080/15374410701817725
92. Spring, B. (2007). Evidence-based practice in clinical psychology: What it is, why it matters; What you need to know. Journal of Clinical Psychology, 63, 611-631. doi:10.1002/jclp.20373
93. Straus, S. E., Glasziou, P., Richardson, W. S., & Haynes, R. B. (2011). Evidence-based medicine: How to practice and teach EBM (4th ed.). New York, NY: Churchill Livingstone.
94. Stricker, G., & Gold, J. R. (1996). Psychotherapy integration: An assimilative, psychodynamic approach. Clinical Psychology: Science and Practice, 3, 47-58. doi:10.1037/11436-005
95. Sue, S., & Zane, N. (2009). The role of culture and cultural techniques in psychotherapy: A critique and reformulation. Asian American Journal of Psychology, 5(1), 3-14. doi:10.1037/1948-1985.S.1.3
96. Swift, J. K., Callahan, J. L., & Vollmer, B. M. (2011). Preferences. In J. C. Norcross (Ed.), Psychotherapy relationships that work (2nd ed., pp. 301-315). New York, NY: Oxford University Press.
97. Task Force on Promotion and Dissemination of Psychological Procedures. (1995). Training in and dissemination of empirically-validated psychological procedures: Report and recommendations. The Clinical Psychologist, 48, 3-23.
98. Thorn, B. E. (2007). Evidence-based practice in psychology. Journal of Clinical Psychology, 63, 607-609. doi:10.1002/jclp.20384
99. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Erlbaum.
100. Weissman, M. M., Verdeli, H., Gameroff, M. J., Bledsoe, S. E., Betts, K., Mufson, L., .. Wickramaratne, P. (2006). National survey of psychotherapy training in psychiatry, psychology, and social work. Archives of General Psychiatry, 63, 925-934.
101. Wellek, S. (2002). Testing statistical hypotheses of equivalence. Boca Raton, FL: Chapman Hall/CRC.
102. Woody, S. R., & Ollendick, T. H. (2006). Technique factors in treating anxiety disorders. In L. G. Castonguay & L. E. Beutler (Eds.), Principles of therapeutic change that work (pp. 167-186). New York, NY: Oxford University Press.
103. Youngstrom, E. A. (2008). Evidence-based strategies for the assessment of developmental psychopathology: Measuring prediction, prescription, and process. In D. J. Miklowitz, W. E. Craighead, & L. Craighead (Eds.), Developmental psychopathology (pp. 34-77). New York, NY: Wiley.
104. Youngstrom, E. A. (2013). Future directions in psychological assessment: Combining evidence-based medicine innovations with psychology's historical strengths to enhance utility. Journal of Clinical Child and Adolescent Psychology, 42, 139-159. doi:10.1080/15374416.2012.736358