Building a Rigorous and Relevant Knowledge Base for the Psychological Therapies

Developing and Delivering Practice-Based Evidence: A Guide for the Psychological Therapies

Volumn , Issue , 2010, Pages 21-61

  Barkham, Michael ^a   Stiles, William B ^c   Lambert, Michael J ^d   Mellor Clark, John ^b  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b CORE Information Management Systems ^*  (United Kingdom)

^c MIAMI UNIVERSITY   (United States)

^d BRIGHAM YOUNG UNIVERSITY   (United States)

Author keywords

Building a rigorous and relevant knowledge base for psychological therapies; Concept of practice based evidence crucial in research questions grounded in practice context; Evidence based practice shaping format and delivery of psychological therapies; Explanatory clinical trials and practical clinical trials; Generic five stage model encompassing diversity of approaches in practice based research; Hallmarks of randomized controlled trials and practice based studies; Randomized control trial RCT priority on internal validity drawing inferences on cause and effect; Randomized controlled trials and responsiveness; Treatment as usual (TAU) as treatment condition; US National Advisory Mental Health Council's (NAMHC) Clinical Treatment and Services Research Workgroup (1999)

Indexed keywords

EID: 79953164648     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470687994.ch2     Document Type: Chapter

References (103)

1. Ahn, H. & Wampold, B. (2001). Where oh where are the specific ingredients? A meta-analysis of component studies in counseling and psychotherapy. Journal of Consulting and Clinical Psychology, 48, 251-257.
2. American Psychological Association (APA) (2002). Criteria for evaluating treatment guidelines. American Psychologist, 57, 1052-1059.
3. American Psychological Association (APA) (2006). Evidence-based practice in psychology: APA Presidential task force on evidence-based practice. American Psychologist, 61, 271-285.
4. Barkham, M. & Margison, F. (2007). Practice-based evidence as a complement to evidence-based practice: From dichotomy to chiasmus. In C. Freeman & M. Power (eds.), Handbook of evidence-based psychotherapies: A guide for research and practice (pp. 443-476). Chichester: John Wiley & Sons, Ltd.
5. Barkham, M. & Mellor-Clark, J. (2000). Rigour and relevance: Practice-based evidence in the psychological therapies. In N. Rowland & S. Goss (eds.), Evidence-based counselling and psychological therapies: Research and applications (pp. 127-144). London: Routledge.
6. Barkham M. & Mellor-Clark J. (2003). Bridging evidence-based practice and practice-based evidence: Developing a rigorous and relevant knowledge for the psychological therapies. Clinical Psychology & Psychotherapy, 10, 319-327.
7. Barkham, M. & Parry, G. (2008). Balancing rigour and relevance in guideline development for depression: The case for comprehensive cohort studies. Psychology and Psychotherapy: Theory, Research and Practice, 81, 399-417.
8. Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J. et al. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Towards practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184-196.
9. Barkham, M., Stiles, W.B., Connell, J., Twigg, E., Leach, C. et al. (2008). Effects of psychological therapies in randomized trials and practice-based studies. British Journal of Clinical Psychology, 47, 397-415.
10. Berger, V.W., Matthews, J.R. & Grosch, E.N. (2008). On improving research methodology in clinical trials. Statistical Methods in Medical Research, 17, 231-242.
11. Bewick, B.M., Trusler, K., Mullin, T., Grant, S. & Mothersole, G. (2006). Routine outcome measurement completion rates of the CORE-OM in primary care psychological therapies and counselling. Counselling & Psychotherapy Research, 6, 50-59.
12. Borkovec, T.D., Echemendia, R.J., Ragusea, S.A. & Ruiz, M. (2001). The Pennsylvania Practice Research Network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy effectiveness research. Clinical Psychology: Science and Practice, 8, 155-167.
13. Bottomley, A. (1997). To randomise or not to randomise: Methodological pitfalls of the RCT design in psychosocial intervention studies. European Journal of Cancer Care, 6, 222-230.
14. Boutron, I., Moher, D., Altman, D.G., Schulz, K.F. & Ravaud, P. (2008). Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: Explanation and elaboration. Annals of Internal Medicine, 148, 295-309.
15. Brower, L.A. (2003). The Ohio mental health consumer outcomes system: Reflections on a major policy initiative in the US. Clinical Psychology & Psychotherapy, 10, 400-406.
16. Cahill, J., Potter, S. & Mullin, T. (2006). First contact session outcomes in primary care psychological therapy and counselling services. Counselling & Psychotherapy Research, 6, 41-49.
17. Cartwright, N. (2007). Are RCTs the gold standard? BioSocieties, 2, 11-20.
18. Clark, D.M., Fairburn C.G. & Wessely, S. (2008). Psychological treatment outcomes in routine NHS services: a commentary on Stiles et al. (2007). Psychological Medicine, 38, 629-634.
19. Clark, D.M., Ehlers, A., Hackmann, A., McManus, F., Fennell, M. et al. (2006). Cognitive therapy versus exposure and applied relaxation in social phobia: A randomised controlled trial. Journal of Consulting and Clinical Psychology, 74, 568-578.
20. Clark, D.M., Layard, R., Smithies, R., Richards, R.A., Suckling, R. et al. (2009). Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behaviour Research and Therapy, 47, 910-920.
21. Connell, J., Grant, S. & Mullin, T. (2006). Client initiated termination of therapy at NHS primary care counselling services. Counselling & Psychotherapy Research, 6, 60-67.
22. Cox, A., Holbrook, D. & Rutter, M. (1981). Psychiatric interviewing techniques VI. Experimental study: Eliciting feelings. British Journal of Psychiatry, 139, 144-152.
23. Cox, A., Rutter, M. & Holbrook, D. (1981). Psychiatric interviewing techniquesV. Experimental study: Eliciting factual information. British Journal of Psychiatry, 139, 29-37.
24. Crits-Christoph, P., Baranackie, K., Kurcias, J.S., Carroll, K., Luborsky, L. et al. (1991).Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81-91.
25. Cuijpers, P., van Straten, A., Anderson, G. & van Oppen, G. (2008). Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology, 76, 909-922.
26. Elkin, I. (1999). A major dilemma in psychotherapy outcome research: Disentangling therapist from therapies. Clinical Psychology: Science and Practice, 6, 10-32.
27. Elkin, I., Falconnier, L., Martinovitch, Z. & Mahoney, C. (2006). Therapist effects in theNIMHTreatment ofDepressionCollaborativeResearch Program. Psychotherapy Research, 16, 144-160.
28. Elkin, I., Shea, M.T., Watkins, J.T., Imber, S.D., Sotsky, S.M. et al. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: general effectiveness of treatments. Archives of General Psychiatry, 46, 971-982.
29. Evans, R., Mellor-Clark, J., Barkham, M. & Mothersole, G. (2006). Developing the resources and management support for routine evaluation in counselling and psychological therapy service provision: Reflections on a decade of CORE development. European Journal of Psychotherapy and Counselling, 8, 141-161.
30. Evans, C., Connell, J., Barkham, M., Marshall, C. & Mellor-Clark, J. (2003). Practice-based evidence: Benchmarking NHS primary care counselling services at national and local levels. Clinical Psychology & Psychotherapy, 10, 374-388.
31. Faulkner, C., Fidler, F. & Cumming, G. (2008). The value of RCT evidence depends on the quality of statistical analysis.BehaviourResearch and Therapy, 46, 270-281.
32. Gloaguen, V., Cottraux, J., Cacherat, M.&Blackburn, I. (1998). A meta-analysis of the effects of cognitive therapy in depressed patients. Journal of Affective Disorders, 49, 59-72.
33. Green, L.W. & Glasgow, R.E. (2006). Evaluating the relevance, generalization, and applicability of research: Issues in external validation and translation methodology, Evaluation and the Health Professions, 29, 126-153.
34. Haaga, D.A.F. & Stiles, W.B. (2000). Randomized clinical trials in psychotherapy research: Methodology, design, and evaluation. In C.R. Snyder & R.E. Ingram (eds.), Handbook of psychological change: Psychotherapy processes and practices for the 21st century (pp. 14-39). New York: John Wiley & Sons, Inc.
35. Hardy, G.E., Stiles, W.B., Barkham, M. & Startup, M. (1998). Therapist responsiveness to client interpersonal styles during time-limited treatments for depression. Journal of Consulting and Clinical Psychology, 66, 304-312.
36. Hickner, J. (1993). Practice-based network research. In M.J. Bass, E.V. Dunn, P.G. Norton, M. Stewart & F. Tudiver (eds.), Conducting research in the practice setting. London: Sage Publications.
37. Horn, S.D. & Gassaway, J. (2007). Practice-based evidence study design for comparative effectiveness research. Medical Care, 45, S50-S57.
38. Huppert, J.D., Bufka, L.F., Barlow, D.H., Gorman, J.M., Shear, M.K. et al. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69, 747-755.
39. Jacobson, N.S. & Christensen, A. (1996). Studying the effectiveness of psychotherapy: How well can clinical trials do the job? American Psychologist, 51, 1031-1039.
40. Jacobson, N.S. & Hollon, S.D. (1996a). Prospects for future comparisons between drugs and psychotherapy: Lessons from the CBT-versuspharmacotherapy exchange. Journal of Consulting and Clinical Psychology, 64, 104-108.
41. Jacobson, N.S.&Hollon, S.D. (1996b).Cognitive-behavior therapy versus pharmacotherapy: Now that the jury's returned its verdict, it's time to present the rest of the evidence. Journal of Consulting and Clinical Psychology, 64, 74-80.
42. Jadad, A.R. & Enkin, M.W. (2007). Randomized controlled trials: Questions, answers and musings (2nd edn.). Oxford: Blackwell Publishing.
43. Joyce, A.S., Wolfaardt, U., Scribney, C. & Aylwin, A.S. (2006). Psychotherapy research at the start of the 21st century: The persistence of the art versus science controversy. Canadian Journal of Psychiatry, 51, 797-809.
44. Kim, D-M., Wampold, B.E.&Bolt, D.M.(2006).Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16, 161-172.
45. King, M., Sibbald, B., Ward, E., Bower, P., Lloyd, M. et al. (2000). Randomised controlled trial of non-directive counselling, cognitive-behaviour therapy and usual general practitioner care in the management of depression as well as mixed anxiety and depression in primary care. Health Technology Assessment, 4, 9.
46. Kotter, J.P. (1995). Leading change. Cambridge, MA: Harvard Business School Press.
47. Kotter, J.P. & Cohen, D.S. (2002). The heart of change: Real live stories of how people change their organizations. Cambridge, MA: Harvard Business School Press.
48. Lambert, M. (2001). Psychotherapy outcome and quality improvement: Introduction to the special section on patient-focused research. Journal of Consulting and Clinical Psychology, 69, 147-149.
49. Lambert M.J. & Ogles, B. (2004). The efficacy and effectiveness of psychotherapy. In M.J. Lambert (ed.), Bergin & Garfield's handbook of psychotherapy and behavior change (5th edn., pp. 139-193). New York: JohnWiley & Sons, Inc.
50. Lambert, M.J., Harmon, C., Slade, K., Whipple, J.L. & Hawkins, E.J. (2005). Providing feedback to psychotherapists on their patients' progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61, 165-174.
51. Lambert, M.J., Whipple, J.L., Hawkins, E.J., Vermeersch, D.A., Nielsen, S.L. et al. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288-301.
52. Lambert, M.J., Whipple, J.L., Smart, D.W., Vermeersch, D.A., Nielsen, S.L. et al. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11, 49-68.
53. Layard, R. (2006). The case for psychological treatment centres. BritishMedical Journal, 332, 1030-1032.
54. Lee, K.J. & Thompson, S.G. (2005). Clustering by health professional in individually randomized trials. British Medical Journal, 330, 142-144.
55. Leykin, Y. & DeRubeis R.J. (2009). Allegiance in psychotherapy outcome research: Separating association from bias. Clinical Psychology: Science and Practice, 16, 54-65.
56. Linehan, M.M. (1999).Development, evaluation, and dissemination of effective psychosocial treatments: Levels of disorder, stages of care, and stages of treatment research. In M.D. Glantz & C.R. Harte (eds.), Drug abuse: Origins and interventions (pp. 367-394). Washington, DC: American Psychological Association.
57. Luborsky, L., Diguer, L., Seligman, D.A., Rosenthal, R., Krause, E.D. et al. (1999). The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6, 95-106.
58. Lucock, M., Leach, C., Iveson, S., Lynch, K., Horsefield, C. et al. (2003). A systematic approach to practice-based evidence in a psychological therapies service. Journal of Clinical Psychology and Psychotherapy, 10, 389-399.
59. Lutz, W. (2002). Patient-focused psychotherapy research and individual treatment progress as scientific groundwork for an empirically based clinical practice. Psychotherapy Research, 12, 251-272.
60. Lutz, W., Leach, C., Barkham, M., Lucock, M., Stiles, W.B. et al. (2005). Predicting rate and shape of change for individual clients receiving psychological therapy: Using growth curve modeling and nearest neighbor technologies. Journal of Consulting and Clinical Psychology, 73, 904-913.
61. Margison, F. (2001). Practice-based evidence in psychotherapy. In C. Mace, S. Moorey & B. Roberts (eds.), Evidence in the psychological therapies: A critical guide for practitioners (pp. 174-198) London: Brunner-Routledge.
62. Margison, F., Barkham, M., Evans, C., McGrath, G., Mellor-Clark, J. et al. (2000). Measurement and psychotherapy: Evidence-based practice and practicebased evidence. British Journal of Psychiatry, 177, 123-130.
63. Mellor-Clark, J. & Barkham, M. (2006). The CORE system: Developing and delivering practice-based evidence through quality evaluation. In C. Feltham & I. Horton (eds.), Handbook of counselling and psychotherapy (2nd edn., pp. 207-224). London: Sage Publications.
64. Mellor-Clark, J., Curtis Jenkins, A., Evans, R., Mothersole, G. & McInnes, B. (2006). Resourcing a CORE Network to develop a National Research Database to help enhance psychological therapy and counselling service provision. Counselling & Psychotherapy Research, 6, 16-22.
65. Merrill, K.A., Tolbert, V.E.&Wade, W.A. (2003). Effectiveness of cognitive therapy for depression in a community mental health center: A benchmarking study. Journal of Consulting and Clinical Psychology, 71, 404-409.
66. Minami, T., Wampold, B.E., Serlin, R.C., Kircher, J.C. & Brown, G.S. (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75, 232-243.
67. Mullin, T., Barkham, M., Mothersole, G., Bewick, B.M. & Kinder, A. (2006). Recovery and improvement benchmarks in routine primary care mental health settings. Counselling & Psychotherapy Research, 6, 68-80.
68. National Advisory Mental Health Council (NAMHC) (1999). Bridging science and service: A report by the National Advisory Mental Health Council's clinical treatment and services research workgroup (NIH Publication No. 99-4353).Washington, DC.
69. Nielsen, S.L., Okiishi, J., Nielsen, D.L., Hawkins, E.J., Harmon, S.C. et al. (2009). Termination, appointment use, and outcome patterns associated with intake therapist discontinuity. Professional Psychology: Research and Practice, 40, 272-278.
70. Norcross, J.C. (ed.) (2002). Psychotherapy relationships that work: Therapist contributions and responsiveness to patient needs. New York: Oxford University Press.
71. Norcross, J.C. & Lambert, W.G. (2006). The therapy relationship. In J.C. Norcross, L.E. Butler & R.F. Levant (eds.), Evidence-based practices in mental health: debate and dialogue on the fundamental questions (pp. 208-218). Washington, DC: American Psychological Association.
72. Okiishi, J.C., Lambert, M.J., Eggett, D., Nielsen, S.L., Dayton, D.D. et al. (2006). An analysis of therapist treatment effects: Towards providing feedback to individual therapists on their patients' psychotherapy outcome. Journal of Clinical Psychology, 62, 1157-1172.
73. Persons, J.B. & Silberschatz, G. (1998). Are the results of randomized trials useful to psychotherapists? Journal of Consulting and Clinical Psychology, 66, 126-135.
74. Rawlins, M.D. (2008). De Testimonio: On the evidence for decisions about the use of therapeutic interventions. The Harveian Oration of 2008. Royal College of Physicians.
75. Richards, D.A. & Suckling, R. (2009). Improving access to psychological therapies (IAPT): Phase IV prospective cohort study. British Journal of Clinical Psychology, 48, 377-396.
76. Roberts, C. & Roberts, S.A. (2005). Design and analysis of clinical trials with clustering effects due to treatment. Clinical Trials, 2, 152-162.
77. Robinson, L.A., Berman, J.S. & Neimeyer, R.A. (1990). Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin, 108, 30-49.
78. Sackett, D., Rosenberg, W., Gray, J., Haynes, B. & Richardson, W. (1996). Evidence-based medicine: what it is and what it is not. British Medical Journal, 312, 71-72.
79. Salkovskis, P.M. (1995). Demonstrating specific effects in cognitive and behavioural therapy. InM. Aveline & D.A. Shapiro (eds.), Research foundations for psychotherapy research (pp. 191-228). Chichester: John Wiley & Sons, Ltd.
80. Shadish, W.R., Matt, G.E., Nararro, A.M., Siegle, G., Crits-Cristoph, P. et al. (1997). Evidence that therapy works in clinically representative conditions. Journal of Consulting and Clinical Psychology, 65, 355-365.
81. Sloane, R.B., Staples, F.R., Cristol, A.H., Yorkston, N.J. & Whipple, K. (1975). Psychotherapy versus behavior therapy. Cambridge, MA: HarvardUniversity Press.
82. Smith, G.C.S. & Pell, J.P. (2003). Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials. British Medical Journal, 327, 1459-1461.
83. Smith, M.L. & Glass, G.V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752-760.
84. Stiles, W.B. (1988). Psychotherapy process-outcome correlations may be misleading. Psychotherapy, 25, 27-35.
85. Stiles, W.B. (2005). Dialogue: Convergence and contention. In J.C. Norcross, L.E. Beutler & R.F. Levant (eds.), Evidence-based practices in mental health: Debate and dialogue on the fundamental questions (pp. 105-107). Washington, DC: American Psychological Association.
86. Stiles,W.B.&Shapiro,D.A. (1994).Disabuse of the drug metaphor: Psychotherapy process-outcome correlations. Journal ofConsulting and Clinical Psychology, 62, 942-948.
87. Stiles, W.B. & Wolfe, B.E. (2006). Relationship factors in treating anxiety disorders. In L.G. Castonguay & L.E. Beutler (eds.), Principles of therapeutic change that work (pp. 155-165). New York: Oxford University Press.
88. Stiles, W.B., Honos-Webb, L.&Surko, M. (1998).Responsiveness in psychotherapy. Clinical Psychology: Science & Practice, 5, 439-458.
89. Stiles, W.B., Shapiro, D.A. & Elliott, R. (1986). 'Are all psychotherapies equivalent?' American Psychologist, 41, 165-180.
90. Stiles, W.B., Barkham, M., Mellor-Clark, J.&Connell, J. (2008a). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary care routine practice: Replication in a larger sample. Psychological Medicine, 38, 677-688.
91. Stiles, W.B., Barkham, M., Mellor-Clark, J. & Connell, J. (2008b). Routine psychological treatment and the Dodo Verdict: A rejoinder to Clark et al. (2007). Psychological Medicine, 38, 905-910.
92. Stiles, W.B., Barkham, M., Twigg, E., Mellor-Clark, J. & Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies as practiced in UK National Health Service settings. Psychological Medicine, 36, 555-566.
93. Sussman, S., Valente, T.W., Rohrbach, L.A., Skara, S. & Pentz, M.A. (2006). Translation in the health professions: Converting science into action. Evaluation and the Health Professions, 29, 7-32.
94. Trusler, K., Doherty, C., Grant, S., Mullin, T. & McBride, J. (2006). Waiting times for primary care counselling services. Counselling & Psychotherapy Research, 6, 23-32.
95. Tunis, S.R., Stryer, D.B. & Clancy, C.M. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. Journal of the America Medical Association, 290, 1624-1632.
96. Veerman, J.W. & van Yperen, T.A. (2007). Degrees of freedom and degrees of certainty: A developmental model for the establishment of evidence-based youth care. Evaluation and Program Planning, 30, 212-221.
97. Walwyn, R. & Roberts, C. (in press). Therapist variation within randomised trials of psychotherapy: Implications for precision, internal and external validity. Statistical Methods in Medical Research.
98. Wampold, B.E. (2001). The great psychotherapy debate: Models, methods, and findings (5th edn., pp. 767-804). Mahwah, NJ: Erlbaum.
99. Wampold, B.E. (2007). Psychotherapy: The humanistic (and effective) treatment. American Psychologist, 62, 857-873.
100. Wampold, B.E.&Brown, G. (2005). Estimating therapist variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923.
101. Wampold, B., Mondlin, G., Moody, M., Stich, F, Benson, K. et al. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically 'All must have prizes.' Psychological Bulletin, 122, 203-215.
102. Wessely, S. (2007). A defence of the randomized controlled trial in mental health. BioSocieties, 2, 115-127.
103. Wojciechowski, F.L. (1984). Double blind research in psychotherapy. Lisse, Netherlands: Swets & Zeitlinger.