Randomised controlled trials and the evaluation of psychological therapy

Evidence Based Counselling and Psychological Therapies: Research and Applications

Volumn , Issue , 2013, Pages 79-110

  Bower, Peter ^a   King, Michael ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85140547182     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203131602-8     Document Type: Chapter

References (98)

1. American Psychiatric Association (1994) Diagnostic and Statistical Manual of Mental Disorders (4th edn). Washington, DC: American Psychiatric Association.
2. Barkham, M. and Shapiro, D. (1992) Response, in W. Dryden and C. Feltham (eds) Psychotherapy and its Discontents. Bristol: Open University Press, 86-96.
3. Barlow, D., Hayes, S. and Nelson, R. (1984) The Scientist-Practitioner: Research and Accountability in Clinical and Educational Settings. New York: Pergamon Press.
4. Basham, R. (1986) Scientific and practical advantages of comparative design in psychotherapy outcome research. Journal of Consulting and Clinical Psychology, 54: 88-94.
5. Beck, A. and Steer, R. (1987) Beck Depression Inventory: Manual. San Antonio: Psychological Corporation.
6. Black, N. (1996) Why we need observational studies to evaluate the effectiveness of health care. British Medical Journal, 312: 1215-1218.
7. Borkovec, T. and Castonguay, L. (1998) What is the scientific meaning of empirically supported therapy? Journal of Consulting and Clinical Psychology, 66: 136-142.
8. Bracht, G. and Glass, G. (1968) The external validity of experiments. American Educational Research Journal, 5: 437-474.
9. Brewin, C. and Bradley, C. (1989) Patient preferences and randomised clinical trials. British Medical Journal, 299: 313-315.
10. Britton, A., McKee, M., Black, N., McPherson, K., Sanderson, C. and Bain, C. (1998) Choosing between randomised and non-randomised studies: A systematic review. Health Technology Assessment 2 (13).
11. Brockelhurst, P. (1997) Partially randomised patient preference trials. British Journal of Obstetrics and Gynaecology, 104: 1332-1335.
12. Campbell, D. and Stanley, J. (1966) Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally.
13. Chalmers, T., Celano, P., Sacks, H. and Smith, H. (1983) Bias in treatment assignment in controlled clinical trials. New England Journal of Medicine, 309: 1358-1361.
14. Chambless, D. and Hollon, S. (1998) Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66: 7-18.
15. Charlton, B. (1996) The future of clinical research: From megatrials towards methodological rigour and representative sampling. Journal of Evaluation in Clinical Practice, 2: 159-169.
16. Clarke, G. (1995) Improving the transition from basic efficacy research to effectiveness studies: Methodological issues and procedures. Journal of Consulting and Clinical Psychology, 63: 718-725.
17. Cochrane, A. (1972) Effectiveness and Efficiency: Random Reflections on Health Services. London: The Nuffield Provincial Hospitals Trust.
18. Cohen, J. (1969) Statistical Power Analysis for the Behavioural Sciences. San Diego: Academic Press.
19. Collins, R., Peto, R., Gray, R. and Parish, S. (1997) Large scale randomised evidence: trials and overviews, in A. Maynard and I. Chalmers (eds) Non-random Reflections on Health Services Research. London: BMJ Publishing Group, 197-230.
20. Cook, T. and Campbell, D. (1979) Quasi-Experimentation - Design and Analysis Issues for Field Settings. Chicago: Rand McNally.
21. Crits-Christoph, P. and Mintz, J. (1991) Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. Journal of Consulting and Clinical Psychology, 59: 20-26.
22. Dar, R., Serlin, R. and Omer, H. (1994) Misuse of statistical tests in three decades of psychotherapy research. Journal of Consulting and Clinical Psychology, 62: 75-82.
23. Davey Smith, G. and Philips, A. (1992) Confounding in epidemiological studies: Why ‘independent’ effects may not be all they seem. British Medical Journal, 305: 757-759.
24. Dawes, R. (1988) You can’t systematize human judgement: Dyslexia, in J. Dowie and A. Elstein (eds) Professional Judgement: A Reader in Clinical Decision Making. New York: Cambridge University Press, 150-162.
25. Derogatis, L. (1992) The Brief Symptom Inventory (BSI): Administration, Scoring and Procedures Manual. Baltimore: Clinical Psychometric Research Inc.
26. Dowie, J. (1996) The research-practice gap and the role of decision analysis in closing it. Health Care Analysis, 4: 5-18.
27. Elkin, I., Gibbons, R., Shea, T. and Shaw, B. (1996) Science is not a trial (but sometimes it can be a tribulation). Journal of Consulting and Clinical Psychology, 64: 92-103.
28. Eysenck, H. (1952) The effects of psychotherapy: An evaluation. Journal of Consulting and Clinical Psychology, 16: 319-324.
29. Fahey, T. (1998) Applying the results of clinical trials to patients in general practice: perceived problems, strengths, assumptions, and challenges for the future. British Journal of General Practice, 48: 1173-1178.
30. Fairhurst, K. and Dowrick, C. (1996) Problems with recruitment in a randomised controlled trial of counselling in general practice: causes and implications. Journal of Health Services Research and Policy, 1: 77-80.
31. Gardner, M. and Altman, D. (1989) Statistics with Confidence. London: British Medical Association.
32. Goldfried, M. and Wolfe, B. (1996) Psychotherapy practice and research. American Psychologist, 51: 1007-1016.
33. Gossop, M., Johns, A. and Green, L. (1986) Opiate withdrawal: Inpatient versus outpatient programmes and preferred versus random assignment to treatment. British Medical Journal, 293: 103-104.
34. Graham-Smith, D. (1995) Evidence-based medicine: Socratic dissent. British Medical Journal, 310: 1126-1127.
35. Greenberg, R. and Fisher, S. (1994) Suspended judgement. Seeing through the doublemasked design: A commentary. Controlled Clinical Trials, 15: 244-246.
36. Greenhalgh, T. and Worrall, J. (1997) From EBM to CSM: The evolution of contextsensitive medicine. Journal of Evaluation in Clinical Practice, 3: 105-108.
37. Haines, A. and Donald, A. (1998) Getting Research Findings into Practice. London: BMJ Books.
38. Hamilton, M. (1967) Development of a rating scale for primary depressive illness. British Journal of Social and Clinical Psychology, 6: 278-296.
39. Hansen, N. and Lambert, M. (1996) Clinical significance: an overview of methods. Journal of Mental Health, 5: 17-24.
40. Heckman, J. (1997) Instrumental variables: A study of implicit behavioural assumptions used in making program evaluations. Journal of Human Resource, 32: 441-461.
41. Jacobson, N. and Christensen, A. (1996) Studying the effectiveness of psychotherapy: How well can clinical trials do the job? American Psychologist, 51: 1031-1039.
42. Jacobson, N., Dobson, K., Truax, P., Addis, M., Koerner, K., Gollan, J., Gortner, E. and Prince, S. (1996) A component analysis of cognitive-behavioural treatment for depression. Journal of Consulting and Clinical Psychology, 2: 295-304.
43. Jacobson, N. and Hollon, S. (1996) Cognitive-behaviour therapy versus pharmacotherapy: Now that the jury’s returned its verdict, it’s time to present the rest of the evidence. Journal of Consulting and Clinical Psychology, 64: 74-80.
44. Jadad, A. (1998) Randomised Controlled Trials: A User’s Guide. London: BMJ Books.
45. Kazdin, A. (1982) Single Case Research Designs: Methods For Clinical and Applied Settings. New York: Oxford University Press.
46. Kazdin, A. (1986) Comparative outcome studies of psychotherapy: Methodological issues and strategies. Journal of Consulting and Clinical Psychology, 54: 95-105.
47. Kazdin, A. and Wilcoxon, L. (1976) Systematic desensitization and nonspecific treatment effects: A methodological evaluation. Psychological Bulletin, 83: 729-758.
48. Kendall, P. and Lipman, A. (1991) Psychological and pharmacological therapy: Methods and modes for comparative outcome research. Journal of Consulting and Clinical Psychology, 59: 78-87.
49. King, M (1997) Brief psychotherapy in general practice: how do we measure outcome? British Journal of General Practice, 47: 136-137.
50. Kleijnen, J., Gøtzsche, P., Kunz, R., Oxman, A. and Chalmers, I. (1997) So what’s so special about randomisation? in A. Maynard and I. Chalmers (eds) Non-random Reflections on Health Services Research. London: BMJ Publishing Group, 93-106.
51. Klein, D. (1996) Preventing hung juries about therapy studies. Journal of Consulting and Clinical Psychology, 64: 81-87.
52. Kline, P. (1992) Problems of methodology in studies of psychotherapy, in W. Dryden and C. Feltham (eds) Psychotherapy and its Discontents. Bristol: Open University Press, 64-99.
53. Kunz, R. and Oxman, A. (1998) The unpredictability paradox: Review of empirical comparisons of randomised and non-randomised clinical trials. British Medical Journal, 317: 1185-1190.
54. Luborsky, L. and Singer, B. (1975) Comparative studies of psychotherapies: Is it true that everyone has won and all must have prizes? Archives of General Psychiatry, 32: 995-1008.
55. McClellan, M., McNeil, B. and Newhouse, J. (1994) Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? Journal of the American Medical Association, 272: 859-866.
56. McKay, J., Alterman, A., McLellan, T., Snider, E. and O’Brien, C. (1995) Effect of random versus non-random assignment in a comparison of inpatient and day hospital rehabilitation for male alcoholics. Journal of Consulting and Clinical Psychology, 63: 70-78.
57. Mahoney, M. (1978) Experimental methods and outcome evaluation. Journal of Consulting and Clinical Psychology, 46: 660-672.
58. Meehl, P. (1954) Clinical Versus Statistical Prediction: A Theoretical Analysis and Review of the Evidence. Minneapolis: University of Minnesota Press.
59. Mirowsky, J. and Ross, C. (1989) Psychiatric diagnosis as reified measurement. Journal of Health and Social Behaviour, 30: 11-25.
60. Moncrieff, J., Wessely, S. and Hardy, R. (1998) Meta-analysis of trials comparing antidepressants with active placebos. British Journal of Psychiatry, 172: 227-231.
61. O’Leary, K. and Borkovec, T. (1978) Conceptual, methodological and ethical problems of placebo groups in psychotherapy research. American Psychologist, 33: 821-830.
62. Orne, M. (1962) On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17: 776-783.
63. Parloff, M. (1982) Psychotherapy research evidence and reimbursement decisions: Bambi meets Godzilla. American Journal of Psychiatry, 139: 718-727.
64. Parloff, M. (1986) Placebo controls in psychotherapy research: A sine qua non or a placebo for research problems? Journal of Consulting and Clinical Psychology, 54: 79-87.
65. Paul, G. (1967) Strategy of outcome research in psychotherapy. Journal of Consulting Psychology, 31: 109-118.
66. Persons, J. (1991) Psychotherapy outcome studies do not accurately represent current models of psychotherapy: A proposed remedy. American Psychologist, 46: 99-106.
67. Persons, J. and Silberschatz, G. (1998) Are results of randomised controlled trials useful to psychotherapists? Journal of Consulting and Clinical Psychology, 66: 126-135.
68. Rice, L. and Greenberg, L. (1984) Patterns of Change. New York: Guilford Press.
69. Roberts, C. and Sibbald, B. (1998) Randomising groups of patients. British Medical Journal, 316: 1898.
70. Roberts, C. and Torgerson, D. (1999) Baseline imbalance in randomised controlled trials. British Medical Journal, 319: 185.
71. Roth, A. and Fonagy, P. (1996) What Works for Whom? A Critical Review of Psychotherapy Research. London: Guilford.
72. Sackett, D., Haynes, R., Guyatt, G. and Tugwell, P. (1991) Clinical Epidemiology: A Basic Science for Clinical Medicine (2nd edn). Boston: Little, Brown & Company.
73. Sackett, D., Rosenberg, W., Gray, J., Haynes, R. and Richardson, W. (1996) Evidencebased medicine: What it is and what it is not. British Medical Journal, 312: 71-72.
74. Salkovskis, P. (1995) Demonstrating specific effects in cognitive and behavioural therapy, in M. Aveline and D. Shapiro (eds) Research Foundations for Psychotherapy Practice, Chichester: Wiley, 191-228.
75. Schulz, K., Chalmers, I., Hayes, R. and Altman, D. (1995) Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. Journal of the American Medical Association, 273: 408-412.
76. Schwartz, D. and Lellouch, J. (1967) Explanatory and pragmatic attitudes in therapeutic trials. Journal of Chronic Diseases, 20: 637-648.
77. Scott, A. and Freeman, C. (1992) Edinburgh primary care depression study: Treatment outcome, patient satisfaction, and cost after 16 weeks. British Medical Journal, 304: 883-887.
78. Sechrest, L., McKnight, P. and McKnight, K. (1996) Calibration of measures for psychotherapy outcome studies. American Psychologist, 51: 1065-1071.
79. Seligman, M. (1995) The effectiveness of psychotherapy: The consumer reports study. American Psychologist, 50: 965-974.
80. Seligman, M. (1996) Science as an ally of practice. American Psychologist, 51: 1072-1079.
81. Shadish, W., Navarro, A., Crits-Christoph, P., Jorm, A., Nietzel, M., Robinson, L., Svartberg, M., Matt, G., Siegle, G., Hazelrigg, M., Lyons, L., Prout, H., Smith, M. and Weiss, B. (1997) Evidence that therapy works in clinically representative populations. Journal of Consulting and Clinical Psychology, 65: 355-365.
82. Shapiro, D. (1980) Science and psychotherapy: The state of the art. British Journal of Medical Psychology, 53: 1-10.
83. Shapiro, D.A. and Shapiro, D. (1983) Meta-analysis of comparative therapy outcome studies: A replication and refinement. Psychological Bulletin, 92: 581-604.
84. Smith, B. and Sechrest, L. (1991) Treatment of aptitude x treatment interactions. Journal of Consulting and Clinical Psychology, 59: 233-244.
85. Smith, M. and Glass, G. (1977) Meta-analysis of psychotherapy outcome studies. American Psychologist, 32: 752-760.
86. Smith, M., Glass, G. and Miller, T. (1980) The Benefits of Psychotherapy. Baltimore: Johns Hopkins University Press.
87. Spector, E. (1981) Research Designs. London: Sage Publications.
88. Strube, M. (1991) Small sample failure of random assignment: A further examination. Journal of Consulting and Clinical Psychology, 59: 346-350.
89. Strupp, H. (1996) The tripartite model and the Consumer Reports study. American Psychologist, 51: 1017-1024.
90. Tanenbaum, S. (1993) What physicians know. New England Journal of Medicine, 329: 1268-1270.
91. Torgerson, D., Klaber-Moffett, J. and Russell, I. (1996) Patient preferences in randomised trials: Threat or opportunity? Journal of Health Services Research and Policy, 1: 194-197.
92. Torgerson, D. and Sibbald, B. (1998) What is a patient preference trial? British Medical Journal, 316: 360.
93. Treasure, T. and MacRae, K. (1998) Minimisation: The platinum standard for trials? British Medical Journal, 317: 362-363.
94. Tversky, A. and Kahneman, D. (1974) Judgement under uncertainty: Heuristics and biases. Science, 185: 1124-1131.
95. Von Korff, M. and Simon, G. (1994) Methodologic perspective: Getting answers to the most important questions, in J. Miranda, A. Hohmann, C. Attkisson and D. Larson (eds) Mental Disorders in Primary Care. San Francisco: Jossey-Bass, 421-447.
96. Weisz, J., Weiss, B. and Donneberg, G. (1992) The lab versus the clinic: Effects of child and adolescent psychotherapy. American Psychologist, 47: 1578-1585.
97. Wessely, S., Rose, S. and Bisson, J. (1998) A systematic review of brief psychological interventions (debriefing) for the treatment of immediate trauma and the prevention of PTSD (Cochrane Review), in The Cochrane Library, Issue 3. Oxford: Update Software.
98. Zelen, M. (1979) A new design for randomised clinical trials. New England Journal of Medicine, 300: 1242-1245.