Some Problems with Randomized Controlled Trials and Some Viable Alternatives

Clinical Psychology and Psychotherapy

Volumn 23, Issue 1, 2016, Pages 87-95

  Carey, Timothy A ^a   Stiles, William B ^b  

^a CHARLES DARWIN UNIVERSITY   (Australia)

^b MIAMI UNIVERSITY   (United States)

Author keywords

Gold standard; Randomized controlled trial; Treatment outcomes

Indexed keywords

HUMAN; MENTAL DISORDERS; PROCEDURES; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL (TOPIC);

HUMANS; MENTAL DISORDERS; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 85014559688     PISSN: 10633995     EISSN: 10990879     Source Type: Journal    
DOI: 10.1002/cpp.1942     Document Type: Article

References (45)

1. Bickman, L., & Reich, S. M. (2009). Randomized controlled trials. A gold standard with feet of clay? In S. I. Donaldson, C. A. Christie, & M. M. Mark (Eds.), What counts as credible evidence in applied research and evaluation practice? (pp. 51-77). Los Angeles: Sage.
2. Blampied, N. M. (2001). The third way: Single-case research, training, and practice in clinical psychology. Australian Psychologist, 36(2), 157-163.
3. Bohart, A. (2000). The client is the most important common factor: Clients' self-healing capacities and psychotherapy. Journal of Psychotherapy Integration, 10(2), 127-149.
4. Bohart, A. C., Tallman, K. L., Byock, G., & Mackrill, T. (2011). The "Research Jury Method": The application of the Jury Trial Model to evaluating the validity of descriptive and causal statements about psychotherapy process and outcome. Pragmatic Case Studies in Psychotherapy, Retrieved from http://pcsp.libraries.rutgers.edu 7, Module 1, Article 8, 101-144.
5. Bracken, M. B. (2013). Risk, change, and causation. New Haven, CT: Yale University Press.
6. Bradford Hill, A. (1951). The clinical trial. British Medical Bulletin, 7(4), 278-83.
7. Budd, R., & Hughes, I. (2009). The Dodo Bird verdict - controversial, inevitable and important: A commentary on 30 years of meta-analyses. Clinical Psychology & Psychotherapy, 16, 510-522.
8. Carey, T. A. (2005). Can patients specify treatment parameters? Clinical Psychology and Psychotherapy: An International Journal of Theory and Practice, 12(4), 326-335.
9. Carey, T. A., Carey, M., Mullan, R. J., Spratt, C. G., & Spratt, M. B. (2009). Assessing the statistical and personal significance of the Method of Levels. Behavioural and Cognitive Psychotherapy, 37, 311-324.
10. Carey, T. A., & Mullan, R. J. (2008). Evaluating the Method of Levels. Counselling Psychology Quarterly, 21(3), 1-10.
11. Carey, T. A., Tai, S. J., & Stiles, W. B. (2013). Effective and efficient: Using patient-led appointment scheduling in routine mental health practice in remote Australia. Professional Psychology: Research and Practice, 44, 405-414.
12. Christie, C. A., & Fleischer, D. (2009). Social inquiry paradigms as a frame for the debate on credible evidence. In S. I. Donaldson, C. A. Christie, & M. M. Mark (Eds.), What counts as credible evidence in applied research and evaluation practice? (pp. 19-30). Los Angeles: Sage.
13. Elliott, R. (2002). Hermeneutic single case efficacy design. Psychotherapy Research, 12, 1-20.
14. Elliott, R. (2010). Psychotherapy change process research: Realizing the promise. Psychotherapy Research, 20, 123-135.
15. Greenberg, L. S. (1984). Task analysis: The general approach. In L. N. Rice & L. S. Greenberg (Eds.), Patterns of change: Intensive analysis of psychotherapy process (pp. 124-148). New York: Guilford Press.
16. Greenberg, L. S. (2007). A guide to conducting a task analysis of psychotherapeutic change. Psychotherapy Research, 17, 15-30.
17. Greenberg, L. S., & Foerster, F. S. (1996). Task analysis exemplified: The process of resolving unfinished business. Journal of Consulting and Clinical Psychology, 64, 439-446.
18. Haaga, D. A. F., & Stiles, W. B. (2000). Randomized clinical trials in psychotherapy research: Methodology, design, and evaluation. In C. R. Snyder & R. E. Ingram (Eds.), Handbook of psychological change: Psychotherapy processes and practices for the 21st century (pp. 14-39). New York: Wiley.
19. Healy, D. (2012). Pharmageddon. Los Angeles, CA: University of California Press.
20. Hemmings, A. (2000). A systematic review of the effectiveness of brief psychological therapies in primary health care. Families, Systems & Health, 18, 279-313.
21. Hsu, L. M. (2003). Random sampling, randomization, and equivalence of contrasted groups in psychotherapy outcome research. In A. E. Kazdin (Ed.), Methodological issues and strategies in clinical research (3rd ed.). (pp. 147-161). Washington, DC: American Psychological Association. [Reprinted from the Journal of Consulting and Clinical Psychology, 57, 131-137.]
22. Jadad, A., & Enkin, M. (2007). Randomized controlled trials: Questions, answers, and musings (2nd ed.). Malden, MA: Blackwell Publishing.
23. Kazdin, A. E. (2011). Single-case research designs (2nd ed.). New York: Oxford University Press.
24. Kessler, R. C., Andrews, G., Colpe, L. J., Hiripi, E., Mroczek, D. K., Normand, S-L. T., Walters, E. E., & Zaslavsky, A. M. (2002). Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine, 32, 959-956.
25. Krause, M. S., & Howard, K. I. (2003). What random assignment does and does not do. Journal of Clinical Psychology, 59(7), 751-766.
26. Krause, M. S., & Lutz, W. (2009). Process transforms inputs to determine outcomes: Therapists are responsible for managing process. Clinical Psychology: Science and Practice, 16, 73-81.
27. Kuhn, T. S. (1970). The structure of scientific revolutions. Chicago: Chicago University Press.
28. Lambert, M. J. (1992). Psychotherapy outcome research: Implications for integrative and eclectic theories. In J. C. Norcross & M. R. Goldfried (Eds), Handbook of psychotherapy integration (pp. 94-129). New York: Basic Books.
29. Lewis, C. C., Simons, A. D., & Kim, H. K. (2012). The role of early symptom trajectories and pretreatment variables in predicting treatment response to cognitive behavioral therapy. Journal of Consulting and Clinical Psychology, 80(4), 525-534.
30. Miller, S. D., & Duncan, B. L. (2004). The outcome and session rating scales: Administration and scoring manual. Chicago: Institute for the Study of Therapeutic Change.
31. Minami, T., Wampold, B. E., Serlin, R. C., Kircher, J. C., Brown, G. S. (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75(2), 232-243.
32. Minami, T., & Wampold, B. E. (2008). Adult psychotherapy in the real world. Biennial Review of Counseling Psychology, 1, 27-45.
33. Murugesan, G., Amey, C. G., Deane, F. P., Jeffrey, R., Kelly, B., & Stain, H. (2007). Inpatient psychosocial rehabilitation in rural NSW: Assessment of clinically significant change for people with severe mental illness. Australian and New Zealand Journal of Psychiatry, 41, 343-350.
34. NHMRC. (1999). A guide to the development, implementation and evaluation of clinical practice guidelines. Canberra: Commonwealth of Australia. Retrieved on 10 March 2014 from http://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/cp30.pdf
35. Pawson, R., & Tilley, N. (1997). Realistic evaluation. Los Angeles: Sage.
36. Pascual-Leone, A., Greenberg, L. S., & Pascual-Leone, J. (2014). Task analysis: New developments for programmatic research on the process of change. In W. Lutz & S. Knox (Eds.), Quantitative and qualitative methods in psychotherapy research (pp. 249-273). London: Taylor & Francis Books.
37. Paul, G. L. (1967). Strategy of outcome research in psychotherapy. Journal of Counseling Psychology, 31(2), 109-118.
38. Persons, J. B., & Silberschatz, G. (2009). Are results of randomized controlled trials useful to psychotherapists? In A. E. Kazdin (Ed.), Methodological issues and strategies in clinical research (3rd ed.) (pp. 547-568). Washington, DC: American Psychological Association. [Reprinted from the Journal of Consulting and Clinical Psychology, 66, 126-135.]
39. Rennie, D. L. (2000). Grounded Theory Methodology as Methodical Hermeneutics: Reconciling realism and relativism. Theory & Psychology, 10(4), 481-502.
40. Rice, L. N., & Saperia, E. P. (1984). Task analysis and the resolution of problematic reactions. In L. N. Rice & L. S. Greenberg (Eds.), Patterns of change (pp. 29-66). New York: Guilford.
41. Stiles, W. B. (2009a). Logical operations in theory-building case studies. Pragmatic Case Studies in Psychotherapy, 5(3), 9-22. Available: http://jrul.libraries.rutgers.edu/index.php/pcsp/article/view/973/2384
42. Stiles, W. B. (2009b). Responsiveness as an obstacle for psychotherapy outcome research: It's worse than you think. Clinical Psychology: Science and Practice, 16, 86-91.
43. Stiles, W. B. (2013). The variables problem and progress in psychotherapy research. Psychotherapy, 50, 33-41.
44. Stiles, W. B. (in press). Theory-building, enriching, and fact-gathering: Alternative purposes of psychotherapy research. In O. Gelo, A. Pritz, & B. Rieken (Eds.), Psychotherapy research: General issues, process, and outcome. New York: Springer-Verlag.
45. West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., Szapocznik, J., Fishbein, M., Rapkin, B., Caltts, M., & Dolan Mullen, P. (2008). Alternatives to the randomized controlled trial. American Journal of Public Health, 98, 1359-1366.