Looking both ways

Psychotherapy Research

Volumn 25, Issue 3, 2015, Pages 282-293

  Stiles, William B ^a,b   Hill, Clara E ^c   Elliott, Robert ^d  

^a MIAMI UNIVERSITY   (United States)

^b APPALACHIAN STATE UNIVERSITY   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

^d UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

outcome research; politically expedient research; process research; psychotherapy; theory building; therapist techniques

Indexed keywords

EVIDENCE BASED PRACTICE; HUMAN; PRACTICE GUIDELINE; PSYCHOTHERAPY; TREATMENT OUTCOME;

EVIDENCE-BASED PRACTICE; HUMANS; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PRACTICE GUIDELINES AS TOPIC; PSYCHOTHERAPEUTIC PROCESSES; PSYCHOTHERAPY;

EID: 84928587984     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503307.2014.981681     Document Type: Article

References (104)

1. Bohart, A. C., & Tallman, K. (1999). How clients make therapy work: The process of active self-healing. Washington, DC: American Psychological Association.
2. Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297–312. doi:10.1037/h0040950
3. Carkhuff, R. R. (1969). Human and helping relations (Vols. 1 & 2). New York, NY: Holt, Rinehart, & Winston.
4. Caro Gabalda, I., & Stiles, W. B. (2013). Irregular assimilation progress: Reasons for setbacks in the context of linguistic therapy of evaluation. Psychotherapy Research, 23, 35–53. doi:10.1080/10503307.2012.721938
5. Carroll, L. (1865). Alice's adventures in Wonderland. London: MacMillan.
6. Castonguay, L., Barkham, M., Lutz, W., & McAleavey, A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 85–133). New York, NY: Wiley.
7. Castonguay, L. G., Goldfried, M. R., Wiser, S., Raue, P. J., & Hayes, A. M. (1996). Predicting the effect of cognitive therapy for depression: A study of unique and common factors. Journal of Consulting and Clinical Psychology, 64, 497–504. doi:10.1037/0022-006X.64.3.497
8. Clark, D. M., Fairburn, C. G., & Wessely, S. (2008). Psychological treatment outcomes in routine NHS services: A commentary on Stiles et al. (2007). Psychological Medicine, 38, 629–634. doi:10.1017/S0033291707001869
9. Cunha, C., Goncalves, M. M., Hill, C. E., Mendes, I., Ribiero, A. P., Angus, L., & Greenberg, L. S. (2012). Therapist interventions and client innovative moments in emotion-focused therapy for depression. Psychotherapy, 49, 536–548. doi:10.1037/a0028259
10. Doucette, A., & Wolf, A.W. (2009). Questioning the measurement precision of psychotherapy research. Psychotherapy Research, 19, 374–389. doi:10.1080/10503300902894422
11. Elliott, R. (1985). Helpful and nonhelpful events in brief counseling interviews: An empirical taxonomy. Journal of Counseling Psychology, 32, 307–322. doi:10.1037/0022-0167.32.3.307
12. Elliott, R. (1989). Comprehensive process analysis: Understanding the change process in significant therapy events. In M. Packer & R. B. Addison (Eds.), Entering the circle: Hermeneutic investigation in psychology (pp. 165–184). Albany, NY: SUNY Press.
13. Elliott, R. (1998). Editor's introduction: A guide to the empirically supported treatments controversy. Psychotherapy Research, 8, 115–125. doi:10.1080/10503309812331332257
14. Elliott, R. (2013). Person-centered-experiential psychotherapy for anxiety difficulties: Theory, research and practice. Person-Centered and Experiential Psychotherapies, 12, 14–30. doi:10.1080/14779757.2013.767750
15. Elliott, R., Hill, C. E., Stiles, W. B., Friedlander, M. L., Mahrer, A. R., & Margison, F. R. (1987). Primary therapist response modes: Comparison of six rating systems. Journal of Consulting and Clinical Psychology, 55, 218–223. doi:10.1037/0022-006X.55.2.218
16. Elliott, R., Partyka, R., Wagner, J., Alperin, R., Dobrenski, R., Messer, S. B., Castonguay, L. G. (2009). An adjudicated hermeneutic single-case efficacy design of experiential therapy for panic/phobia. Psychotherapy Research, 19, 543–557. doi:10.1080/10503300902905947 Appendices available at: http://www.informaworld.com/smpp/content∼content=a914761426∼db=all∼tab=multimedia
17. Elliott, R., Shapiro, D. A., Firth-Cozens, J., Stiles, W. B., Hardy, G., Llewelyn, S. P., & Margison, F. (1994). Comprehensive process analysis of insight events in cognitive-behavioral and psychodynamic-interpersonal therapies. Journal of Counseling Psychology, 41, 449–463. doi:10.1037/0022-0167.41.4.449
18. Elliott, R., Stiles, W. B., & Shapiro, D. A. (1993). Are some psychotherapies more equivalent than others? In T. R. Giles (Ed.), Handbook of effective psychotherapy (pp. 455–479). New York, NY: Plenum Press.
19. Elliott, R., Watson, J., Greenberg, L. S., Timulak, L., & Freire, E. (2013). Research on humanistic-experiential psychotherapies. In M. J. Lambert (Ed.), Bergin & Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 495–538). New York, NY: Wiley.
20. Fishman, D. B. (1999). The case for pragmatic psychology. New York: New York University Press.
21. Frommer, J., Langenbach, M., & Streeck, U. (2004). Qualitative psychotherapy research in German-speaking countries. Psychotherapy Research, 14, 57–75. doi:10.1093/ptr/kph004
22. Goldfried, M. R. (1980). Toward the delineation of therapeutic change principles. American Psychologist, 35, 991–999. doi:10.1037/0003-066X.35.11.991
23. Haaga, D. A. F., & Stiles, W. B. (2000). Randomized clinical trials in psychotherapy research: Methodology, design, and evaluation. In C. R. Snyder & R. E. Ingram (Eds.), Handbook of psychological change (pp. 14–39). New York, NY: Wiley.
24. Heaton, K. J., Hill, C. E., & Edwards, L. A. (1995). A comparison of three methods of assessing therapist techniques. Psychotherapy Research, 5, 141–152.
25. Hill, C. E. (1978). Development of a counselor verbal response category system. Journal of Counseling Psychology, 25, 461–468. doi:10.1037/0022-0167.25.5.461
26. Hill, C. E. (1989). Therapist techniques and client outcomes: Eight cases of brief psychotherapy. Newbury Park, CA: SAGE.
27. Hill, C. E. (2005). Therapist techniques, client involvement, and the therapeutic relationship: Inextricably intertwined in the therapy process. Psychotherapy: Theory, Research, Practice, Training, 42, 431–442. doi:10.1037/0033-3204.42.4.431
28. Hill, C. E. (Ed.). (2012). Consensual qualitative research: A practical resource for investigating social science phenomena. Washington, DC: American Psychological Association.
29. Hill, C. E. (2014). Helping skills: Facilitating exploration, insight, and action (4th ed.). Washington, DC: American Psychological Association.
30. Hill, C. E., Gelso, C. J., Chui, H., Spangler, P., Hummel, A., Huang, T., Miles, J. R. (2014). To be or not to be immediate with clients: The use and effects of immediacy in psychodynamic/interpersonal psychotherapy. Psychotherapy Research, 24, 299–315. doi:10.1080/10503307.2013.812262
31. Hill, C. E., Helms, J. E., Tichenor, V., Spiegel, S. B., O'Grady, K. E., & Perry, E. S. (1988). The effects of therapist response modes in brief psychotherapy. Journal of Counseling Psychology, 35, 222–233. doi:10.1037//0022-0167.35.3.222
32. Hill, C. E., & Knox, S. (2009). Processing the therapeutic relationship. Psychotherapy Research, 19, 13–29. doi:10.1080/10503300802621206
33. Hill, C. E., Sim, W., Spangler, P., Stahl, J., Sullivan, C., & Teyber, E. (2008). Therapist immediacy in brief psychotherapy: Case study II. Psychotherapy: Theory, Research, Practice, Training, 45, 298–315. doi:10.1037/a0013306
34. Hill, C. E., Thames, T. B., & Rardin, D. K. (1979). Comparison of Rogers, Perls, and Ellis on the hill counselor verbal response category system. Journal of Counseling Psychology, 26, 198–203. doi:10.1037/0022-0167.26.3.198
35. Hill, C. E., Thompson, B. J., & Williams, E. N. (1997). A guide to conducting consensual qualitative research. The Counseling Psychologist, 25, 517–572. doi:10.1177/0011000097254001
36. Hilsenroth, M. J., Blagys, M. D., Ackerman, S. J., Bonge, D. R., & Blais, M. A. (2005). Measuring psychodynamic-interpersonal and cognitive-behavioral techniques: Development of the comparative psychotherapy process scale. Psychotherapy: Theory, Research, Practice, and Training, 42, 340–356. doi:10.1037/0033-3204.42.3.340
37. Hofmeister, B. (2010). The person-centered approach in Germany: To cut a long story short. Person-Centered and Experiential Psychotherapies, 9(1), 1–13. doi:10.1080/14779757.2010.9688500
38. Hunsley, J., & Di Giulio, G. (2002). Dodo bird, phoenix, or urban legend? The question of psychotherapy equivalence. The Scientific Review of Mental Health Practice, 1(1). Retrieved from www.srmhp.org/0101/psychotherapy-equivalence.html
39. Imel, Z. E., Steyvers, M., & Atkins, D. C. (in press). Computational psychotherapy: Scaling up the evaluation of patient provider interactions. Psychotherapy.
40. Ivey, A. E. (1971). Microcounseling: Innovations in interviewing training. Springfield, IL: Charles C. Thomas.
41. Jackson, J., Chui, H., & Hill, C. E. (2012). The modification of CQR for case study research: An introduction to CQR-C. In C. E. Hill (Ed.), Consensual qualitative research: A practical resource for investigating social science phenomena (pp. 285–303). Washington, DC: American Psychological Association.
42. Jones, E. E., & Pulos, S. M. (1993). Comparing the process in psychodynamic and cognitivebehavioral therapies. Journal of Consulting and Clinical Psychology, 61, 306–316. doi:10.1037/0022-006x.61.2.306
43. Kasper, L., Hill, C. E., & Kivlighan, D. (2008). Therapist immediacy in brief psychotherapy: Case study I. Psychotherapy: Theory, Research, Practice, Training, 45, 281–287. doi:10.1037/a0013305
44. Keefe, J. R., McCarthy, K. S., Dinger, U., Zilcha-Mano, S., & Barber, J. P. (2014). A meta-analytic review of psychodynamic therapies for anxiety disorders. Clinical Psychology Review, 34, 309–323. doi:10.1016/j.cpr.2014.03.004
45. Kenny, D. A., & Hoyt, W. T. (2009). Multiple levels of analysis in psychotherapy research. Psychotherapy Research, 19, 462–468. doi:10.1080/10503300902806681
46. Kuhn, T. S. (1970). The structure of scientific revolutions. Chicago: University of Chicago Press.
47. Lambert, M. J. (2013). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin & Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 169–218). New York, NY: Wiley.
48. Leichsenring, F., Salzer, S., Beutel, M. E., Herpertz, S., Hiller, W., Hoyer, J., Leibing, E. (2013). Psychodynamic therapy and cognitive-behavioral therapy in social anxiety disorder: A multicenter randomized controlled trial. American Journal of Psychiatry, 170, 759–767. doi:10.1176/appi.ajp.2013.12081125
49. Leiman, M., & Stiles, W. B. (2001). Dialogical sequence analysis and the zone of proximal development as conceptual enhancements to the assimilation model: The case of Jan revisited. Psychotherapy Research, 11, 311–330. doi:10.1080/713663986
50. Levins, R. (1968). Evolution in changing environments: Some theoretical explorations. Princeton, NJ: Princeton University Press.
51. Lilienfeld, S. O. (2007). Psychological treatments that cause harm. Perspectives on Psychological Science, 2, 53–70. doi:10.1111/j.1745-6916.2007.00029.x
52. Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Schweizer, E. (1999). The researcher's own therapy allegiances: A “wild card” in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6, 95–106.
53. Luborsky, L., Rosenthal, R., Diguer, L., Andrusyna, T. P., Berman, J. S., Levitt, J. T., Krause, E. D. (2002). The Dodo bird verdict is alive and well – mostly. Clinical Psychology: Science and Practice, 9(1), 2–12. doi:10.1093/clipsy/9.1.2
54. Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that “everyone has won and all must have prizes”? Archives of General Psychiatry, 32, 995–1008. doi:10.1001/archpsyc.1975.01760260059004
55. MacLeod, R., & Elliott, R. (2012). Emotion-focused therapy for social anxiety: A hermeneutic single-case efficacy design study of a low-outcome case. Counselling Psychology Review, 27, 7–22.
56. MacLeod, R., Elliott, R., & Rodgers, B. (2012). Process-experiential/emotion-focused therapy for social anxiety: A hermeneutic single-case efficacy design study. Psychotherapy Research, 22, 67–81. doi:10.1080/10503307.2011.626805
57. Mahrer, A. R. (1980, September). Psychotherapy process research: A preview of the next decade. Symposium presented at the American Psychological Association Convention, Montreal, Quebec, Canada.
58. McCarthy, K. S., & Barber, J. P. (2009). The multitheoretical list of therapeutic interventions (MULTI): Initial report. Psychotherapy Research, 19, 96–113.
59. McLeod, J. (2010). Case study research in counselling and psychotherapy. London: SAGE.
60. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(6), e1000097. doi:10.1371/journal.pmed1000097
61. Murphy, D. (2013). BAPCA practice research network. Retrieved from http://www.bapca.org.uk/blog/538-bapca-practice-research-network.html
62. National Collaborating Centre for Mental Health. (2009). Depression: The treatment and management of depression in adults (update) (NICE clinical guideline 90). London: National Institute for Clinical Excellence. Retrieved from www.nice.org.uk/CG90
63. National Collaborating Centre for Mental Health. (2010). Schizophrenia: The NICE guideline on core interventions in the treatment and management of schizophrenia in adults in primary and secondary care (Updated edition). London: National Institute for Clinical Excellence. Retrieved from www.nice.org.uk/CG82
64. Nezu, A. M., & Nezu, C. M. (2008). Evidence-based outcome research: A practical guide to conducting randomized controlled trials for psychosocial interventions. Oxford: Oxford University Press, ISBN 978-0-19-530463-3.
65. Norcross, J. (Ed.). (2011). Psychotherapy relationships that work (2nd ed.). New York, NY: Oxford University Press.
66. Orlinsky, D. E., Grawe, K., & Parks, B. K. (1994). Process and outcome in psychotherapy - Noch einmal. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 270–376). New York, NY: Wiley.
67. Peräkylä, A., Antaki, C., Vehviläinen, S., & Leudar, I. (Eds.). (2008). Conversation analysis and psychotherapy. Cambridge: Cambridge University Press.
68. Pinto-Coelho, K. G., & Hill, C. E. (June, 2014). Characterizing therapist self-disclosure in psychodynamic psychotherapy. Paper presented at the Society for Psychotherapy Research, Copenhagen, Denmark.
69. Porter, E. H. Jr. (1943). The development and evaluation of a measure of counseling interview procedures. Educational and Psychological Measurement, 3, 105–126. doi:10.1177/001316444300300111
70. Rennie, D. L. (2000). Grounded theory methodology as methodological hermeneutics: Reconciling realism and relativism. Theory & Psychology, 10, 481–502. doi:10.1177/0959354300104003
71. Rennie, D. L. (2004). Anglo-North American qualitative counseling and psychotherapy research. Psychotherapy Research, 14, 37–55. doi:10.1093/ptr/kph003
72. Rennie, D. L., Phillips, J. R., & Quartaro, G. K. (1988). Grounded theory: A promising approach to conceptualization in psychology? Canadian Psychology, 29, 139–150. doi:10.1037/h0079765
73. Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990). Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin, 108(1), 30–49. doi:10.1037/0033-2909.108.1.30
74. Rogers, C. R. (1942a). Counseling and psychotherapy. Boston: Houghton Mifflin.
75. Rogers, C. R. (1942b). The use of electrically recorded interviews in improving psychotherapeutic techniques. American Journal of Orthopsychiatry, 12, 429–434. doi:10.1111/j.1939-0025.1942.tb05930.x
76. Rosenzweig, S. (1936). Some implicit common factors in diverse methods of psychotherapy. American Journal of Orthopsychiatry, 6, 412–415. doi:10.1111/j.1939-0025.1936.tb05248.x
77. Safran, J. D., & Muran, J. C. (2000). Negotiating the therapeutic alliance: A relational treatment guide. New York, NY: Guilford.
78. Safran, J. D., Muran, J. C., & Eubanks-Carter, C. (2011). Repairing alliance ruptures. Psychotherapy, 48, 80–87. doi:10.1037/a0022140
79. Sales, C. M. D., & Alves, P. C. G. (2012). Individualized patient-progress systems: Why we need to move towards a personalized evaluation of psychological treatments. Canadian Psychology/Psychologie canadienne, 53, 115–121. doi:10.1037/a0028053
80. Snyder, W. U. (1945). An investigation of the nature of non-directive psychotherapy. Journal of General Psychology, 33, 193–223. doi:10.1080/00221309.1945.10544506
81. Society for Clinical Psychology. (2014). Website on research-supported psychological treatments. Retrieved from http://www.psychologicaltreatments.org/
82. Spielmans, G. I., Pasek, L. F., & McFall, J. P. (2007). What are the active ingredients in cognitive and behavioral psychotherapy for anxious and depressed children? A meta-analytic review. Clinical Psychology Review, 27, 642–654. doi:10.1016/06.001
83. Stephen, S., Elliott, R., & MacLeod, R. (2011). Person-centred therapy with a client experiencing social anxiety difficulties: A hermeneutic single case efficacy design. Counselling and Psychotherapy Research, 11, 55–66. doi:10.1080/14733145.2011.546203
84. Stiles, W. B. (1979). Verbal response modes and psychotherapeutic technique. Psychiatry, 42, 49–62.
85. Stiles, W. B. (1993). Quality control in qualitative research. Clinical Psychology Review, 13, 593–618. Retrieved from http://dx.doi.org/10.1016/0272-7358(93)90048-Q
86. Stiles, W. B. (2002). Assimilation of problematic experiences. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients (pp. 357–365). New York, NY: Oxford University Press.
87. Stiles, W. B. (2009). Logical operations in theory-building case studies. Pragmatic Case Studies in Psychotherapy, 5(3), 9–22. Retrieved from http://jrul.libraries.rutgers.edu/index.php/pcsp/article/view/973/2384
88. Stiles, W. B. (2011). Coming to terms. Psychotherapy Research, 21, 367–384. doi:10.1080/10503307.2011.582186
89. Stiles, W. B. (in press). Theory-building, enriching, and fact-gathering: Alternative purposes of psychotherapy research. In O. Gelo, A. Pritz, & B. Rieken (Eds.), Psychotherapy research: General issues, process, and outcome. New York, NY: Springer-Verlag.
90. Stiles, W. B., Barkham, M., Mellor-Clark, J., & Connell, J. (2008). Routine psychological treatment and the Dodo verdict: A rejoinder to Clark et al. (2007). Psychological Medicine, 38, 905–910. doi:10.1017/S0033291708002717
91. Stiles, W. B., Elliott, R., Llewelyn, S. P., Firth-Cozens, J. A., Margison, F. R., Shapiro, D. A., & Hardy, G. (1990). Assimilation of problematic experiences by clients in psychotherapy. Psychotherapy, 27, 411–420. doi:10.1037/0033-3204.27.3.411
92. Stiles, W. B., Honos-Webb, L., & Surko, M. (1998). Responsiveness in psychotherapy. Clinical Psychology: Science and Practice, 5, 439–458. doi:10.1111/j.1468-2850.1998.tb00166.x
93. Stiles, W. B., Meshot, C. M., Anderson, T. M., & Sloan, W. W., Jr. (1992). Assimilation of problematic experiences: The case of John Jones. Psychotherapy Research, 2, 81–101. doi:10.1080/10503309212331332874
94. Stiles, W. B., & Shapiro, D. A. (1994). Disabuse of the drug metaphor: Psychotherapy process-outcome correlations. Journal of Consulting and Clinical Psychology, 62, 942–948. doi:10.1037/0022-006X.62.5.942
95. Stiles, W. B., Shapiro, D. A., & Elliott, R. (1986). Are all psychotherapies equivalent? American Psychologist, 41, 165–180. doi:10.1037/0003-066X.41.2.165
96. Stiles, W. B., Shapiro, D. A., & Firth-Cozens, J. A. (1988). Verbal response mode use in contrasting psychotherapies: A within-subjects comparison. Journal of Consulting and Clinical Psychology, 56, 727–733. doi:10.1037/0022-006X.56.5.727
97. Stiles, W. B., & Sultan, F. E. (1979). Verbal response mode use by clients in psychotherapy. Journal of Consulting and Clinical Psychology, 47, 611–613. doi:10.1037/0022-006X.47.3.611
98. Sutherland, O., Peräkylä, A., & Elliott, R. (2014). Conversation analysis of the two chair self-soothing task in emotion-focused therapy. Psychotherapy Research, 24, 738–751. doi:10.1080/10503307.2014.885146
99. Timulak, L. (2007). Identifying core categories of client-identified impact of helpful events in psychotherapy: A qualitative meta-analysis. Psychotherapy Research, 17, 305–314.
100. Tolin, D. F. (2010). Is cognitive-behavioral therapy more effective than other therapies?: A meta-analytic review. Clinical Psychology Review, 30, 710–720. doi:10.1016/j.cpr.2010.05.003
101. Torgerson, D. J., Torgerson, C. (2008). Designing randomised trials in health, education and the social sciences: An introduction. Basingstoke and New York, NY: Palgrave Macmillan, ISBN 978-0-230-53735-4.
102. Vromans, L. P., & Schweitzer, R. D. (2011). Narrative therapy for adults with major depressive disorder: Improved symptom and interpersonal outcomes. Psychotherapy Research, 21, 4–15. doi:10.1080/10503301003591792
103. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Lawrence Erlbaum Associates.
104. Wasserman, R. H., Levy, K. N., & Loken, E. (2009). Generalizability theory in psychotherapy research: The impact of multiple sources of variance on the dependability of psychotherapy process ratings. Psychotherapy Research, 19, 397–408. doi:10.1080/10503300802579156