Distinguishing scientific from pseudoscientific psychotherapies: evaluating the role of theoretical plausibility, with a little help from reverend bayes

Clinical Psychology: Science and Practice

Volumn 18, Issue 2, 2011, Pages 105-112

  Lilienfeld, Scott O ^a  

^a EMORY UNIVERSITY   (United States)

Author keywords

Bayes theorem; Empirically supported therapies; Exposure; Nonspecific effects; Pseudoscience; Psychotherapy

Indexed keywords

EID: 79958759033     PISSN: 09695893     EISSN: 14682850     Source Type: Journal    
DOI: 10.1111/j.1468-2850.2011.01241.x     Document Type: Article

References (49)

1. Atwood, K. (2008). Prior probability: The dirty little secret of "evidence based alternative medicine." Science-Based Medicine. Retrieved September 28, 2010, from
2. Beck, A. T. (1991). Cognitive therapy: A 30-year retrospective. American Psychologist, 46, 368-375.
3. Boisvert, C. M. (2010). Negative treatment effects: Is it time for a black-box warning? American Psychologist, 65, 680-681.
4. Borkovec, T. D. (1985). Placebo: Defining the unknown. In L. White, B. Tursky, & G. E. Schwartz (Eds.), Placebo: Theory, research, and mechanisms (pp. 59-64). New York: Guilford Press.
5. Chambless, D. L., & Hollon, S. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
6. Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685-716.
7. Cohen, J. (1994). The earth is round (p<.05). American Psychologist, 49, 997-1003.
8. David, D., & Montgomery, G. H. (2011). The scientific status of psychotherapies: A new evaluative framework for evidence-based psychosocial interventions. Clinical Psychology: Science and Practice, 18, 89-98.
9. Davidson, P., & Parker, K. (2001). Eye movement desensitization and reprocessing (EMDR): A meta-analysis. Journal of Consulting and Clinical Psychology, 69, 305-316.
10. Dimidjian, S., & Hollon, S. D. (2010). How would we know if psychotherapy were harmful? American Psychologist, 65, 21-33.
11. Dimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., et al. (2006). Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. Journal of Consulting and Clinical Psychology, 74, 658-670.
12. Eisner, D. A. (2000). The death of psychotherapy: From Freud to alien abductions. Westport, CT: Praeger.
13. Feinstein, D. (2008). Energy psychology: A review of the preliminary evidence. Psychotherapy: Theory, Research, Practice, Training, 45, 199-213.
14. Ghaemi, S. N. (2009). A clinician's guide to statistics and epidemiology in mental health: Measuring truth and uncertainty. Cambridge, MA: Cambridge University Press.
15. Goodman, S. N. (1999). Toward evidence-based medical statistics. 2: The Bayes factor. Annals of Internal Medicine, 130, 1005-1013. Retrieved September 30, 2010, from
16. Herbert, J., Lilienfeld, S. O., Lohr, J. M., Montgomery, R. W., O'Donohue, W., Rosen, G., et al. (2000). Science and pseudoscience in the development of eye movement desensitization and reprocessing: Implications for clinical psychology. Clinical Psychology Review, 20, 945-971.
17. Hunsley, J., & DiGuilio, G. (2002). Dodo bird, phoenix, or urban legend? The Scientific Review of Mental Health Practice, 1, 11-22. Retrieved September 13, 2010, from
18. Ilardi, S. S., & Craighead, W. E. (1994). The role of nonspecific factors in cognitive-behavior therapy for depression. Clinical Psychology: Science and Practice, 1, 138-156.
19. Kazdin, A. E. (2009). Understanding how and why psychotherapy leads to change. Psychotherapy Research, 19, 418-428.
20. Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, 44, 1116-1129.
21. Lilienfeld, S. O. (1998). Pseudoscience in contemporary clinical psychology: What it is and what we can do about it. The Clinical Psychologist, 51(4), 3-9. Retrieved October 2, 2010, from
22. Lilienfeld, S. O. (2007). Psychological treatments that cause harm. Perspectives on Psychological Science, 2, 53-70.
23. Lilienfeld, S. O., Lynn, S. J., & Lohr, J. M. (2003). Science and pseudoscience in clinical psychology. New York: Guilford Press.
24. Lohr, J. M., Lilienfeld, S. O., Tolin, D. F., & Herbert, J. D. (1999). Eye movement desensitization and reprocessing: An analysis of specific versus nonspecific treatment factors. Journal of Anxiety Disorders, 13, 185-207.
25. Lohr, J. M., Olatunji, B. O., Parker, L., & DeMaio, C. (2005). Experimental analysis of specific treatment factors: Efficacy and practice implications. Journal of Clinical Psychology, 61, 819-834.
26. Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151-159.
27. McCaslin, D. (2009). A review of efficacy claims in energy psychology. Psychotherapy: Theory, Research, Practice, Training, 49, 249-256.
28. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
29. Meehl, P. E., & Rosen, A. (1955). Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194-216.
30. Murphy, R., Cooper, Z., Hollon, S. D., & Fairburn, C. G. (2009). How do psychological treatments work? Investigating mediators of change. Behaviour Research and Therapy, 47, 1-5.
31. Ost, L. G., & Sterner, U. (1987). Applied tension. A specific behavioral method for treatment of blood phobia. Behaviour Research and Therapy, 25, 25-29.
32. Pignotti, M., & Thyer, B. (2009). Some comments on "Energy psychology: A review of the evidence": Premature conclusions based on incomplete evidence? Psychotherapy: Theory, Research, Practice, Training, 49, 257-261.
33. Popper, K. (1959). The logic of scientific discovery. New York: Basic Books.
34. Quine, W. V. O. (1951). Main trends in recent philosophy: Two dogmas of empiricism. The Philosophical Review, 60, 20-43. Retrieved October 1, 2010, from
35. Rosen, G. M., & Davison, G. C. (2003). Psychology should list empirically supported principles of change (ESPs) and not credential trademarked therapies or other treatment packages. Behavior Modification, 27, 300-312.
36. Ruscio, J. (2006). Critical thinking in psychology: Separating sense from nonsense (2nd ed.). Pacific Grove, CA: Wadsworth.
37. Sagan, C. (1995). The demon-haunted world: Science as a candle in the dark. New York: Random House.
38. Sapolsky, A. (1964). An effort at studying Rorschach content symbolism: The frog response. Journal of Consulting Psychology, 28, 469-472.
39. Saravi, F. D. (1999). Energy and the brain: Facts and fantasies. In S. Della Sala (Ed.), Mind myths: Exploring popular assumptions about the mind and brain (pp. 43-58). New York: Wiley.
40. Sehon, S. R., & Stanley, D. E. (2003). A philosophical analysis of the evidence-based medicine debate. BMC Health Services Research, 3, 1-10.
41. Shapiro, F. (1998). Eye movement desensitization and reprocessing (EMDR): Accelerated information processing and affect-driven constructions. Crisis Intervention, 4, 145-157. Retrieved October 11, 2010, from
42. Shedler, J. (2010). The efficacy of psychodynamic therapy. American Psychologist, 95, 98-109.
43. Stanford, K. (2009). Underdetermination of theory. Stanford Encyclopedia of Philosophy. Retrieved October 11, 2010, from
44. Stanovich, K. (2009). How to think straight about psychology (9th ed.). Boston: Pearson.
45. Taylor, S. (2007). Electroconvulsive therapy: A review of history, patient selection, technique, and medication management. Southern Medical Journal, 100, 494-498.
46. Truzzi, M. (1978). On the extraordinary: An attempt at clarification. Zetetic Scholar, 1, 11-22. Retrieved September 9, 2010, from
47. Tryon, W. W. (2005). Possible mechanisms for why desensitization and exposure therapy work. Clinical Psychology Review, 25, 67-95.
48. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Hillsdale, NJ: Erlbaum.
49. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, "all must have prizes." Psychological Bulletin, 122, 203-215.