Evaluating clinical significance through equivalence testing: Extending the normative comparisons approach

Psychotherapy Research

Volumn 19, Issue 6, 2009, Pages 677-686

  Cribbie, Robert A ^a   Arpin Cribbie, Chantal A ^b  

^a YORK UNIVERSITY   (Canada)

^b LAURENTIAN UNIVERSITY   (Canada)

Author keywords

Outcome research; Statistical methodology

Indexed keywords

ARTICLE; COMPARATIVE STUDY; EVALUATION; HUMAN; METHODOLOGY; PSYCHOLOGIC TEST; PSYCHOLOGICAL MODEL; PSYCHOLOGY; PSYCHOTHERAPY;

HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL TESTS; PSYCHOLOGY; PSYCHOTHERAPY;

EID: 77953162782     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503300902926554     Document Type: Article

References (30)

1. Achenbach, T. M. (2001). What are norms and why do we need valid ones? Clinical Psychology: Science and Practice, 8, 446-450.
2. Algina, J., Oshima, T. C., & Lin, W.-Y. (1994). Type I error rates for Welch’s test and James’s second order test under nonnormality and inequality of variance when there are two groups. Journal of Educational and Behavioral Statistics, 19, 275-292.
3. Arpin-Cribbie, C. A., Irvine, J., & Ritvo, P. (2009). Perfectionism related cognitions and psychological distress: A randomized trial evaluating the relative effectiveness of a web-based cognitive behavioural intervention protocol. Unpublished manuscript.
4. Baucom, D. H., & Mehlman, S. K. (1984). Predicting marital status following behavioral marital therapy: A comparison of models of marital relationships. In K. Hahlweg & N. S. Jacobson (Eds), Marital interactions: Analysis and modification (pp. 89-104). New York: Guilford Press.
5. Bauer, S., Lambert, M. J., & Nielsen, S. L. (2004). Clinical significance methods: A comparison of statistical techniques. Journal of Personality Assessment, 82, 60-70.
6. Boneau, C. A. (1960). The effects of violations of assumptions underlying the t test. Psychological Bulletin, 57, 49-64.
7. Cribbie, R. A., Gruman, J., & Arpin-Cribbie, C. (2004). Recommendations for applying tests of equivalence. Journal of Clinical Psychology, 60, 1-10.
8. Flett, G. L., Hewitt, P. L., Blankstein, K., & Gray, L. (1998). Psychological distress and the frequency of perfectionistic thinking. Journal of Personality and Social Psychology, 75, 1363-1381.
9. Frost, R. O., Marten, P., Lahart, C., & Rosenblate, R. (1990). The dimensions of perfectionism. Cognitive Therapy and Research, 14, 449-68.
10. Gruman, J., Cribbie, R. A., & Arpin-Cribbie, C. A. (2007). The effects of heteroscedasticity on tests of equivalence. Journal of Modern Applied Statistical Methods, 6, 133-140.
11. Hewitt, P. L., & Flett, G. L. (1991). Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. Journal of Personality and Social Psychology, 60, 456-470.
12. Jacobsen, N. S., Follette, W. C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336-552.
13. Jacobsen, N. S., & Revenstorf, D. (1988). Statistics for assessing the clinical significance of psychotherapy techniques: Issues, problems, and new developments. Behavioral Assessment, 10, 133-145.
14. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
15. Kazdin, A. E. (2001). Behavior modification in applied settings (6th ed.). New York: Wadsworth.
16. Kendall, P. C. (1997). Editorial. Journal of Consulting and Clinical Psychology, 65, 3-5.
17. Kendall, P. C., & Grove, W. M. (1988). Normative comparisons in therapy outcome. Behavioral Assessment, 10, 147-158.
18. Kendall, P. C., Marrs-Garcia, A., Nath, S. R., & Sheldrick, R. C. (1999). Normative comparisons for the evaluation of clinical significance. Journal of Consulting and Clinical Psychology, 67, 285-299.
19. Kendall, P. C., & Norton-Ford, J. D. (1982). Clinical psychology: Scientific and professional dimensions. New York: Wiley.
20. Kohr, R. L., & Games, P. A. (1974). Robustness of the analysis of variance, the Welch procedure and a Box procedure to heterogeneous variances. Journal of Experimental Education, 43, 61-69.
21. Ogles, B. M., Lunnen, K. M., & Bonesteel, K. (2001). Clinical significance: History, application, and current practice. Clinical Psychology Review, 21, 421-46.
22. Rogers, J. L., Howard, K. I., & Vessey, J. T. (1993). Using significance tests to evaluate equivalence between two experimental groups. Psychological Bulletin, 113, 553-565.
23. Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110-114.
24. Schuirmann, D. J. (1987). A comparison of the two one-sided tests procedure and the power approach for assessing equivalence of average bioavailability. Journal of Pharmacokinetics and Biopharmaceutics, 15, 657-680.
25. Sheldrick, R., Kendall, P. C., & Heimberg, R. (2001). The clinical significance of treatments: A comparison of three treatments for conduct disordered children. Clinical Psychology: Science and Practice, 8, 418-30.
26. Streiner, D. L. (2003). Unicorns do exist: A tutorial on “proving” the null hypothesis. Canadian Journal of Psychiatry, 48, 756-761.
27. Welch, B. L. (1938). The significance of the difference between two means when population variances are unequal. Biometrika, 29, 350-362.
28. Wise, E. A. (2004). Methods for analyzing psychotherapy outcomes: A review of clinical significance, reliable change, and recommendations for future directions. Journal of Personality Assessment, 82, 50-59.
29. Yuen, K. K. (1974). The two-sample trimmed t for unequal population variances. Biometrika, 61, 165-170.
30. Zimmerman, D. W., & Zumbo, B. D. (1989). A note on rank transformations and comparative power of the Student t test and Wilcoxon-Mann-Whitney test. Perceptual and Motor Skills, 68, 1139-1146.