The relevance of results in clinical research: Statistical, practical, and clinical significance

Journal of Cognitive and Behavioral Psychotherapies

Volumn 10, Issue 1, 2010, Pages 101-114

  Pintea, Sebastian ^a  

^a BABE BOLYAI UNIVERSITY   (Romania)

Author keywords

Clinical significance; Effect size; Normative comparison; Practical significance; Quality of life; Reliable change; Social significance; Statistical significance

Indexed keywords

EID: 79954548752     PISSN: 15847101     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (42)

1. Abelson, R. P. (1997). A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented). In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.). What if there were no significance tests? (pp. 117-141). Mahwah, NJ: Erlbaum.
2. American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
3. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
4. Ankuta, G. Y., & Abeles, N. (1993). Client satisfaction, clinical significance, and meaningful change in psychotherapy. Professional Psychology: Research and Practice, 24, 70-74.
5. Atkins, D. C., Bedics, J. D., McGlinchey, J. B., & Beauchaine, T. P. (2005). Assessing Clinical Significance: Does It Matter Which Method We Use? Journal of Consulting and Clinical Psychology, 73, 982-989.
6. Bauer, S., Lambert, M. J., Nielsen, S. L. (2004). Clinical significance methods: a comparison of statistical techniques. Journal of Personality Assessment, 86, 60-70.
7. Beck, A. T., Steer, R. A., & Garbin, M. G. (1988). Psychometric properties of the Beck depression inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100.
8. Campbell, T. C. (2005). An introduction to clinical significance: An alternative index of intervention effect for group experimental designs. Journal of Early Intervention, 27, 210-227.
9. Christensen, L., & Mendoza, J. L. (1986). A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy, 17, 305-308.
10. Cohen, J. (1994). The earth is round (p < 0.05). American Psychologist, 49, 997-1003.
11. Czaja, S. J., & Shoultz, R. (2003). Does the treatment make a real difference? The measurement of clinical significance. Alzheimer's Care Quarterly, 4, 229-240
12. Gladis, M. M., Gosch, E. A., Dishuk, N. M., & Crits-Christoph, P. (1999). Quality of life: Expanding the scope of clinical significance. Journal of Consulting and Clinical Psychology, 67, 320-331.
13. Hageman, W. J., & Arrindell, W. A. (1999). Establishing clinically significant change: Increment of precision and the distinction between individual and group level of analysis. Behavior Research and Therapy, 37, 1169-1193.
14. Harris, R. J. (1997). Reforming significance testing via three-valued logic. In L. L. Harlow, S. A. Mulaik & J. H. Steiger (Eds.). What if there were no significance tests? (pp. 145-174). Mahwah, NJ: Erlbaum.
15. Henson, R. K. (2006). Effect-Size Measures and Meta-Analytic Thinking in Counseling Psychology Research. Counseling Psychologist, 34, 601-629.
16. Hsu, L. M. (1989). Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment, 11, 459-467.
17. Hsu, L. M. (1999). Caveats concerning comparisons of change rates obtained with five methods of identifying significant client changes: Comment on Speer and Greenbaum (1995). Journal of Consulting and Clinical Psychology, 67, 594-598.
18. Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336-352.
19. Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999). Methods for defining and determining the clinical significance of treatement effects: description, application, and alternatives. Journal of Consulting and Clinical Psychology, 67, 300-307.
20. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningfull change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
21. Kazdin, A. E. (1999). The meanings and measurement of clinical significance. Journal of Consulting and Clinical Psychology, 67, 300-307.
22. Kendall, P. C. (1997). Editorial. Journal of Consulting and Clinical Psychology, 65, 3-5.
23. Kendall, P. C. (1999). Clinical significance. Journal of Consulting & Clinical Psychology, 67, 283-284.
24. Kendall, P. C., & Grove, W. M. (1988). Normative comparisons in therapy outcome. Behavioral Assessment, 10, 147-158.
25. Kendall, P. C., Marrs-Garcia, A., Nath, S. R., & Sheldrick, R. C. (1999). Normative comparisons for the evaluation of clinical significance. Journal of Consulting and Clinical Psychology, 67, 285-299.
26. Kendall, P. C., & Sheldrick, R. C. (2000). Normative data for normative comparisons. Journal of Consulting & Clinical Psychology, 68, 767-773.
27. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
28. Kirk, R. E. (2001). Promoting good statistical practices: Some suggestions. Educational and Psychological Measurement, 61, 213-218.
29. Kraemer, E. C., Morgan, G. A., Leech, N. L., Gliner, J. A., Vaske, J. J., & Harmon, R. J. (2003). Journal of the American Academy of Child and Adolescent Psychiatry, 42, 1524-1529.
30. Lunnen, K. M., & Ogles, B. M. (1998). A multi-perspective, multi-variable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66, 400-410.
31. McGlinchey, J. B., Atkins, D. C., & Jacobson, N. S. (2002). Clinical significance methods: which one to use and how useful are they? Behavior Therapy, 33, 529-550.
32. Ogles, B. M., Lunnen, K. M., & Bonesteel, K. (2001). Clinical significance: history, application, and current practice. Clinical Psychology Review, 21, 421-446.
33. Paquin, M. J. R. (1983). Beyond significant yet meaningless results in psychotherapy. Psychotherapy: Theory, Research and Practice, 20, 38-40.
34. Rosnow, R. L., & Rosenthal, R. (1996). Computing Contrasts, Effect Sizes, and Countermills on Other People's Published Data: General Procedures for Research Consumers. Psychological Methods, 1(4), 331-340.
35. Rozeboom, W. W. (1997). Good science is abductive, not hypothetico-deductive. In L. L. Harlow, S. A. Mulaik & J. H. Steiger (Eds.). What if there were no significance tests? (pp. 335-392). Mahwah, NJ: Erlbaum.
36. Schmidt, F. L., & Hunter, J. E. (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In L. L. Harlow, S. A. Mulaik & J. H. Steiger (Eds.). What if there were no significance tests? (pp. 37-64). Mahwah, NJ: Erlbaum.
37. Speer, D. C. (1992). Clinically significant change: Jacobson and Truax (1991) revisited. Journal of Consulting and Clinical Psychology, 60, 402-408.
38. Speer, D. C., Greenbaum, P. E. (1995). Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology, 63, 1044-1048.
39. Thompson, B. (1993). The use of statistical significance tests in research: bootstrap and other alternatives. Journal of Experimental Education, 61, 361-377.
40. Thompson, B. (2002). "Statistical", "Practical" and "Clinical": How Many Kinds of significance do Counselors Need to Consider? Journal of Counseling & Development, 80, 64-71.
41. Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory & Psychology, 10, 413-425.
42. Wise, E. A. (2004). Methods for Analysing Psychotherapy Outcomes. A review of clinical significance, reliable change, and recommendations for future directions. Journal of Personality Assessement, 82, 50-59.