Effect sizes in single case research: How large is large?

School Psychology Review

Volumn 34, Issue 1, 2005, Pages 116-132

  Parker, Richard I ^a   Brossart, Daniel F ^a   Vannest, Kimberly J ^a   Long, James R ^b   De Alba, Roman Garcia ^c   Baugh, Frank G ^d   Sullivan, Jeremy R ^c  

^a TEXAS A AND M UNIVERSITY   (United States)

^b VA PALO ALTO HEALTH CARE SYSTEM   (United States)

^c Cypress Fairbanks ISD ^*  (United States)

^d Natl Ctr for Org Development   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 17544376903     PISSN: 02796015     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (84)

1. Allison, D. B., & German, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behavior, Research, and Therapy, 31, 621-631.
2. Allison, D. B., Silverstein, J. M, & Gorman, B. S. (1996). Power, sample size estimation, and early stopping rules.. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.). Design and analysis of single case research (pp. 335- 371). Mahwah, NJ: Lawrence Erlbaum Associates.
3. Anhalt, K., McNeil, C. B., & Bahl, A. B. (1998). The ADHD classroom kit: A whole-classroom approach for managing disruptive behavior. Psychology in the Schools, 35, 67-79.
4. Baer, D. M. (1977). Perhaps it would be better not to know everything. Journal of Applied Behavior Analysis, 10, 167-172.
5. Barlow, D. H., & Hersen, M. (Eds.). (1984). Single case experimental designs: Strategies for studying behavior change (2nd ed.). Oxford, England: Pergamon Press.
6. Berry, W., & Lewis-Beck, M. (Eds.). (1986). New tools for social scientists: Advances and applications in research methods. Beverly Hills, CA: Sage.
7. Box, G. E. P., & Jenkins, G. M. (1976). Time series analysis : Forecasting and control. San Francisco: Holden-Day.
8. Bray, M. A. & Kehle, T. J. (1998). Self-modeling as an intervention for stuttering. School Psychology Review, 27, 587-598.
9. Bujold, A., Ladouceur, R., Sylvain, C., & Boisvert, J. (1994). Treatment of pathological gamblers: An experimental study. Journal of Behavioral Therapy & Experimental Psychiatry, 25, 275-282.
10. Burnette, M., Boehn, K., Kenyon-Jump, R., Hutton, K., & Stark, C. (1991). Control of genital herpes recurrences using progressive muscle relaxation. Behavior Therapy, 22, 237-247.
11. Busk, P. L., & Marascuilo, L. A. (1988). Autocorrelation in single-subject research: A counterargument to the myth of no autocorrelation. Behavioral Assessment, 10, 229-242.
12. Busk, P. L., & Serlin, R. C. (1992). Meta-analysis for single case research. In T. R. Kratochwill & J. R. Levin (Eds.), Single case research design and analysis: New directions for psychology and education (pp. 187-212). Hillsdale, NJ: Lawrence Erlbaum Associates.
13. Carver, R. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
14. Cassisi, J., & McGlynn, F. (1988). Effects of EMG activated alarms on nocturnal bruxism. Behavior Therapy, 19, 133-142.
15. Center, B. A., Skiba, R. J., & Casey, A. (1985-1986). A methodology for the quantitative synthesis of intrasubject design research. Journal of Special Education, 19, 387-400.
16. Chadwick, P., & Trower, P. (1996). Cognitive therapy for punishment paranoia: A single case experiment. Behavioral Research and Therapy, 4, 351-356.
17. Chadwick, P. D. (1994). Examining specific cognitive change in cognitive therapy for depression: A controlled case experiment. Journal of Cognitive Psychotherapy: An International Quarterly, 8, 19-31.
18. Chadwick, P. D., & Lowe, C.F. (1990). Measurement and modification of delusional beliefs. Journal of Consulting and Clinical Psychology, 58, 225-232.
19. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
20. Cohen, J., & Cohen, P. (1983). Applied multiple regression/ correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
21. Crosbie, J. (1987). The inability of the binominal test to control type I error with single- subject data. Behavioral Assessment, 9, 141-150.
22. Crosbie, J. (1993). Interrupted time-series analysis with brief single-subject data. Journal of Consulting & Clinical Psychology, 61, 966-974.
23. Crosbie, J. (1995). Interrupted time-series analysis with short series: Why it is problematic; How it can be improved. In J. M. Gottman (Ed.), The analysis of change (pp. 361-395). Mahwah, NJ: Lawrence Erlbaum Associates.
24. Darlington, R. B., & Carlson, P. M. (1987). Behavioral statistics: Logic & methods. New York: Free Press.
25. Edgington, E. S. (1987). Randomizing single subject experiments and statistical tests. Journal of Counseling Psychology, 34, 437-442.
26. Faith, M. S., Allison, D. B., & Gorman, B. S. (1996). Meta-analysis of single case research. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single case research (pp. 245-277). Mahwah, NJ: Lawrence Erlbaum Associates.
27. Fidler, F., & Thompson, B. (2001). Computing correct confidence intervals for ANOVA fixed- and random-effects effect sizes. Educational and Psychological Measurement, 61, 575-604.
28. Fowler, R. J. (1985). Point estimates and confidence intervals in measures of association. Psychological Bulletin, 98, 160-165.
29. Fox, J. (1991). Regression diagnostics. Newbury Park, CA: Sage.
30. Franklin, R. D., Allison, D. B., & Gorman, B. S. (Eds.). (1996). Design and analysis of single case research. Mahwah, NJ: Lawrence Erlbaum Associates.
31. Glass, G. V, Willson, V. L., & Gottman, J. M. (1975). Design and analysis of time-series experiments. Boulder: Colorado Associated University Press.
32. Gorman, B. S., & Allison, D. B. (1996). Statistical alternatives for single case designs. In R. D. Franklin & D. B. Allison & B. S. Gorman (Eds.), Design and analysis of single case research (pp. 159-214). Mahwah, NJ: Lawrence Erlbaum Associates.
33. Gorsuch, R. L. (1983). Three methods for analyzing time-series (N of 1) data. Behavioral Assessment, 5, 141154.
34. Greene, B. F., Norman, K. R., Searle, M. S., Daniels, M., & Lubeck, R. C. (1995). Child abuse and neglect by parents with disabilities: A tale of two families. Journal of Applied Behavior Analysis, 28, 417-434.
35. Hartley, E. T., Bray, M. A., & Kehle, T. J. (1998). Self-modeling as an intervention to increase student classroom participation. Psychology in the Schools, 35, 363372.
36. Hartmann, D. P., Gottman, J. M., Jones, R. R., Gardner, W., Kazdin, A. E., & Vaught, R. S. (1980). Interrupted time-series analysis and its application to behavioral data. Journal of Applied Behavior Analysis, 13, 543559.
37. Hedges, L. V., & Olkin, L. (1985). Statistical methods for meta-analysis. San Diego: Academic Press.
38. Hintze, J. (2002). NCSS 2002 [Computer Software]. Kaysville, UT: NCSS Statistical Software.
39. Holtzman, W. H. (1963). Statistical methods for the study of change in the single case. In C. W. Harris (Ed.), Problems in measuring change (pp. 199-211). Madison: University of Wisconsin Press.
40. Houten, R. V., & Retting, R. A. (2001). Increasing motorist compliance and caution at stop signs. Journal of Applied Behavior Analysis, 34, 185-193.
41. Huitema, B. D. (1986). Statistical analysis and single-subject designs. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 209- 232). New York: Plenum.
42. Huitema, B. E. (1985). Autocorrelation in applied behavior analysis: A myth. Behavioral Assessment, 7, 107118.
43. Huitema, B. E. (2004). Analysis of interrupted time-series experiments using USE: A critique. Understanding Statistics, 3, 27-46.
44. Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336-352.
45. Jensen, C. (1994). Psychosocial treatment of depression in women: Nine single subject evaluations. Research on Social Work Practice, 4, 267-282.
46. Jones, R. R., Vaught, R. S., & Weinrott, M. (1977). Time-series analysis in operant research. Journal of Applied Behavior Analysis, 10, 151-166.
47. Kazdin, A. (1984). Statistical analysis for single case experiments designs. In D. H. Barlow & M. Hersen (Eds.), Single case experimental designs (2nd ed., pp. 285-324). New York: Pergamon.
48. Kazdin, A. E. (1982). Single case research designs: Methods for clinical and applied settings. New York: Oxford University Press.
49. Kern, L., & Bambara, L. (2002). Class-wide curricular modification to improve the behavior of students with emotional or behavioral disorders. Behavior Disorders, 27, 317-326.
50. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational & Psychological Measurement, 56, 746-759.
51. Kratochwill, T. R., & Brody, G. H. (1978). Single subject designs: A perspective on the controversy over employing statistical inference and implications for research and training in behavior modification. Behavior Modification, 2, 291-307.
52. Kratochwill, T. R., & Levin, J. R. (Eds.). (1992). Single case research design and analysis: New directions for psychology and education. Hillsdale, NJ: Lawrence Erlbaum Associates.
53. Kromrey, J. D., & Foster-Johnson, L. (1996). Determining the efficacy of intervention: The use of effect sizes for data analysis in single-subject research. The Journal of Experimental Education, 65, 73-93.
54. Ladouceur, R., Freeston, M., Gagnon, F., Thibodeau, N., & Dumont, J. (1993). Idiographic considerations in the behavioral treatment of obsessional thoughts. Journal of Behavioral Therapy & Experimental Psychiatry, 24, 301-310.
55. Lee, R., McComas, J. J., & Jawor, J. (2002). The effects of differential and lag reinforcement schedules on varied verbal responding by individuals with autism. Journal of Applied Behavior Analysis, 35, 391-402.
56. Lemanek, K. L., & Gresham, F. M. (1984). Social skills training with a deaf adolescent: implications for place ment and programming. School Psychology Review, 13, 385-390.
57. Levin, J. R., & Wampold, B. E. (1999). Generalized single case randomization tests: Flexible analyses for a variety of situations. School Psychology Quarterly, 14, 5993.
58. Linden Software. (1998) [Graph digitizing software.] Linden Software Ltd., Inglenook Cottage, Westoby Lane, Barrow Upon Humber, DN19 7DJ, UK.
59. Lopez, A., & Cole, C. L. (1999). Effects of a parent-implemented intervention on the academic readiness skills of five Puerto Rican Kindergarten students in an urban school. School Psychology Review, 28, 439-447.
60. Martens, B. K., Hiralall, A. S., & Bradley, T. A. (1997). A note to teacher: Improving student behavior through goal setting and feedback. School Psychology Quarterly, 72, 33-41.
61. Matyas, T. A., & Greenwood, K. M. (1996). Serial dependency in single case time series. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single case research (pp. 215-243). Mahwah, NJ: Lawrence Erlbaum Associates.
62. Maxwell, S. E., Camp, C. J., & Arvey, R. D. (1981). Measures of strength of association: A comparative examination. Journal of Applied Psychology, 66, 525-534.
63. Michael, J. L. (1974). Statistical inference for individual organism research: Mixed blessing or curse? Journal of Applied Behavior Analysis, 7, 647-653.
64. Mitchell, C., & Hartmann, D. P. (1981). A cautionary not on the use of Omega squared to evaluate the effectiveness of behavioral treatments. Behavioral Assessment, 3, 93-100.
65. Nourbakhsh, M. R., & Ottenbacher, K. J. (1994). The statistical analysis of single-subject data: A comparative examination. Physical Therapy, 74, 768-776.
66. Ostrom, C. W., Jr. (1990). Time series analysis: Regression techniques (2nd ed.). Beverly Hills, CA: Sage.
67. Parker, R., & Brossart, D. (2003). Evaluating single case research data: A comparison of seven statistical methods. Behavior Therapy, 34, 189-211.
68. Parsonson, B. S., & Baer, D. M. (1992). The visual analysis of data, and current research into the stimuli controlling it. In T. R. Kratochwill & J. R. Levin (Eds.), Single case research design and analysis (pp. 15-40). Hillsdale, NJ: Lawrence Erlbaum Associates.
69. Pray, B., Kramer, J. J., & Lindskog, R. (1986). Assessment and treatment of tic behavior: A review and case study. School Psychology Review, 15, 418-429.
70. Rankin, H. (1982). Control rather than abstinence as a goal in the treatment of excessive gambling. Behavior Research and Therapy, 20, 185-187.
71. Rosenthal, R. (1991). Meta-analytic procedures for social research (rev. ed. Vol. 6). Newbury Park, CA: Sage.
72. Rosnow, R., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
73. Salend, S. J., Whittaker, C. R., Raab, S., & Giek, K. (1991). Using a self-evaluation system as a group contingency. Journal of School Psychology, 29, 319-329.
74. Scheffé, H. (1959). The analysis of variance. New York: Wiley.
75. Shapiro, E. S., Albright, T. S., & Ager, C. L. (1986). Group versus individual contingencies in modifying two disruptive adolescents' behavior. Professional School Psychology, 1, 105-116.
76. Sharpe, T., & Lounsbery, M. (1997). The effects of a sequential behavior analysis protocol on the teaching practices of undergraduate trainees. School Psychology Quarterly, 1, 105-116.
77. 2: A computer program for interval estimation, power calculations, sample size estimation, and hypothesis testing in multiple regression. Behavioral Research Methods, Instruments, and Computers, 24, 581-582.
78. Suen, H. K., & Ary, D. (1987). Autocorrelation in applied behavior analysis: Myth or reality? Behavioral Assessment, 9, 125-130.
79. Swanson, H. L., Kozleski, E. & Stegink, P. (1987). Disabled readers' processing of prose: Do any processes change because of intervention? Psychology in the Schools, 24, 378-384.
80. Thompson, B. (2002). "Statistical," "practical," and "clinical": How many kinds of significance do counselors need to consider? Journal of Counseling and Development, 80, 64-71.
81. Tollefson, N., Tracy, D. B., Johnsen, E. P., & Chatman, J. (1986). Teaching learning disabled students goal-implementation skills. Psychology in the Schools, 23, 194-204.
82. White, D. M., Rusch, F. R., Kazdin, A. E., & Hartmann, D. P. (1989). Applications of meta-analysis in individual subject research. Behavioral Assessment, 11, 281-296.
83. White, O. R., & Haring, N. G. (1980). Exceptional teaching (2nd ed.). Columbus, OH: Merrill.
84. Winborn, L., Wacker, D. P., Richman, D. M., Asmus, J., & Geier, D. (2002). Assessment of mand selection for functional communication training packages. Journal of Applied Behavior Analysis, 35, 295-298.