Statistical reform: Evidence-based practice, meta-analyses, and single subject designs

Psychology in the Schools

Volumn 44, Issue 5, 2007, Pages 483-493

  Jenson, William R ^a,b   Clark, Elaine ^a   Kircher, John C ^a   Kristjansson, Sean D ^a  

^a UNIVERSITY OF UTAH   (United States)

^b Milton Bennion Hall ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34250865051     PISSN: 00333085     EISSN: 15206807     Source Type: Journal    
DOI: 10.1002/pits.20240     Document Type: Article

References (57)

1. American Psychological Association. (1996). Initial report: Task force on statistical inference, Board of Scientific Affairs, Washington, D.C., American Psychological Association. Retrieved March 29, 2006, http://www.apa.org/science/ bsaweb-tfsi.html.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: APA.
3. Busk, P.L., & Serlin, R.C. (1992). Meta-analysis for single-case research. In T.R. Kratochwill & J.R. Levin (Eds.), Single case research design and analysis: New directions for psychology and education (pp. 187-212). Hillsdale, NJ: Erlbaum.
4. Campbell, J.M. (2004). Statistical comparison of four effect sizes for single-subject designs. Behavior Modification, 28, 234-246.
5. Chambless, D.L., & Hollon, S.D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
6. Christiansen, E.A. (2005). Effectiveness of behavioral treatments for the reduction of self-injury in autism: A meta-analysis. Unpublished masters thesis, University of Utah.
7. Coe, R. (2002). It's the effect size, stupid: What effect size is and why it is important. Paper presented at the Annual Conference of the British Educational Research Association, University of Exeter, England, September 12-14, 2002.
8. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
9. Crosbie, J. (1993). Interrupted time-series analysis with brief single-subject data. Journal of Consulting and Clinical Psychology, 61, 966-974.
10. Crosbie, J. (1999). Statistical inference in behavior analysis: Useful friend. Behavior Analyst, 22, 105-108.
11. Ennett, S.T., Tobler, N.S., Ringwalt, C.L., & Flewelling, R.L. (1994). How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations. American Journal of Public Health, 84, 1394-1401.
12. Faith, M.S., Allison, D.B., & Gorman, B.S. (1996). Meta-analysis of single-case research. In R.D. Franklin, D.B. Allison, & B.S. Gorman (Eds.), Design and analysis of single-case research (pp. 245-277). Hillsdale, NJ: Erlbaum.
13. Forness, S.R., Kavale, K.A., Blum, S., & Lloyd, J.W. (1997). Mega-analysis of meta-analyses: What works in special education and related services. Teaching Exceptional Children, 29, 4-9.
14. Glass, G.V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
15. Glass, G.V., McGaw, B., & Smith, M.L. (1981). Meta-analysis in social research. Beverly Hills, CA: SAGE Publications.
16. Gottman, J.M., & Rushe, R.H. (1993). The analysis of change: Issues, fallacies and new ideas. Journal of Consulting and Clinical Psychology, 61, 907-910.
17. Gresham, F.M., McIntyre, L.L., Olson-Tinker, H., Dolstra, L., McLaughlin, V., & Van, M. (2004). Relevance of functional behavioral assessment research for school-based interventions and positive behavioral support. Research in Developmental Disabilities, 25, 19-37.
18. Huitema, B.E. (1988). Autocorrelation: 10 years of confusion. Behavioral Assessment, 10, 253-294.
19. Huitema, B.E., McKean, J.W., & Laraway, S. (2005). Time-series intervention analysis using ITSACORR: Fatal flaws. Unpublished manuscript.
20. Jimerson, S.R. (2001). Meta-analysis of grade retention research: Implications for practice in the 21st century. School Psychology Review, 30, 420-437.
21. Johnson, B.T. (1989). DSAT 1.10: Software for the meta-analytic review of research literatures. Mahwah, NJ: Erlbaum.
22. Johnston, J.M., & Pennypacker, H.S. (1993). Strategies and tactics of behavioral research (2nd ed.). Hillside, NJ: Erlbaum.
23. Kavale, K.A., Mathur, S.R., Forness, S.R., Quinn, M.M., & Rutherford, R.B. (2000). Right reason in the integration of group and single-subject research in behavioral disorders. Behavioral Disorders, 25, 142-157.
24. Kavale, K., & Mattson, P.D. (1983). One jumped off the balance beam: Meta-analysis of perceptual-motor training. Journal of Learning Disabilities, 16, 165-173.
25. Lipsey, M.W., & Wilson, D.B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
26. Mathur, S.R., Kavale, K.A., Quinn, M.M., Forness, S.R., & Rutherford, R.B. (1998). Social skills interventions with students with emotional and behavioral problems: A quantitative synthesis of single-subject research. Behavioral Disorders, 23, 193-201.
27. Matyas, T.A., & Greenwood, K.M. (1991). Problems in the estimation of autocorrelation in brief time series and some implications for behavioral data. Behavioral Assessment, 13, 137-157.
28. Maughan, D.R., Christiansen, E., Jenson, W.R., Olympia, D., & Clark, E. (2005). Behavioral parent training as a treatment for externalizing behaviors and disruptive behavior disorders: A meta-analysis. School Psychology Review, 34, 267-286.
29. McDowall, D., McCleary, R., Meidinger, E., & Hay, R. (1980). Interrupted time series analysis. Sage University Papers Series on Quantitative Applications in the Social Sciences. Beverly Hills, CA: Sage.
30. Miller, A.L. (2005). Interventions targeting reciprocal social interaction in children and young adults with autism spectrum disorders: A meta-analysis. Unpublished dissertation, University of Utah.
31. Office of the Federal Register. (2006). Special Education and Rehabilitative Services, Technical Assistance and Dissemination to Improve Services and Results for Children with Disabilities (New Awards) for Fiscal Year 2006. Federal Register, 71, 10658-10663.
32. Peck H.L., Bray M.A., & Kehle T.J. (2003). Relaxation and guided imagery: A school based intervention for children with asthma. Psychology in the Schools, 40, 657-675.
33. Quinn, M.M., Kavale, K.A., Mathur, S.R., Rutherford, R.B., & Forness, S.R. (1999). A meta-analysis of social skills interventions for students with emotional or behavioral disorders. Journal of Emotional and Behavioral Disorders, 7, 54-64.
34. Raudenbush, S.W., & Bryk, A.S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
35. Raudenbush, S.W., Bryk, A.S., & Cheong, Y.F., & Congdon, R.T. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.
36. Salzberg, C.L., Strain, P.S., & Baer, D.M. (1987). Meta-analysis for single-subject research: When does it clarify, when does it obscure? Remedial and Special Education, 8, 43-48.
37. Scruggs, T.E., & Mastropieri, M.A. (1998). Summarizing single-subject research: Issues and applications. Behavior Modification, 22, 221-242.
38. Scruggs, T.E., Mastropieri, M.A., & Casto, G. (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial & Special Education, 8, 24-33.
39. Scruggs, T.E., Mastropieri, M.A., Cook, S.B., & Escobar, C. (1986). Early intervention for children with conduct disorders: A quantitative synthesis of single-subject research. Behavioral Disorders, 11, 260-271.
40. Serketich, W.J., & Dumas, J.E. (1996). The effectiveness of behavioral parent training to modify antisocial behavior in children: A meta-analysis. Behavior Therapy, 27, 171-186.
41. Sigurdsson, S.O., & Austin, J. (2006). Should we be measuring effect size in applied behavior analysis? Retrieved March 29, 2006 from the Organizational Behavior Management Network, http://www.obmnetwork.com/resources/ articles/main/Sigurdsson_EffectSize.htm
42. Stage, S.A. (2001). Program evaluation using hierarchical linear modeling with curriculum-based measurement reading probes. School Psychology Quarterly, 16, 91-112.
43. Stage, S.A. & Quiroz, D.R. (1997). A meta-analysis of interventions to decrease disruptive classroom behavior in public education settings. School Psychology Review, 26, 333-368.
44. Steffey, E.D. (2005). Meta-analysis of single-subject research for self-stimulatory behavior reduction treatments in autism. Unpublished masters thesis, University of Utah.
45. Stoiber, K.C., & Kratochwill, T.R. (2000). Empirically supported interventions and school psychology: Rationale and methodological issues - Part 1. School Psychology Quarterly, 15, 75-105.
46. Strain, P.S., Kohler, F.W., & Gresham, F. (1998). Problems in logic and interpretation with quantitative syntheses of single-case research: Mathur and colleagues (1998) as a case in point. Behavioral Disorders, 24, 74-85.
47. Suen, H.K., & Ary, D. (1987). Autocorrelation in applied behavior analysis: Myth or reality? Behavioral Assessment, 9, 125-130.
48. Swanson, H.L., & Sachse-Lee, C. (2000). A meta-analysis of single-subject-design intervention research for students with LD. Journal of Learning Disabilities, 33, 114-136.
49. Takkouche, B., Etminan, M., & Montes-Martlnes, A. (2005). Personal use of hair dyes and risk of cancer: A meta-analysis. Journal of the American Medical Association, 293, 2516-2525.
50. Tawney, J.W., & Gast, D.L. (1984). Single subject research in special education. Columbus, OH: Merrill.
51. Theodore, L.A., Bray, M.A., & Kehle, T.J. (2004). A comparative study of group contingencies and randomized reinforcers to reduce disruptive classroom behaviors. School Psychology Quarterly, 19, 253-271.
52. U.S. Department of Education. (2002). No Child Left Behind Act of 2001. Retrieved March 29, 2006, from http://www.ed.gov/policy/elsec/leg/esea02/107- 110.pdf
53. Van den Noortgate, W. & Onghena, P. (2003). Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly, 18, 325-346.
54. Vegas, K.C. (2001). A meta-analysis of timeout effectiveness in reducing disruptive behavior with single-subject designs. Unpublished masters thesis, University of Utah.
55. Weisz, J.R., Donenberg, G.R., Han, S.S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688-701.
56. West, S.G., & Hepworth, J.T. (1991). Statistical issues in the study of temporal data: Daily experiences. Journal of Personality, 59, 609-662.
57. White, O. (1987). Some comments concerning "The quantitative synthesis of single-subject research." Remedial & Special Education, 8, 34-39.