Reconsidering Overlap-Based Measures for Quantitative Synthesis of Single-Subject Data: What They Tell Us and What They Don't

Behavior Modification

Volumn 37, Issue 3, 2013, Pages 378-390

  Carter, Mark ^a  

^a MACQUARIE UNIVERSITY   (Australia)

Author keywords

meta analysis; overlap metrics; single subject

Indexed keywords

ARTICLE; BEHAVIORAL RESEARCH; HUMAN; META ANALYSIS (TOPIC); METHODOLOGY; STATISTICAL ANALYSIS; STATISTICS;

BEHAVIORAL RESEARCH; DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; RESEARCH DESIGN;

EID: 84876710962     PISSN: 01454455     EISSN: 15524167     Source Type: Journal    
DOI: 10.1177/0145445513476609     Document Type: Article

References (42)

1. Allison D. B.,Gorman B. S.Calculating effect sizes for meta-analysis: The case of the single case.Behavior Research and Therapy. 1993;31:621-631.
2. Beretvas S. N.,Chung H.A review of meta-analyses of single-subject experimental designs: Methodological issues and practice.Evidence-Based Communication Assessment and Intervention. 2008;2:129-141.
3. Borenstein M.,Hedges L. V.,Higgins J. P. T.,Rothstein H. R.Introduction to meta-analysis. Chichester, UK: Wiley; 2009:.
4. Busk P. L.,Serlin R. C.Single-case research design and analysis: New directions for psychology and education. Kratochwill T. R.Levin J. R., ed. Hillsdale, NJ: Lawrence Erlbaum; 1992:.
5. Campbell D. T.,Stanley J. C.Experimental and quasi-experimental designs for research. Chicago, IL: Rand McNally; 1963:.
6. Carter M.Effects of graphing conventions and response options on interpretation of small n graphs.Educational Psychology. 2009;29:643-658.
7. Center B. J.,Skiba R. J.,Casey A.A methodology for the quantitative synthesis of intra-subject design research.Journal of Special Education. 1985;19:387-400.
8. Critchfield T. S.,Newland M. C.,Kollins S. H.The good, the bad, and the aggregate.Behavior Analyst. 2000;23:107-115.
9. DeProspero A.,Cohen S.Inconsistent visual analyses of intrasubject data.Journal of Applied Behavior Analysis. 1979;12:573-579.
10. Fisch G. S.Visual inspection of data revisited: Do the eyes still have it?.Behavior Analyst. 1998;21:111-123.
11. Ganz J. B.,Earles-Vollrath T. L.,Heath A. K.,Parker R. I.,Rispoli M. J.,Duran J. B.A meta-analysis of single case research studies on aided augmentative and alternative communication systems with individuals with autism spectrum disorders.Journal of Autism and Developmental Disorders. 2011;42:60-74.
12. Gersten R.,Fuchs L. S.,Compton D.,Coyne M.,Greenwood C.,Innocenti M. S.Quality indicators for group experimental and quasi-experimental research in special education.Exceptional Children. 2005;71:149-164.
13. Haardorfer R.Concerns with using Cohen's d and PND in single-case data analysis.Focus on Autism and Other Developmental Disabilities. 2010;25:125-127.
14. Harvey S.,Boer D.,Meyer L.,Evans I.Updating a meta-analysis of intervention research with challenging behaviour: Treatment validity and standards of practice.Journal of Intellectual & Developmental Disability. 2009;34:67-80.
15. Hattie J. A. C.Visible learning: A synthesis of over 800 meta-analyses relating to achievement. London, England: Routledge; 2009:.
16. HigginsJ. P. T.GreenS. (2009). Cochrane handbook for systematic reviews of interventions (Version 5.0.2). Retrieved from http://www.cochrane-handbook.org/.
17. Horner R. H.,Carr E. G.,Halle J.,McGee G.,Odom S.,Wolery M.The use of single-subject research to identify evidence-based practice in special education.Exceptional Children. 2005;71:165-179.
18. Kahng S.,Chung K. M.,Gutshall K.,Pitts S. C.,Kao J.,Girolami K.Consistent visual analyses of intrasubject data.Journal of Applied Behavior Analysis. 2010;43:35-45.
19. Kavale K. A.,Forness S. R.Efficacy of special education and related services. Washington, DC: AAMR; 1999:.
20. Kazdin A. E.Single-case research designs: Methods for clinical and applied settings. New York, NY: Oxford University Press; 1982:.
21. Kennedy C. H.Single-case designs for education research. Boston, MA: Allyn & Bacon; 2005:.
22. KratochwillT. R.HitchcockJ.HornerR. H.LevinJ. R.OdomS. L.RindskopfD. M.ShadishW. R. (2010). Single-case designs technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
23. Leong H. M.,Carter M.Research on the efficacy of sensory integration therapy: Past, present and future.Australasian Journal of Special Education. 2008;32:83-99.
24. Lipsy M. W.,Wilson D. B.Practical meta-analysis. Thousand Oaks, CA: SAGE; 2001:.
25. Ma H. H.An alternative method for quantitative synthesis of single-subject researches: Percentage of data points exceeding the median.Behavior Modification. 2006;30:598-617.
26. Ma H. H.The effectiveness of intervention on the behavior of individuals with autism: A meta-analysis using percentage of data points exceeding the median of baseline phase (PEM).Behavior Modification. 2009;33:339-359.
27. Matyas T. A.,Greenwood K. M.Visual analysis of single-case time series: Effects of variability, serial dependence and magnitude of intervention effects.Journal of Applied Behavior Analysis. 1990;23:341-351.
28. Ottenbacher K.Reliability and accuracy of visually analyzing graphed data from single-subject designs.American Journal of Occupational Therapy. 1986;40:464-469.
29. Parker R. I.,Hagan-Burke S.Median-based overlap analysis for single case data: A second study.Behavior Modification. 2007;31:919-936.
30. Parker R. I.,Hagan-Burke S.,Vannest K.Percentage of all non-overlapping data (PAND): An alternative to PND.Journal of Special Education. 2006;40:194-204.
31. Parker R. I.,Vannest K. J.,Brown L.The improvement rate difference for single-case research.Exceptional Children. 2009;75:135-150.
32. Parker R. I.,Vannest K. J.,Davis J. L.Effect size in single-case research: A review of nine nonoverlap techniques.Behavior Modification. 2011;35:303-322.
33. Parker R. I.,Vannest K. J.,Davis J. L.,Sauber S. B.Combining nonoverlap and trend for single-case research: Tau-U.Behavior Therapy. 2011;42:284-299.
34. Preston D.,Carter M.A review of the efficacy of the picture exchange communication system intervention.Journal of Autism and Developmental Disorders. 2009;39:1471-1486.
35. Reynhout G.,Carter M.Evaluation of the efficacy of social stories (TM) using three single subject metrics.Research in Autism Spectrum Disorders. 2011;5:885-900.
36. Salzberg C. L.,Strain P. S.,Baer D. M.Meta-analysis for single-subject research: When does it clarify, when does it obscure?.Remedial and Special Education. 1987;8 (2): 43-48.
37. Schneider N.,Goldstein H.,Parker R.Social skills interventions for children with autism: A meta-analytic application of percentage of all non-overlapping data (PAND).Evidence-Based Communication Assessment and Intervention. 2008;2:152-168.
38. Scruggs T. E.,Mastropieri M. A.,Casto G.Reply to Owen White.Remedial and Special Education. 1987a;8 (2): 40-42.
39. Scruggs T. E.,Mastropieri M. A.,Casto G.The quantitative synthesis of single-subject research: Methodology and validation.Remedial and Special Education. 1987b;8 (2): 24-33.
40. Slavin R. E.Mastery learning reconsidered.Review of Educational Research. 1987;57:175-213.
41. White O. R.Some comments concerning "The quantitative synthesis of single-subject research.".Remedial and Special Education. 1987;8 (2): 34-39.
42. Wolery M.,Busick M.,Reichow B.,Barton E. E.Comparison of overlap methods for quantitatively synthesizing single-subject data.Journal of Special Education. 2010;44:18-28.