Comparison of nonoverlap methods for identifying treatment effect in single-subject experimental research

Behavioral Disorders

Volumn 39, Issue 3, 2014, Pages 128-145

  Rakap, Salih ^a   Snyder, Patricia ^a   Pasia, Cathleen ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84904279083     PISSN: 01987429     EISSN: None     Source Type: Journal    
DOI: 10.1177/019874291303900303     Document Type: Article

References (56)

1. Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behavior Research and Therapy, 31, 621-631.
2. American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
3. Baer, D. (1977). Perhaps it would be better not to know everything. Journal of Applied Behavior Analysis, 10, 167-172.
4. Bambara, L. M., and Warren, S. F., & Komisar, S. (1988). The individualized curriculum sequencing model: Effects on skill acquisition and generalization. Journal of the Association for Persons with Severe Handicaps, 13, 8-19.
5. Beretvas, S. N., & Chung, H. (2008). A review of single-subject experimental design meta-analyses: Methodological issues and practice. Evidence-Based Communication Assessment and Intervention, 2, 129-141.
6. Biosoft (2004). UnGraph for Windows (Version 5.0). Cambridge, UK: Author.
7. Campbell, J. (2004). Statistical comparison of four effect sizes for single-subject designs. Behavior Modification, 28, 234-246.
8. Center, B. J., and Skiba., R. J., & Casey, A. (1986). A methodology for the quantitative synthesis of intra-subject design research. Journal of Special Education, 19, 387-400.
9. Chiara, L, and Schuster., J. W., Bell, J. K., & Wolery, M. (1995). Small-group massed-trial and individ-ually-distributed-trial instruction with preschoolers. Journal of Early Intervention, 19, 203-217.
10. Cohen, R. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Routledge.
11. DeProspero, A., & Cohen, S. (1979). Inconsistent visual analysis of intrasubject data. Journal of Applied Behavior Analysis, 12, 573-579.
12. Ferron, J., & Sentovich, C. (2002). Statistical power of randomization tests used with multiple baseline designs, journal of Experimental Education, 70, 165-178.
13. Grice, J. W., & Barrett, P. T. (2011). A note on Cohen's overlapping proportions of normal distributions. Stillwater, OK: Oklahoma State University, Department of Psychology, Retrieved from http://psychology.okstate.edu/faculty/ jgrice/personalitylab/CriceBarrett-2011-CohenOverlap.pdf
14. Crissom, R. J., & Kim, J. J. (2005). Effect sizes for research: A broad practical approach. New York: Psychology Press.
15. Hinton, P. R. (2004). Statistics explained: A guide for social science students (2nd ed.). New York: Routledge.
16. Horner, R. H., and Carr., E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165-179.
17. Kazdin, A. E. (1982). Single-case research designs: Methods for clinical and applied settings. New York: Oxford University Press.
18. Kokina, A., & Kern, L. (2010). Social story interventions for students with autism spectrum disorders: A meta-analysis. Journal of Autism & Developmental Disorders, 40, 812-826.
19. Kratochwill, T. R., Hitchcock, J., Horner, R. H., and Levin., J. R., Odom, S. L, Rindskopf, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc-scd. pdf
20. Laushey, K. M., and Heflin., L. J., Shippen, M., Alberto, P., & Fredrick, L. (2009). Concept mastery routines to teach social skills to elementary school children with high functioning autism. Journal of Autism and Developmental Disorders, 39, 1435-1448.
21. Lequia, J., Machalicek, W., & Rispoli, M. J. (2012). Effects of activity schedules on challenging behavior exhibited in children with autism spectrum disorders: a systematic review. Research in Autism Spectrum Disorders, 6, 480-492.
22. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
23. Ma, H. H. (2006). An alternative method for quantitative synthesis of single-subject researches: Percentage of data points exceeding the median. Behavior Modification, 30, 598-617.
24. Maggin, D. M., and Briesch., A. M., & Chafouleas, S. M. (2013). An application of the What Works Clearinghouse standards for evaluating single-subject research: Synthesis of the self-management literature-base. Remedial and Special Education, 34, 44-58.
25. Mason, R. A., and Ganz., J. B., Parker, R. I., Boles, M. B., and Davis., H. S., & Rispoli, M. J. (2013). Video-based modeling: Differential effects due to treatment protocol. Research in Autism Spectrum Disorders, 7, 120-131.
26. Ottenbacher, K. J. (1990). Visual inspection of single-subject data: An empirical analysis. Mental Retardation, 28, 283-290.
27. Park, H., Marascuilo, L., & Gaylord-Ross, R. (1990). Visual inspection and statistical analysis in single-case designs. Journal of Experimental Education, 50, 311-320.
28. Parker, R. I., & Brossait, D. F. (2003). Evaluating single-case data: A comparison of seven statistical methods. Behavior Therapy, 34, 189-211.
29. Parker, R. I., and Brossait., D. F., Callicott, K. J., Long, J. R., De-Alba, R. G., & Baugh, F. G., et al. (2005). Effect sizes in single case research: How large is large? School Psychology Review, 34, 116-132.
30. Parker, R. I., & Hagan-Burke, S. (2007). Median-based overlap analysis for single case data: A second study. Behavior Modification, 31, 919-936.
31. Parker, R. I., Hagan-Burke, S., & Vannest, S. (2007). Percentage of all nonoverlapping data (PAND): An alternative to PND. Journal of Special Education, 40, 194-204.
32. Parker, R. I., & Vannest, S. (2007). Pairwise data overlap for single case research. Unpublished manuscript.
33. Parker, R. I., & Vannest, K. J. (2009). An improved effect size for single case research: Nonoverlap of all pairs (NAP). Behavior Therapy, 40, 357-367.
34. Parker, R. I., and Vannest., K. J., & Brown, L. (2009). The improvement rate difference for single-case research. Exceptional Children, 75, 135-150.
35. Parker, R. I., and Vannest., K. J., & Davis, J. L. (2011). Effect size in single-case research: A review of nine nonoverlap techniques. Behavior Modification, 35, 303-322.
36. Parker, R. I., and Vannest., K. J., Davis, J. L., & Sauber, S. B. (2011). Combining non-overlap and trend for single case research: Tau-U. Behavior Therapy, 42, 284-299.
37. Parsonson, B. S., & Baer, D. M. (1986). The graphic analysis of data. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 157-186). New York: Plenum Press.
38. Rispoli, M., O'Reilly, M. F., Sigafoos, J., Lang, R., Kang, S., & Lancioni, G. (2011). The effects of precession satiation on challenging behavior and academic engagement for children with autism during classroom instruction. Education and Training in Autism and Developmental Disabilities, 46, 607-618.
39. Rogers, L, & Graham, S. (2008). A meta-analysis of single subject design writing intervention research. Journal of Educational Psychology, 100, 879-906.
40. Rosenthal, R. (1979). The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, 638-641.
41. Salzberg, C. L, Strain, P. S., & Baer, D. M. (1987). Meta-analysis for single-subject research: When does it clarify, when does it obscure? Remedial and Special Education, 8, 43-48.
42. Schneider, N., Goldstein, H., & Parker, R. (2008). Social skills interventions for children with autism: A meta-analytic application of percentage of all nonoverlapping data (PAND), Evidence-Based Communication Assessment and Intervention, 2, 152-162.
43. Scruggs, T. E., & Mastropieri, M. A. (1998). Summarizing single subject research: Issues and applications. Behavior Modification, 22, 221-242.
44. Scruggs, T. E., & Mastropieri, M. A. (2013). PND at 25: Past, present, and future trends in summarizing single-subject research. Remedial and Special Education, 34, 9-19.
45. Scruggs, T. E., and Mastropieri., M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education, 8, 24-33.
46. Shadish, W. R., Brasil, I. C. C, lllingworth, D. A., and White., K. D., Galindo, R., & Nagler, E. D., et al. (2009). Using UnGraph to extract data from image files: Verification of reliability and validity. Behavior Research Methods, 41, 177-183.
47. Shadish, W. R., & Rindskopf, D. M. (2007). Methods for evidence based practice: Quantitative synthesis of single-subject designs. In G. Julnes & D. J. Rog (Eds.), Informing federal policies on evaluation method: Building the evidence base for method choice in government sponsored evaluation (pp. 95-109). San Francisco, CA: Jossey-Bass.
48. Shadish, W. R., and Rindskopf., D. M., & Hedges, L. V. (2008). The state of the science in the metaanalysis of single-case experimental designs. Evidence-Based Communication Assessment & Intervention, 2, 188-196.
49. Snyder, P., Rakap, S., Hemmeter, M. L, McLaughlin, T., Sandall, S., & McLean, M. (2014). Naturalistic instructional approaches in early learning: A systematic review of the empirical literature. Manuscript submitted for publication.
50. Trembath, D., Balandin, S., Togher, L., & Standiffe, R. J. (2009). Peer-mediated teaching and augmentative and alternative communication for preschool-aged children with autism. Journal of Intellectual & Developmental Disability, 34, 173-186.
51. Van den Noortgate, W., & Onghena, P. (2003). Hierarchical linear models for the quantitative integration of effect sizes in single case research. Behavior Research Methods, Instruments & Computers, 35, 1-10.
52. Van Rie, G. L., & Heflin, L.J. (2009). The effect of sensory activities on correct responding for children with autism spectrum disorders. Research in Autism Spectrum Disorders, 3, 783-796.
53. White, O. R., & Haring, N. G. (1980). Exceptional teaching. Columbus, OH: Charles Merrill.
54. Wolery, M., Busick, M., Reichow, B., & Barton, E. (2008, February). Quantitative synthesis of single subject research. Paper presented at the Conference on Research Innovations in Early Intervention, San Diego, CA.
55. Wolery, M., Busick, M., Reichow, B., & Barton, E. (2010). Comparison of overlap methods for quantitatively synthesizing single-subject data. Journal of Special Education, 44, 18-28.
56. Wolery, M., & Harris, S. R. (1982). Interpreting results of single-subject research designs. Physical Therapy, 62, 445-452.