Effect sizes as result interpretation aids in single-subject experimental research: Description and application of four nonoverlap methods

British Journal of Special Education

Volumn 42, Issue 1, 2015, Pages 11-33

  Rakap, Salih ^a  

^a ONDOKUZ MAYIS UNIVERSITY   (Turkey)

Author keywords

Effect size; IRD; PEM T; PND; Single subject experimental research; Tau U

Indexed keywords

EID: 84924765278     PISSN: 09523383     EISSN: 14678578     Source Type: Journal    
DOI: 10.1111/1467-8578.12091     Document Type: Article

References (47)

1. Allison, D. B. & Gorman, B. S. (1993) 'Calculating effect sizes for meta-analysis: the case of the single case', Behavior Research and Therapy, 31, 621-631.
2. Altman, D. G. (1999) Practical Statistics for Medical Research. Bristol: Chapman & Hall.
3. APA (American Psychological Association) (2010) Publication Manual of the American Psychological Association (6th edition). Washington, DC: APA.
4. Baer, D. (1977) 'Perhaps it would be better not to know everything', Journal of Applied Behavior Analysis, 10, 167-172.
5. Brossart, D. F., Parker, R. I., Olson, E. A. & Mahadevan, L. (2006) 'The relationship between visual analysis and five statistical analyses in a simple AB single-case research design', Behavior Modification, 30, 531-563.
6. Busk, P. L. & Serlin, R. C. (1992) 'Meta-analysis for single-case research', in T. R. Kratochwil & J. R. Levin (eds), Single-Case Research Design and Analysis: new directions for psychology and education. Hillsdale, NJ: Lawrence Erlbaum.
7. Cakiroglu, O. (2013) 'Single subject research: applications to special education', British Journal of Special Education, 39, 21-29.
8. Cohen, J. (1965) 'Some statistical issues in psychological research', in B. B. Wolman (ed.), Handbook of Clinical Psychology. New York: McGraw-Hill.
9. Cooper, H., Hedges, L. V. & Valentine, J. C. (2009) Handbook of Research Synthesis and Meta-analysis. New York: Russell Sage Foundation.
10. DeProspero, A. & Cohen, S. (1979) 'Inconsistent visual analysis of intrasubject data', Journal of Applied Behavior Analysis, 12, 573-579.
11. Ferron, J. & Sentovich, C. (2002) 'Statistical power of randomization tests used with multiple baseline designs', Journal of Experimental Education, 70, 165-178.
12. Gast, D. L. (ed.) (2010) Single-Subject Research Methodology in Behavioral Sciences. New York: Routledge.
13. Holcombe, A., Wolery, M. & Gast, D. L. (1994) 'Comparative single-subject research: description of designs and discussion of problems', Topics in Early Childhood Special Education, 14, 119-145.
14. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S. & Wolery, M. (2005) 'The use of single-subject research to identify evidence-based practice in special education', Exceptional Children, 71, 165-179.
15. Huitema, B. E. & McKean, J. W. (2000) 'A simple and powerful test for autocorrelated errors in OLS intervention models', Psychological Reports, 87, 3-20.
16. Kazdin, A. E. (2011) Single-Case Research Design: methods for clinical and applied settings. New York: Oxford University Press.
17. Kennedy, C. H. (2005) Single-Case Designs for Educational Research. Boston, MA: Allyn and Bacon.
18. Kratochwill, T. (ed.) (1978) Single Subject Research. New York: Academic Press.
19. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M. & Shadish, W. R. (2010) Single-case designs technical documentation [online at http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf].
20. Lenz, A. S. (2013) 'Calculating effect size in single-case research: a comparison of nonoverlap methods', Measurement and Evaluation in Counseling and Development, 46, 64-73.
21. Lipsey, M. W. & Wilson, D. B. (2001) Practical Meta-analysis. Thousand Oaks, CA: Sage.
22. Ma, H. H. (2006) 'An alternative method for quantitative synthesis of single-subject researches: percentage of data points exceeding the median', Behavior Modification, 30, 598-617.
23. Ma, H. H. (2009) 'The effectiveness of intervention on the behavior of individuals with autism: a meta-analysis using percentage of data points exceeding the median of baseline phase (PEM)', Behavior Modification, 33, 339-359.
24. Maggin, D. M., Briesch, A. M. & Chafouleas, S. M. (2013) 'An application of the What Works Clearinghouse standards for evaluating single-subject research: synthesis of the self-management literature-base', Remedial and Special Education, 34, 44-58.
25. Maggin, D. M., Swaminathan, H., Rogers, H. J., O'Keeffe, B. V., Sugai, G. & Horner, R. (2011) 'A generalized least squares regression approach for computing effect sizes in single-case research: application examples', Journal of School Psychology, 49, 301-321.
26. Morgan, D. L. & Morgan, R. K. (2009) Single-Case Research Methods for the Behavioral and Health Sciences. Los Angeles: Sage.
27. Okagaki, L., Albro, E. R. & Buckley, J. A. (2009) 'Institute of Education Sciences: putting science back into education research', in R. St. Clair (ed.), Education Science: critical perspectives. Boston, MA: Sense.
28. Olive, M. L. & Smith, B. W. (2005) 'Effect size calculations and single subject designs', Educational Psychology, 25, 313-324.
29. Ottenbacher, K. J. (1990) 'Visual inspection of single-subject data: an empirical analysis', Mental Retardation, 28, 283-290.
30. Park, H. S., Marascuilo, L. & Gaylord-Ross, R. (1990). 'Visual inspection and statistical analysis in single-case designs', Journal of Experimental Education, 58, 311-320.
31. Parker, R. I. & Hagan-Burke, S. (2007) 'Median-based overlap analysis for single case data: a second study', Behavior Modification, 31, 919-936.
32. Parker, R. I., Hagan-Burke, S. & Vannest, S. (2007) 'Percentage of all nonoverlapping data (PAND): an alternative to PND', Journal of Special Education, 40, 194-204.
33. Parker, R. I. & Vannest, K. J. (2009) 'An improved effect size for single case research: nonoverlap of all pairs (NAP)', Behavior Therapy, 40, 357-367.
34. Parker, R. I., Vannest, K. J. & Brown, L. (2009) 'The improvement rate difference for single-case research', Exceptional Children, 75, 135-150.
35. Parker, R. I., Vannest, K. J. & Davis, J. L. (2011) 'Effect size in single-case research: a review of nine nonoverlap techniques', Behavior Modification, 35, 303-322.
36. Parker, R. I., Vannest, K. J., Davis, J. L. & Sauber, S. B. (2011) 'Combining non-overlap and trend for single case research: Tau-U', Behavior Therapy, 42, 284-299.
37. Parsonson, B. S. & Baer, D. M. (1986) 'The graphic analysis of data', in A. Poling & R. W. Fuqua (eds), Research Methods in Applied Behavior Analysis: issues and advances. New York: Plenum Press.
38. Rakap, S., Snyder, P. & Pasia, C. (2014). 'Comparison of nonoverlap methods for identifying treatment effect in single-subject experimental research', Behavioral Disorders, 39, 128-145.
39. Rakap, S., Snyder, P., Rakap, S. & Pasia, C. (under review) 'Evaluating treatment effect in single-subject experimental research: a comparison of five nonoverlap methods'.
40. Rispoli, M., Lang, R., Neely, L., Hutchins, N., Camargo, S., Davenport, K. & Goodwyn F. (2013) 'A comparison of within- and across-activity choices for reducing challenging behavior in children with autism spectrum disorders', Journal of Behavioral Education, 22, 66-83.
41. Scruggs, T. E., Mastropieri, M. A. & Casto, G. (1987) 'The quantitative synthesis of single-subject research methodology and validation', Remedial and Special Education, 8, 24-33.
42. Smith, J. D. (2012) 'Single-case experimental designs: a systematic review of published research and current standards', Psychological Methods, 17, 510-550.
43. Van den Noortgate, W. & Onghena, P. (2003) 'Hierarchical linear models for the quantitative integration of effect sizes in single case research', Behavior Research Methods, Instruments & Computers, 35, 1-10.
44. Vannest, K.J., Parker, R.I. & Gonen, O. (2011) 'Single case research: web based calculators for SCR analysis (Version 1.0) [Web-based application]', College Station, TX: Texas A&M University [online at singlecaseresearch.org].
45. White, O. R. & Haring, N. G. (1980) Exceptional Teaching (second edition). Columbus, OH: Charles Merrill.
46. Wolery, M., Busick, M., Reichow, B. & Barton, E. (2010) 'Comparison of overlap methods for quantitatively synthesizing single-subject data', Journal of Special Education, 44, 18-28.
47. Wolery, M. & Harris, S. R. (1982) 'Interpreting results of single-subject research designs', Physical Therapy, 62, 445-452.