Computing Tools for Implementing Standards for Single-Case Designs

Behavior Modification

Volumn 39, Issue 6, 2015, Pages 835-869

  Chen, Li Ting ^a   Peng, Chao Ying Joanne ^a   Chen, Ming E ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

computing; effect; intervention; single case design; software; standards; WWC

Indexed keywords

HUMAN; METHODOLOGY; SOFTWARE; STANDARDS; STATISTICS;

HUMANS; RESEARCH DESIGN; SOFTWARE; STATISTICS AS TOPIC;

EID: 84946054325     PISSN: 01454455     EISSN: 15524167     Source Type: Journal    
DOI: 10.1177/0145445515603706     Document Type: Article

References (74)

1. A.Agresti (2002). Categorical data analysis. Hoboken, NJ: John Wiley.
2. P.M.BeesonR.R.Robey (2006). Evaluating single-subject treatment research: Lessons learned from the aphasia literature. Neuropsychological Review, 16, 161-169. doi:10.1007/s11065-006-9013-7
3. J.J.BorckardtM.R.Nash (2014). Simulation modelling analysis for small sets of single-subject data collected over time. Neuropsychological Rehabilitation: An International Journal, 24, 492-506. doi:10.1080/09602011.2014.895390
4. J.J.BorckardtM.R.NashM.D.MurphyM.MooreD.ShawP.O’Neil (2008). Clinical practice as natural laboratory for psychotherapy research: A guide to case-based time-series analysis. American Psychologist, 63(2), 77-95. doi:10.1037/0003-066x.63.2.77
5. D.F.BrossartK.J.VannestJ.L.DavisM.A.Patience (2014). Incorporating nonoverlap indices with visual analysis for quantifying intervention effectiveness in single-case experimental designs. Neuropsychological Rehabilitation: An International Journal, 24, 464-491. doi:10.1080/09602011.2013.868361
6. I.BultéP.Onghena (2012). When the truth hits you between the eyes: A software tool for the visual analysis of single-case experimental data. Methodology, 8, 104-114. doi:10.1027/1614-2241/a000042
7. I.BultéP.Onghena (2013). The single-case data analysis package: Analysing single-case experiments with R software. Journal of Modern Applied Statistical Methods, 12, 450-478. Retrieved from http://digitalcommons.wayne.edu/jmasm/
8. P.L.BuskL.A.Marascuilo (1992). Statistical analysis in single-case research: Issues, procedures, and recommendations, with applications to multiple behaviors. In T.R.KratochwillJ.R.Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 159-186). Hillsdale, NJ: Lawrence Erlbaum.
9. P.L.BuskR.C.Serlin (1992). Meta-analysis for single-case research. In T.R.KratochwillJ.R.Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187-212). Hillsdale, NJ: Lawrence Erlbaum.
10. J.Cohen (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
11. J.M.FerronJ.R.Levin (2014). Single-case permutation and randomization statistical tests: Present status, promising new developments. In T.R.KratochwillJ.R.Levin (Eds.), Single-case intervention research: Methodological and statistical advances (pp. 153-183). Washington, DC: American Psychological Association.
12. J.Fox (2005). The R commander: A basic-statistics graphical user interface to R. Journal of Statistical Software, 14(9), 1-41. Retrieved from http://www.jstatsoft.org/
13. J.Fox (2007). Extending the R commander by “plug-in” packages. R News, 7(3), 46-52. Retrieved from https://cran.r-project.org/doc/Rnews/
14. R.D.FranklinB.S.GormanT.M.BeasleyD.B.Allison (1997). Graphical display and visual analysis. In R.D.FranklinD.B.AllisonB.S.Gorman (Eds.), Design and analysis of single-case research (pp. 119-158). Mahwah, NJ: Lawrence Erlbaum.
15. B.S.GafurovJ.R.Levin (2014a). ExPRT user’s guide. Retrieved from http://code.google.com/p/exprt
16. B.S.GafurovJ.R.Levin (2014b). The Single-Case data-analysis ExPRT (Excel Package of Randomization Tests, Version 1.2). Retrieved from http://code.google.com/p/exprt
17. L.V.Hedges (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128. doi:10.2307/1164588
18. L.V.HedgesJ.E.PustejovskyW.R.Shadish (2012). A standardized mean difference effect size for single-case designs. Research Synthesis Methods, 3, 224-239. doi:10.1002/jrsm.1052
19. L.V.HedgesJ.E.PustejovskyW.R.Shadish (2013). A standardized mean difference effect size for multiple baseline designs across individuals. Research Synthesis Methods, 4, 324-341. doi:10.1002/jrsm.1086
20. M.HeyvaertO.WendtW.Van den NoortgateP.Onghena (2014). Randomization and data-analysis items in quality standards for single-case experimental studies. The Journal of Special Education. Advance online publication. doi:10.1177/0022466914525239
21. J.Hintze (2006). NCSS and PASS: Number cruncher statistical system [Computer software]. Kaysville, UT: NCSS.
22. R.H.HornerE.G.CarrJ.HalleG.McGeeS.OdomM.Wolery (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165-179.
23. IBM Corporation. (2014). IBM SPSS statistics base 22. Retrieved from http://www-01.ibm.com/support/docview.wss?uid=swg27038407#en
24. Institute of Education Sciences. (2013, February). What Works Clearinghouse: Procedures and standards handbook (Version 3.0). Retrieved from http://ies.ed.gov/ncee/wwc/DocumentSum.aspx?sid=19.
25. A.E.Kazdin (1982). Single-case research designs: Methods for clinical and applied settings. New York, NY: Oxford University Press.
26. C.H.Kennedy (2005). Single-case designs for educational research. Boston, MA: Pearson.
27. M.J.KoehlerJ.R.Levin (1998). Regulated randomization: A potentially sharper analytical tool for the multiple-baseline design. Psychological Methods, 3, 206-217. doi:10.1037/1082-989x.3.2.206
28. H.C.KraemerD.J.Kupfer (2006). Size of treatment effects and their importance to clinical research and practice. Biological Psychiatry, 59, 990-996. doi:10.1016/j.biopsych.2005.09.014
29. T.R.KratochwillJ.H.HitchcockR.H.HornerJ.R.LevinS.L.OdomD.M.RindskopfW.R.Shadish (2013). Single-case intervention research design standards. Remedial and Special Education, 34, 26-38. doi:10.1177/0741932512452794
30. T.R.KratochwillJ.R.Levin (1992). Single-case research design and analysis: New development for psychology and education. Hillsdale, NJ: Lawrence Erlbaum.
31. T.R.KratochwillJ.R.Levin (2014). Introduction: An overview of single-case intervention research. In T.R.KratochwillJ.R.Levin (Eds.), Single-case intervention research: Methodological and statistical advances (pp. 3-23). Washington, DC: American Psychological Association.
32. T.R.KratochwillJ.R.LevinR.H.HornerC.M.Swoboda (2014). Visual analysis of single-case intervention research: Conceptual and methodological considerations. In T.R.KratochwillJ.R.Levin (Eds.), Single-case intervention research: Methodological and statistical advances (pp. 91-125). Washington, DC: American Psychological Association.
33. M.C.LambertG.CartledgeW.L.HewardY.-Y.Lo (2006). Effects of response cards on disruptive behavior and academic responding during math lessons by fourth-grade urban students. Journal of Positive Behavior Interventions, 8, 88-99. doi:10.1177/10983007060080020701
34. J.D.LaneD.L.Gast (2014). Visual analysis in single case experimental design studies: Brief review and guidelines. Neuropsychological Rehabilitation: An International Journal, 24, 445-463. doi:10.1080/09602011.2013.815636
35. J.R.LevinJ.M.FerronB.S.Gafurov (2015). Randomization tests for phase-related slope and variability change in single-case intervention designs. [Manuscript in preparation].
36. H.-H.Ma (2006). An alternative method for quantitative synthesis of single-subject researches: Percentage of data points exceeding the median. Behavior Modification, 30, 598-617. doi:10.1177/0145445504272974
37. D.M.MagginH.SwaminathanH.J.RogersB.V.O’KeeffeG.SugaiR.H.Horner (2011). A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology, 49, 301-321. doi:10.1016/j.jsp.2011.03.004
38. R.ManolovD.L.GastM.PerdicesJ.J.Evans (2014). Single-case experimental designs: Reflections on conduct and analysis. Neuropsychological Rehabilitation: An International Journal, 24, 634-660. doi:10.1080/09602011.2014.903199
39. R.ManolovA.Solanas (2009). Percentage of nonoverlapping corrected data. Behavior Research Methods, 41, 1262-1271. doi:10.3758/BRM.41.4.1262
40. R.ManolovA.Solanas (2013). A comparison of mean phase difference and generalized least squares for analyzing single-case data. Journal of School Psychology, 51, 201-215. doi:10.1016/j.jsp.2012.12.005
41. L.A.MarascuiloP.L.Busk (1988). Combining statistics for multiple-baseline AB and replicated ABAB designs across subjects. Behavioral Assessment, 10, 1-28.
42. K.O.McGrawS.P.Wong (1992). A common language effect size statistic. Psychological Bulletin, 111, 361-365. doi:10.1037/0033-2909.111.2.361
43. C.MehtaN.Patel (2001). StatXact 5: Statistical software for exact nonparametric inference (User manual). Cambridge, MA: Cytel Software Corporation.
44. D.S.MooreG.P.McCabeM.J.Evans (2005). Introduction to the practice of statistics Minitab manual and Minitab version 14. New York, NY: W.H. Freeman.
45. S.MorleyM.Adams (1991). Graphical analysis of single-case time series data. British Journal of Clinical Psychology, 30, 97-115. doi:10.1111/j.2044-8260.1991.tb00926.x
46. R.B.Newson (2000). snp15.1: Update to somersd. Stata Technical Bulletin, 57, 35. Retrieved from http://www.stata.com/products/stb/journals/stb57.pdf
47. R.E.O’NeillJ.J.McDonnellF.F.BillingsleyW.R.Jenson (2011). Single case research designs in educational and community settings. Upper Saddle River, NJ: Pearson.
48. R.I.ParkerS.Hagan-Burke (2007). Useful effect size interpretations for single case research. Behavior Therapy, 38, 95-105. doi:10.1016/j.beth.2006.05.002
49. R.I.ParkerS.Hagan-BurkeK.Vannest (2007). Percentage of all non-overlapping data (PAND): An alternative to PND. The Journal of Special Education, 40, 194-204. doi:10.1177/00224669070400040101
50. R.I.ParkerK.Vannest (2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40, 357-367. doi:10.1016/j.beth.2008.10.006
51. R.I.ParkerK.J.VannestL.Brown (2009). The improvement rate difference for single-case research. Exceptional Children, 75, 135-150.
52. R.I.ParkerK.J.VannestJ.L.DavisS.B.Sauber (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284-299. doi:10.1016/j.beth.2010.08.006
53. C.Y.J.PengL.-T.Chen (2014). Beyond Cohen’s d: Alternative effect size measures for between-subject designs. Journal of Experimental Education, 82, 22-50. doi:10.1080/00220973.2012.745471
54. C.Y.J.PengL.-T.Chen (2015). Examining intervention effects in single-case studies with the Page test. Manuscript submitted for publication.
55. C.Y.J.PengL.-T.Chen (in press). Algorithms for assessing intervention effects in single-case studies. Journal of Modern Applied Statistical Methods.
56. J.E.PustejovskyL.V.HedgesW.R.Shadish (2014). Design-comparable effect sizes in multiple baseline designs: A general modeling framework. Journal of Educational and Behavioral Statistics, 39, 368-393. doi:10.3102/1076998614547577
57. SAS Institute Inc. (2014). SAS/STAT 13.1 user’s guide. Cary, NC: Author.
58. T.E.ScruggsM.A.MastropieriG.Casro (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education, 8(2), 24-33. doi:10.1177/074193258700800206
59. P.K.Sen (1968). Estimates of regression coefficient based on Kendall’s Tau. Journal of the American Statistical Association, 63, 1379-1389. doi:10.1080/01621459.1968.10480934
60. W.R.ShadishL.V.HedgesJ.E.Pustejovsky (2014). Analysis and meta-analysis of single-case designs with a standardized mean difference statistic: A primer and applications. Journal of School Psychology, 52, 123-147. doi:10.1016/j.jsp.2013.11.005
61. J.D.Smith (2012). Single-case experimental designs: A systematic review of published research and current standards. Psychological Methods, 17, 510-550. doi:10.1037/a0029312
62. G.L.SnowL.M.ChiharaT.Hesterberg (2005). S-PLUS guide for Moore and McMabe’s introduction to the practice of statistics. New York, NY: W.H. Freeman.
63. R.R.SokalF.J.Rohlf (1995). Biometry. New York, NY: W.H. Freeman.
64. A.SolanasR.ManolovP.Onghena (2010). Estimating slope and level change in N = 1 designs. Behavior Modification, 34, 195-218. doi:10.1177/0145445510363306
65. R.L.TateS.McDonaldM.PerdicesL.TogherR.SchultzS.Savage (2008). Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the Single-Case Experimental Design (SCED) scale. Neuropsychological Rehabilitation: An International Journal, 18, 385-401. doi:10.1080/09602010802009201
66. R.L.TateM.PerdicesS.McDonaldL.TogherU.Rosenkoetter (2014). The design, conduct and report of single-case research: Resources to improve the quality of the neurorehabilitation literature. Neuropsychological Rehabilitation: An International Journal, 24, 315-331. doi:10.1080/09602011.2013.875043
67. R.L.TateM.PerdicesU.RosenkoetterD.WakimK.GodbeeL.TogherS.McDonald (2013). Revision of a method quality rating scale for single-case experimental designs and n-of-1 trials: The 15-item Risk of Bias in N-of-1 Trials (RoBiNT) scale. Neuropsychological Rehabilitation: An International Journal, 23, 619-638. doi:10.1080/09602011.2013.824383
68. H.Theil (1950). A rank-invariant method of linear and polynomial regression analysis, III. Proceedings of the Koninklijke Nederlandse Akademie van Wetenschappen A, 53, 1397-1412.
69. J.W.Tukey (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
70. A.VarghaH.D.Delaney (2000). A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics, 25, 101-132. doi:10.2307/1165329
71. O.WendtB.Miller (2012). Quality appraisal of single-subject experimental designs: An overview and comparison of different appraisal tools. Education and Treatment of Children, 35, 235-268. Retrieved from http://muse.jhu.edu/journals/education_and_treatment_of_children/
72. O.R.White (1972). A manual for the calculation and use of the median slope: A technique of progress estimation and prediction in the single case. Eugene: Regional Resource Center for Handicapped Children, University of Oregon.
73. R.R.Wilcox (1996). Statistics for the social sciences. San Diego, CA: Academic Press.
74. M.WoleryG.DunlapJ.R.Ledford (2011). Single-case experimental methods: Suggestions for reporting. Journal of Early Intervention, 33, 103-109. doi:10.1177/1053815111418235