A comparison of mean phase difference and generalized least squares for analyzing single-case data

Journal of School Psychology

Volumn 51, Issue 2, 2013, Pages 201-215

  Manolov, Rumen ^a   Solanas, Antonio ^a  

^a UNIVERSITY OF BARCELONA   (Spain)

Author keywords

Autocorrelation; Differencing; Regression analysis; Single case; Trend

Indexed keywords

ARTICLE; COMPARATIVE STUDY; HUMAN; METHODOLOGY; REGRESSION ANALYSIS;

HUMANS; LEAST-SQUARES ANALYSIS; REGRESSION ANALYSIS; RESEARCH DESIGN;

EID: 84875373272     PISSN: 00224405     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsp.2012.12.005     Document Type: Article

References (80)

1. Allison D.B., Gorman B.S. Calculating effect sizes for meta-analysis: The case of the single case. Behaviour Research and Therapy 1993, 31:621-631.
2. Barlow D.H., Nock M.K., Hersen M. Single case experimental designs: Strategies for studying behavior change 2009, Pearson, Boston, MA. 3rd ed.
3. Brossart D.F., Parker R.I., Castillo L.G. Robust regression for single-case data analysis: How can it help?. Behavior Research Methods 2011, 43:710-719.
4. Brossart D.F., Parker R.I., Olson E.A., Mahadevan L. The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification 2006, 30:531-563.
5. Bulté I., Onghena P. Randomization tests for multiple-baseline designs: An extension of the SCRT-R package. Behavior Research Methods 2009, 41:477-485.
6. Campbell D.T., Stanley J.C. Experimental and quasi-experimental designs for research 1966, Rand McNally, Chicago, IL.
7. Colón, M. (2006). Improving the reliability and validity of visual inspection of data by behavior analysts: An empirical comparison of two training methods to improve visual inspection and interpretation, the job aid and the conservative dual-criteria. Electronic Theses, Treatises and Dissertations. Paper 3495.. http://diginole.lib.fsu.edu/etd/3495.
8. Crosbie J. The inability of the binomial test to control Type I error with single-subject data. Behavioral Assessment 1987, 9:141-150.
9. Cumming G. Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis 2012, Routledge, London, UK.
10. Danov S.E., Symons F.J. A survey evaluation of the reliability of visual inspection and functional analysis graphs. Behavior Modification 2008, 32:828-839.
11. DeProspero A., Cohen S. Inconsistent visual analyses of intersubject data. Journal of Applied Behavior Analysis 1979, 12:573-579.
12. Dolezal D.N., Weber K.P., Evavold J.J., Wylie J., McLaughlin T.F. The effects of a reinforcement package for on-task and reading behavior with at-risk and middle school students with disabilities. Child & Family Behavior Therapy 2007, 29:9-25.
13. Drager K.D.R., Postal V.J., Carrolus L., Castellano M., Gagliano C., Glynn J. The effect of aided language modeling on symbol comprehension and production in 2 preschoolers with autism. American Journal of Speech-Language Pathology 2006, 15:112-125.
14. Edgington E.S., Onghena P. Randomization tests 2007, Chapman & Hall/CRC, London. 4th ed.
15. Ferron J.M., Onghena P. The power of randomization tests for single-case phase designs. The Journal of Experimental Education 1996, 64:231-239.
16. Ferron J.M., Sentovich C. Statistical power of randomization tests used with multiple-baseline designs. The Journal of Experimental Education 2002, 70:165-178.
17. Fisher W.W., Kelley M.E., Lomas J.E. Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs. Journal of Applied Behavior Analysis 2003, 36:387-406.
18. Franklin R.D., Gorman B.S., Beasley T.M., Allison D.B. Graphical display and visual analysis. Design and analysis of single-case research 1996, 119-158. Erlbaum, Mahwah, NJ. R.D. Franklin, D.B. Allison, B.S. Gorman (Eds.).
19. Gast D.L., Spriggs A.D. Visual analysis of graphic data. Single subject research methodology in behavioral sciences 2009, 199-233. Routledge, London, UK. D.L. Gast (Ed.).
20. Glass G.V., Willson V.K., Gottman J.M. The design and analysis of time-series experiments 1975, Colorado Associated University Press, Boulder, CO.
21. Gorsuch R.L. Three methods for analyzing limited time-series (N of 1) data. Behavioral Assessment 1983, 5:141-154.
22. Greenwald A.G. Within-subject designs: To use or not to use?. Psychological Bulletin 1976, 8:314-320.
23. Grissom R.J., Kim J.J. Effect size for research: Univariate and multivariate applications 2012, Routledge, London, UK. 2nd ed.
24. Hagopian L.P., Fisher W.W., Thompson R.H., Owen-DeSchryver J., Iwata B.A., Wacker D.P. Toward the development of structured criteria for interpretation of functional analysis data. Journal of Applied Behavior Analysis 1997, 30:313-326.
25. Harrop J.W., Velicer W.F. A comparison of alternative approaches to the analysis of interrupted time-series. Multivariate Behavioral Research 1985, 20:27-44.
26. Hedges L.V., Olkin I. Statistical methods for meta-analysis 1985, Academic Press, New York, NY.
27. Horner R.H., Carr E.G., Halle J., McGee G., Odom S., Wolery M. The use of single-subject research to identify evidence-based practice in special education. Exceptional Children 2005, 71:165-179.
28. Houle T.T. Statistical analyses for single-case experimental designs. Single case experimental designs: Strategies for studying behavior change 2009, 271-305. Pearson, Boston, MA. 3rd ed. D.H. Barlow, M.K. Nock, M. Hersen (Eds.).
29. Huitema B.E., McKean J.W. Design specification issues in time-series intervention models. Educational and Psychological Measurement 2000, 60:38-58.
30. Institute of Education Sciences Request for applications: Statistical and research methodology in education Retrieved July 12, 2012 from. http://ies.ed.gov/funding/pdf/2013_84305D.pdf.
31. Jenson W.R., Clark E., Kircher J.C., Kristjansson S.D. Statistical reform: Evidence-based practice, meta-analyses, and single subject designs. Psychology in the Schools 2007, 44:483-493.
32. Johnston J.M., Pennypacker H.S. Strategies and tactics of human behavioral research 1980, Erlbaum, Hillsdale, NJ.
33. Kahng S.W., Chung K.-M., Gutshall K., Pitts S.C., Kao J., Girolami K. Consistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis 2010, 43:35-45.
34. Kazdin A.E. Single-case research designs: Methods for clinical and applied settings 1982, Oxford University Press, New York, NY.
35. Knapp T.J. Behavioral analysts' visual appraisal of behavior change in graphic display. Behavioral Assessment 1983, 5:155-164.
36. Kratochwill T.R., Brody G.H. Single subject designs: A perspective on the controversy over employing statistical inference and implications for research and training in behavior modification. Behavior Modification 1978, 2:291-307.
37. Kratochwill T.R., Hitchcock J., Horner R.H., Levin J.R., Odom S.L., Rindskopf D.M., et al. Single-case designs technical documentation Retrieved from What Works Clearinghouse website. http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
38. Kratochwill T.R., Levin J.R. Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods 2010, 15:124-144.
39. Kutner M.H., Nachtsheim C.J., Neter J., Li W. Applied linear statistical models 2005, McGraw-Hill, London, UK. 5th ed.
40. Lall V.F., Levin J.R. An empirical investigation of the statistical properties of generalized single-case randomization tests. Journal of School Psychology 2004, 42:61-86.
41. Levin J.R., Ferron J.M., Kratochwill T.R. Nonparametric statistical tests for single-case systematic and randomized ABAB ... AB and alternating treatment intervention designs: New developments, new directions. Journal of School Psychology 2012, 50:599-624.
42. Levin J.R., Lall V.F., Kratochwill T.R. Extensions of a versatile randomization test for assessing single-case intervention effects. Journal of School Psychology 2011, 49:55-79.
43. Maggin D.M., Swaminathan H., Rogers H.J., O'Keefe B.V., Sugai G., Horner R.H. A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology 2011, 49:301-321.
44. Manolov R., Solanas A. Comparing N=1 effect size indices in presence of autocorrelation. Behavior Modification 2008, 32:860-875.
45. Manolov R., Solanas A. Assigning and combining probabilities in single-case studies. Psychological Methods 2012, July 16, 10.1037/a0029248.
46. Manolov R., Solanas A., Sierra V., Evans J.J. Choosing among techniques for quantifying single-case intervention effectiveness. Behavior Therapy 2011, 42:533-545.
47. McCleary R., Hay R.A. Applied time series analysis for the social sciences 1980, Sage, Beverly Hills, CA.
48. McKnight S.D., McKean J.W., Huitema B.E. A double bootstrap method to analyze linear models with autoregressive error terms. Psychological Methods 2000, 3:87-101.
49. Michael J. Statistical inference for individual organism research: Mixed blessing or curse?. Journal of Applied Behavior Analysis 1974, 7:647-653.
50. Onghena P. Randomization tests for extensions and variations of ABAB single-case experimental designs: A rejoinder. Behavioral Assessment 1992, 14:153-171.
51. Onghena P., Edgington E.S. Randomization tests for restricted alternating treatments designs. Behaviour Research and Therapy 1994, 32:783-786.
52. Ottenbacher K.J. Visual inspection of single-subject data: An empirical analysis. Mental Retardation 1990, 28:283-290.
53. Parker R.I. Increased reliability for single-case research results: Is bootstrap the answer?. Behavior Therapy 2006, 37:326-338.
54. Parker R.I., Brossart D.F. Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy 2003, 34:189-211.
55. Parker R.I., Cryer J., Byrns G. Controlling baseline trend in single-case research. School Psychology Quarterly 2006, 21:418-443.
56. Parker R.I., Hagan-Burke S. Median-based overlap analysis for single case data: A second study. Behavior Modification 2007, 31:919-936.
57. Parker R.I., Vannest K.J. An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy 2009, 40:357-367.
58. Parsonson B.S., Baer D.M. The graphic analysis of data. Research methods in applied behavior analysis: Issues and advances 1986, 157-186. Plenum Press, New York, NY. A. Poling, R.W. Fuqua (Eds.).
59. R Development Core Team R: A language and environment for statistical computing 2012, R Foundation for Statistical Computing, Vienna, Austria, (URL http://www.R-project.org/).
60. Robey R.R., Schultz M.C., Crawford A.B., Sinner C.A. Single-subject clinical outcome research: Designs, data, effect sizes, and analysis. Aphasiology 1999, 13:445-473.
61. Schlosser R.W., Lee D.L., Wendt O. Application of the percentage of non-overlapping data (PND) in systematic reviews and meta-analyses: A systematic review of reporting characteristics. Evidence-Based Communication Assessment and Intervention 2008, 2:163-187.
62. Schneider N., Goldstein H., Parker R. Social skills interventions for children with autism: A meta-analytic application of percentage of all non-overlapping data (PAND). Evidence-Based Communication Assessment and Intervention 2008, 2:152-162.
63. Scruggs T.E., Mastropieri M.A., Casto G. The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education 1987, 8:24-33.
64. Shadish W.R., Sullivan K.J. Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods 2011, 43:971-980.
65. Sidman M. Tactics of scientific research: Evaluating experimental data in psychology 1960, Basic Books, New York, NY.
66. Sierra V., Solanas A., Quera V. Randomization tests for systematic single-case designs are not always appropriate. The Journal of Experimental Education 2005, 73:140-160.
67. Simonton D.K. Cross-sectional time-series experiments: Some suggested statistical analyses. Psychological Bulletin 1977, 84:489-502.
68. Skiba R., Deno S., Marston D., Casey A. Influence of trend estimation and subject familiarity on practitioners judgements of intervention effectiveness. Journal of Special Education 1989, 22:433-446.
69. Skinner B.F. The behavior of organisms: An experimental analysis 1938, Appleton-Century, New York, NY.
70. Solanas A., Manolov R., Onghena P. Estimating slope and level change in N=1 designs. Behavior Modification 2010, 34:195-218.
71. Solanas A., Manolov R., Sierra V. Lag-one autocorrelation in short series: Estimation and hypothesis testing. Psicológica 2010, 31:357-381.
72. Tate R.L., McDonald S., Perdices M., Togher L., Schultz R., Savage S. Rating the methodological quality of single subject designs and n-of-1 trials: Introducing the Single-Case Experimental Design (SCED) Scale. Neuropsychological Rehabilitation 2008, 18:385-401.
73. Tate R.L., Togher L., Perdices M., McDonald S., Rosenkoetter U. Developing reporting guidelines for single-case experimental designs: The SCRIBE project. Paper presented at the 9th Conference of the Neuropsychological Rehabilitation Special Interest Group of the World Federation for Neurorehabilitation, Bergen, Norway 2012, July.
74. Tryon W.W. A simplified time-series analysis for evaluating treatment interventions. Journal of Applied Behavior Analysis 1982, 15:423-429.
75. Van Den Noortgate W., Onghena P. Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments, & Computers 2003, 35:1-10.
76. Wampold B.E., Goodheart C., Levant R. Clarification and elaboration on evidence-based practice in psychology. The American Psychologist 2007, 62:616-618.
77. White O.R. The split-middle: A quickie method of trend analysis 1972, Regional Center for Handicapped Children, Eugene, OR.
78. White D.M., Rusch F.R., Kazdin A.E., Hartmann D.P. Applications of meta-analysis in individual subject research. Behavioral Assessment 1989, 11:281-296.
79. Whitlock M.C. Combining probability from independent tests: The weighted Z-method is superior to Fisher's approach. Journal of Evolutionary Biology 2005, 18:1368-1373.
80. Zeileis, A., & Hothorn, T. (2002). Diagnostic checking in regression relationships. R News, 2(3), 7-10. URL http://CRAN.R-project.org/doc/Rnews/.