A generalized least squares regression approach for computing effect sizes in single-case research: Application examples

Journal of School Psychology

Volumn 49, Issue 3, 2011, Pages 301-321

  Maggin, Daniel M ^a   Swaminathan, Hariharan ^a   Rogers, Helen J ^a   O'Keeffe, Breda V ^a   Sugai, George ^a   Horner, Robert H ^b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b UNIVERSITY OF OREGON   (United States)

Author keywords

Autocorrelation; Effect size; Methodology; Single case research

Indexed keywords

ARTICLE; BULLYING; HUMAN; METHODOLOGY; REGRESSION ANALYSIS;

BULLYING; HUMANS; LEAST-SQUARES ANALYSIS; RESEARCH DESIGN;

EID: 79957844168     PISSN: 00224405     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsp.2011.03.004     Document Type: Article

References (78)

1. Allison D.B., Gorman B.S. Calculating effect sizes for meta-analysis: The case of the single case. Behavior Research and Therapy 1993, 31:621-631.
2. Baer D.M., Wolfe M.M., Risley T.R. Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis 1968, 1:91-97.
3. Beach C.M., MacKinnon J.G. A maximum likelihood procedure for regression with autocorrelated errors. Econometrica 1978, 46:51-58.
4. Beretvas S.N., Chung H. A review of meta-analyses of single-subject experimental designs: Methodological issues and practice. Evidence-Based Communication Assessment & Intervention 2008, 2:129-141.
5. Borenstein M., Hedges L.V., Higgins J.P.T., Rothstein H.R. Introduction to meta-analysis 2009, Wiley, West Sussex, United Kingdom.
6. Busk P.L., Marascuilo L.A. Statistical analysis in single-case research: Issues, procedures, and recommendations with applications to multiple behaviors. Single-case research design and analysis: New directions for psychology and education 1992, 159-185. Erlbaum, Hillsdale, NJ. T. Kratochwill, J.R. Levin (Eds.).
7. Busk P.L., Serlin R.C. Meta-analysis for single-case research. Single-case research design and analysis: New directions for psychology and education 1992, 187-212. Erlbaum, Hillsdale, NJ. T.R. Kratochwill, J.R. Levin (Eds.).
8. Center B.J., Skiba R.J., Casey A. A methodology for the quantitative synthesis of intra-subject design research. Journal of Special Education 1985-1986, 19:387-400.
9. Clements M.P., Hendry D.F. Forecasting economic time series 1998, Cambridge University Press, Cambridge.
10. Cochrane D., Orcutt G.H. Application of least squares regression to relationships containing autocorrelated error terms. Journal of the American Statistical Association 1949, 44:32-61.
11. Crosbie J. The inability of the binomial test to control Type I error with single-subject data. Behavioral Assessment 1987, 9:141-150.
12. Crosbie J. Interrupted time-series analysis with brief single-subject data. Journal of Consulting and Clinical Psychology 1993, 61:966-974.
13. Crosbie J. Interrupted time-series analysis with short series: Why it is problematic; how it can be improved. The analysis of change 1995, 361-395. Erlbaum, Mahwah, NJ. J.M. Gottman (Ed.).
14. DeProspero A., Cohen S. Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis 1979, 12:573-579.
15. Faith M.S., Allison D.B., Gorman B.S. Meta-analysis of single-case research. Design and analysis of single-case research 1996, 245-277. Erlbaum, Hillsdale, NJ. R.D. Franklin, D.B. Allison, B.S. Gorman (Eds.).
16. Single-subject research methodology in behavioral sciences 2010, Routledge Press, New York. D.L. Gast (Ed.).
17. Gersten R., Chard D.J., Jayanthi M., Baker S.K., Morphy P., Flojo J.R. Mathematics instruction for students with learning disabilities: A meta-analysis of instructional components. Review of Educational Research 2009, 79:1202-1242.
18. Gingerich W.J. Meta-analysis of applied tiome-series data. The Journal of Applied Behavioral Science 1984, 20:71-79.
19. Gorman B.S., Allison B.B. Statistical alternative for single-case designs: Design and analysis of single-case research. Design and analysis of single case research 1996, 159-214. Erlbaum, Hillsdale, NJ. R.D. Franklin, D.B. Allison, B.S. Gorman (Eds.).
20. Gorsuch R.L. Three methods for analyzing limited time series (N of 1) data. Behavioral Assessment 1983, 5:141-154.
21. Gottman J.M. Time-series analysis: A comprehensive introduction for social scientists 1981, Cambridge University Press, New York.
22. Hersen M., Barlow D.H. Single-case experimental designs: Strategies for studying behavior 1976, Pergamon Press, New York.
23. Horner R.H., Carr E.G., Halle J., McGee G., Odom S., Wolery M. The use of single-subject research to identify evidence-based practice in special education. Exceptional Children 2005, 71:161-179.
24. Horner R.H., Swaminathan H., Sugai G., Smolkowski K. Expanding analysis and use of single-case research 2009, Institute for Education Sciences, U.S. Department of Education, Washington, DC.
25. Huitema B.E. Autocorrelation in applied behavior analysis: A myth. Behavioral Assessment 1985, 7:107-118.
26. Huitema B.E. Autocorrelation in behavioral research: Wherefore art thou?. Research methods in applied behavior analysis: Issues and advances 1986, 209-233. Plenum Press, New York. A. Poling, R.W. Fuqua (Eds.).
27. Huitema B.E. Autocorrelation: 10years of confusion. Behavioral Assessment 1990, 10:253-294.
28. Huitema B.E. Analysis of interrupted time series experiments using ITSE: A critique. Understanding Statistics 2004, 3:27-46.
29. Huitema B.E., McKean J.W. A simple and powerful test for autocorrelated errors in OLS intervention models. Psychological Reports 2000, 87:3-20.
30. Huitema B.E., McKean J.W. Identifying autocorrelation generated by various error processes in interrupted time-series regression designs. Educational and Psychological Measurement 2007, 67:447-459.
31. Hunt M.M. How science takes stock: The story of meta-analysis 1997, Sage, New York.
32. Jayaratne S., Tripodi T., Talsma E. The comparative analysis and aggregation of single-case data. The Journal of Applied Behavioral Science 1988, 24:119-128.
33. Jenson W.R., Clark E., Kircher J.C., Kristjansson S.D. Statistical reform: Evidence-based practice, meta-analyses, and single-subject designs. Psychology in the Schools 2007, 44:483-493.
34. Kennedy C.H. Single-case designs for educational research 2005, Allyn and Bacon, New York.
35. Kirk R.E. Practical significance: A concept whose time has come. Educational and Psychological Measurement 1996, 56:746-759.
36. Single subject research 1978, Academic Press, New York. T. Kratochwill (Ed.).
37. Kratochwill T.R., Hitchcock J., Horner R.H., Levin J.R., Odom S.L., Rindskopf D.M., et al. Single-case designs technical documentation 2010, Retrieved from What Works Clearinghouse website:. http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
38. Lambert M.C., Cartledge G., Heward W.L., Lo Y. Effects of response cards on disruptive behavior and academic responding during math lessons by fourth-grade urban students. Journal of Positive Behavior Interventions 2006, 8:88-99.
39. Lipsey M.W., Wilson D.B. Practical meta-analysis 2001, Sage Publications, Thousand Oaks, CA.
40. Ma H.H. An alternative method for quantitative synthesis of single-subject researches: Percentage of data points exceeding the median. Behavior Modification 2006, 30:598-617.
41. Manolov R., Solanas A. Comparing N=1 effect size indices in presence of autocorrelation. Behavior Modification 2008, 32:860-875.
42. Matyas T.A., Greenwood K.M. Serial dependency in single-case time series. Design and analysis of single-case research 1996, 215-243. Erlbaum, Mahwah, NJ. R.D. Franklin, D.B. Allison, B.S. Gorman (Eds.).
43. McCleary R., Hay R.A. Applied time series analysis 1980, Sage, Beverley Hills, CA.
44. McKnight S.D., McKean J.W., Huitema B.E. A double bootstrap method to analyze linear models with autoregressive error terms. Psychological Methods 2000, 1:87-101.
45. Evidence matters: Randomized trials in education research 2002, Brookings Institute, Washington DC. F. Mosteller, R. Boruch (Eds.).
46. National Research Council Scientific research in education. Committee on Scientific Principles for Education Research. Center for Education. Division of Behavioral and Social Sciences and Education 2002, National Academy Press, Washington, DC. R.J. Shavelson, L. Towne (Eds.).
47. No Child Left Behind Retrieved March 24, 2011 from. http://www2.ed.gov/policy/elsec/leg/esea02/index.html.
48. Odom S.L., Brantlinger E., Gersten R., Horner R.H., Thompson B., Harris K.R. Research in special education: Scientific methods and evidence-based practices. Exceptional Children 2005, 71:137-148.
49. Okagaki L., Albro E.R., Buckley J.A. Institute of Education Sciences: Putting science back into education research. Education science: Critical perspectives 2009, 1-24. Sense, Boston. R. St.Clair (Ed.).
50. Ottenbacher K.J. Interrater agreement of visual analysis in single-subject decisions: Quantitative review and analysis. American Journal of Mental Retardation 1993, 98:135-142.
51. Parker R.I., Brossart D.F. Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy 2003, 34:189-211.
52. Parker R., Hagan-Burke S. Useful effect size interpretations for single-case research. Behavior Therapy 2007, 38:95-105.
53. Parker, R. I. and Vannest, S., (2007b). Pairwise data overlap for single case research. Unpublished manuscript.
54. Parker R.I., Brossart D.F., Vannest K.J., Long J.R., Garcia De-Alba R., Baugh F.G., et al. Effect sizes in single-case research: How large is large?. School Psychology Review 2005, 34:116-132.
55. Parker R.I., Cryer J., Byrns G. Controlling baseline trend in single-case research. School Psychology Quarterly 2006, 21:418-444.
56. Parker R., Hagan-Burke S., Vannest S. Percentage of all non-overlapping data points (PAND): An alternative to PND. Journal of Special Education 2007, 40:194-204.
57. Parker R.I., Vannest K.J., Brown L. The "improvement rate difference" for single-case research. Exceptional Children 2009, 75:135-150.
58. Parsonson B., Baer D. The analysis and presentation of graphic data. Single subject research 1978, 101-166. Academic Press, New York. T. Kratochwill (Ed.).
59. Rogers, H. and Swaminathan, H. (2009). SINGSUB (1.0) [Computer program]. Unpublished computer program.
60. Ross S.W., Horner R.H. Bully prevention in positive behavior support. Journal of Applied Behavior Analysis 2009, 42:747-759.
61. Salzberg C.L., Strain P.S., Baer D.M. Meta-analysis for single-subject research: When does it clarify, when does it obscure?. Remedial and Special Education 1987, 8:43-48.
62. Scruggs T.E., Mastropieri M.A., Casto G. The quantitative synthesis of single-subject research. Methodology and validation. Remedial and Special Education 1987, 8:24-33.
63. Shadish W.R., Rindskopf D.M. Methods for evidence-based practice: Quantitative synthesis of single-subject designs. New Directions for Evaluation 2007, 113:95-109.
64. Shadish W.R., Rindskopf D.M., Hedges L.V. The state of the science in the meta-analysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention 2008, 2:188-196.
65. Snijders T., Bosker R. Multilevel analysis: An introduction to basic and advanced multilevel modeling 1999, SAGE Publications, London.
66. Solanas A., Manolov R., Sierra V. Lag-one autocorrelation in short series: Estimation and hypothesis testing. Psicológica 2010, 31:357-381.
67. Swaminathan, H., Horner, R. H., Sugai, G., Smolkowski, K., Hedges, L., Spaulding, S. A. (2010). Application of generalized least squares regression to measure effect size in single-case research: A technical report. Unpublished technical report, Institute for Education Sciences.
68. Tawney J.W., Gast D.L. Single subject research in special education 1984, Merrill, Columbus.
69. Tervo R.C., Estrem T.L., Bryson-Brockmann W., Symons F.J. Single-case experimental designs: Applications in developmental-behavioral pediatrics. Journal of Developmental and Behavioral Pediatrics 2003, 24:438-448.
70. Van den Noortgate W., Onghena P. Hierachical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments, & Computers 2003, 35:1-10.
71. Van den Noortgate W., Onghena P. A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment & Intervention 2008, 2:142-151.
72. What Works Clearinghouse Study review standards 2003, Author, Washington, DC, Retrieved December 14, 2009 from. http://www.aea267.k12.ia.us/rr/files/What_Works_Clearninghouse.pdf.
73. What Works Clearinghouse Evidence standards for review studies (Version 1.0) 2008, Author, Washington, DC, Retrieved December 14, 2009 from. http://ies.ed.gov/ncee/wwc/pdf/wwc_version1_standards.pdf.
74. What Works Clearinghouse Procedures and standards handbook (Version 2.0) 2008, Author, Washington, DC, Retrieved December 14, 2009, from. http://ies.ed.gov/ncee/wwc/pdf/wwc_procedures_v2_standards_handbook.pdf.
75. White O.R. The quantitative synthesis of single-subject research: Methodology and validation. Comment. Remedial and Special Education 1987, 8:34-39.
76. White D.M., Rusch F.R., Kazdin A.E., Hartmann D.P. Applications of meta-analysis in individual subject research. Behavioral Assessment 1989, 11:281-296.
77. Whitehurst G.J. The Institute of Education Sciences: New wine, new bottles. Paper presented at the annual conference of the American Educational Research Association. Los Angeles, CA 2003, Retrieved December 14, 2009, from. https://www.ed.gov/rschstat/research/pubs/ies.pdf.
78. Wolery M., Busick M., Reichow B., Barton E.E. Comparison of overlap methods for quantitatively synthesizing single-subject data. Journal of Special Education 2010, 44:18-28.