From a single-level analysis to a multilevel analysis of single-case experimental designs

Journal of School Psychology

Volumn 52, Issue 2, 2014, Pages 191-211

  Moeyaert, Mariola ^a   Ferron, John M ^b   Beretvas, S Natasha ^c   Van den Noortgate, Wim ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

^c UNIVERSITY OF TEXAS   (United States)

Author keywords

Multilevel analysis; Single case experimental design

Indexed keywords

HUMAN; METHODOLOGY; STANDARDS; STATISTICAL ANALYSIS; STATISTICAL MODEL;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; RESEARCH DESIGN;

EID: 84897665387     PISSN: 00224405     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsp.2013.11.003     Document Type: Article

References (44)

1. Akaike H. Information theory and an extension of the maximum likelihood principle. Second International Symposium on Information Theory 1973, 267-281. Akademiai Kiado, Budapest, Hungary. B.N. Petrov, F. Csaki (Eds.).
2. Ferron J.M., Bell B.A., Hess M.R., Rendina-Gobioff G., Hibbard S.T. Making treatment effect inferences from multiple baseline data: The utility of multilevel modeling approaches. Behavior Research Methods 2009, 41:372-384.
3. Ferron J., Moeyaert M., Van den Noortgate W., Beretvas S.N. Estimating causal effects from multiple-baseline studies: Implications for design and analysis 2013, (submitted for publication).
4. Goldstein H. Multilevel statistical models 1995, Adward Arnold, London, England.
5. Goldstein H., Rasbash J. Multilevel time series models with applications to repeated measures data. Statistics in Medicine 1994, 13:1643-1655.
6. Hedges L.V., Pustejovsky J.E., Shadish W.R. A standardized mean difference effect size for single case designs. Research Synthesis Methods 2012, 3:224-239.
7. Huitema B.E., McKean J.W. Two biased-reduced autocorrelation estimators: rF1 and rF2. Perceptual and Motor Skills 1994, 78:323-330.
8. Huitema B.E., McKean J.W. Irrelevant autocorrelation in least-squares intervention models. Psychological Methods 1998, 1:104-116.
9. Jennrich R.I., Schluchter M.D. Unbalanced repeated-measures models with structured covariance matrices. Biometrics 1986, 42:805-820.
10. Koegel L.K., Camarata S.M., Valdez-Menchaca M., Koegel R.L. Setting generalization of question-asking by children with autism. American Journal on Mental Retardation 1998, 102:346-357.
11. Koegel R.L., Symon J.B., Koegel L.K. Parent education for families of children with autism living in geographically distant areas. Journal of Positive Behavior Interventions 2002, 4:88-103.
12. Koutsoftas A.D., Harmon M.T., Gray S. The effect of tier 2 intervention for phonemic awareness in a response-to-intervention model in low-income preschool classrooms. Language, Speech, and Hearing Services in Schools 2009, 40:116-130.
13. Kromrey J.D., Foster-Johnson L. Determining the efficacy of intervention: The use of effect sizes for data analysis in single-subject research. Journal of Experimental Education 1996, 65:73-93.
14. Lambert M.C., Cartledge G., Heward W.L., Lo Y. Effects of response cards on disruptive behavior and academic responding during math lessons by fourth-grade urban students. Journal of Positive Behavior Interventions 2006, 8:86-99.
15. Laski K.E., Charlop M.H., Schreibman L. Training parents to use the natural language paradigm to increase their autistic children's speech. Journal of Applied Behavior Analysis 1988, 21:391-400.
16. LeBlanc L.A., Geiger K.B., Sautter R.A., Sidener T.M. Using the natural language paradigm (NLP) to increase vocalizations of older adults with cognitive impairments. Research in Developmental Disabilities 2007, 28:437-444.
17. Maggin D.M., Swaminathan H., Rogers H.J., O'Keeffe B.V., Sugai G., Horner R.H. A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology 2011, 49:301-321.
18. McKnight S.D., McKean J.W., Huitema B.E. A double bootstrap method to analyze linear models with autoregressive error terms. Psychological Methods 2000, 5:87-101.
19. Moeyaert M., Ugille M., Ferron J., Beretvas S.N., Van den Noortgate W. Three-level analysis of single-case experimental data: Empirical validation. The Journal of Experimental Education 2013, 82:1-21. 10.1080/00220973.2012.745470.
20. Moeyaert M., Ugille M., Ferron J., Beretvas S.N., Van den Noortgate W. The influence of the design matrix on treatment effect estimates in the quantitative analyses of single-case experimental design research 2013, (submitted for publication).
21. Moeyaert M., Ugille M., Ferron J., Beretvas S.N., Van den Noortgate W. Three-level analysis of standardized single-case experimental data: Empirical validation. Multivariate Behavior Research 2013, 48:719-748.
22. Moeyaert M., Ugille M., Ferron J., Beretvas S.N., Van den Noortgate W. Modeling external events in the three-level analysis of multiple-baseline across participants designs: A simulation study. Behavior Research Methods 2013, 45:547-559.
23. Moeyaert M., Ugille M., Ferron J., Beretvas S.N., Van den Noortgate W. The misspecification of the covariance structures in multilevel models for single-case data: A Monte Carlo simulation study 2013, (submitted for publication).
24. Owens C.M., Ferron J.M. Synthesizing single-case studies: A Monte Carlo examination of a three-level meta-analytic model. Behavior Research Methods 2012, 44:795-805.
25. Petit-Bois M., Baek E.K., Ferron J.M. The effect of error structure specification on the meta-analysis of single-case studies: A Monte Carlo study. Poster presented at the American Educational Research Association Annual Meeting, San Francisco, CA 2013, April.
26. Raudenbush S.W., Bryk A.S. Hierarchical linear models: Applications and data analysis methods 2002, Sage, Newbury Park, CA. 2nd ed.
27. Schreibman L., Stahmer A.C., Barlett V.C., Dufek S. Brief report: toward refinement of a predictive behavioral profile for treatment outcome in children with autism. Research in Autism Spectrum Disorders 2009, 3:163-172.
28. Schwarz G. Estimating the dimension of a model. Annuals of Statistics 1978, 6:461-464.
29. Shadish W.R., Kyse E.N., Rindskopf D.M. Analyzing data from single-case designs using multilevel models: new applications and some agenda items for future research. Psychological Methods 2013, 18:385-405.
30. Shadish W.R., Rindskopf D.M. Methods for evidence-based practice: Quantitative synthesis of single-subject designs. New Directions for Evaluation 2007, 113:95-109.
31. Shadish W.R., Rindskopf D.M., Hedges L.V. The state of the science in the meta-analysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention 2008, 2:188-196.
32. Shadish W.R., Sullivan K.J. Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods 2011, 43:971-980.
33. Shrerer M.R., Schreibman L. Individual behavioral profiles and predictors of treatment effectiveness for children with autism. Journal of Consulting and Clinical Psychology 2005, 73:525-538.
34. Singer J.D., Willett J.B. Applied longitudinal data analysis: Modeling change and event occurrence 2003, Oxford University Press, Oxford, England.
35. Snijders T., Bosker R.J. Multilevel analysis: An introduction to basic and advanced multilevel modeling 2012, Sage, Thousand Oaks, CA. 2nd ed.
36. Thorp D.M., Stahmer A.C., Schreibman L. The effects of sociodramatic play training on children with autism. Journal of Autism and Developmental Disorders 1995, 25:265-282.
37. Ugille M., Moeyaert M., Beretvas S.N., Ferron J., Van den Noorgate W. Multilevel meta-analysis of single-subject experimental designs: A simulation study. Behavior Research Methods 2013, 44:1244-1254.
38. Ugille M., Moeyaert M., Beretvas S.N., Ferron J., Van Den Noortgate W. Bias corrections for standardized effect size estimates used with single-subject experimental designs. Journal of Experimental Education 2013, (Advance online publication). 10.1080/00220973.2013.813366.
39. Van den Noortgate W., Onghena P. Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly 2003, 18:325-346.
40. Van den Noortgate W., Onghena P. Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments, & Computers 2003, 35:1-10.
41. Van den Noortgate W., Onghena P. A multilevel meta-analysis of single-subject experimental design studies. Evidence Based Communication Assessment and Intervention 2008, 2:142-151.
42. Velicer W.F., Fava J.L. Time series analysis. Research methods in psychology 2003, 581-606. John Wiley, New York. J. Schinka, W.F. Velicer (Eds.).
43. Wang J., Xie H., Fisher J.H. Multilevel models: Applications using SAS 2012, Higher Education Press and Walter de Gruyter GmbH & Co. KG, Berlin, Germany.
44. Wolfinger R.D. Heterogeneous variance-covariance structures for repeated measures. Journal of Agricultural, Biological, and Environmental Statistics 1996, 1:205-230.