The use of multilevel analysis for integrating single-case experimental design results within a study and across studies

Neuropsychological Rehabilitation

Volumn 24, Issue 3-4, 2014, Pages 590-606

  Baek, Eun Kyeng ^a   Moeyaert, Mariola ^b   Petit Bois, Merlande ^a   Natasha Beretvas, S ^c   Van Den Noortgate, Wim ^b   Ferron, John M ^a  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Effect size; Intervention effect; Multilevel modelling; Single case experimental design; Standardisation

Indexed keywords

HUMAN; METHODOLOGY; MULTILEVEL ANALYSIS; PROCEDURES; STATISTICAL MODEL; STATISTICS; STATISTICS AND NUMERICAL DATA;

HUMANS; MODELS, STATISTICAL; MULTILEVEL ANALYSIS; RESEARCH DESIGN; STATISTICS AS TOPIC;

EID: 84903182225     PISSN: 09602011     EISSN: 14640694     Source Type: Journal    
DOI: 10.1080/09602011.2013.835740     Document Type: Article

References (34)

1. Baek, E., & Ferron, J. M. (2013). Multilevel models for multiple-baseline data: Modeling across participant variation in autocorrelation and residual variance. Behavior Research Methods, 45, 65-74.
2. Bell, B. A., Schoeneberger, J., Morgan, G., Kromrey, J., & Ferron, J. (2010). Fundamental diagnostics for two-level mixed models: The SAS macro MIXED DX. SAS global forum 2010 proceedings. Retrieved from. http://support.sas.com/ resources/papers/proceedings10/201e2010.pdf.
3. Beretvas, S. N., Hembry, I., Van Den Noortgate, W., & Ferron, J. (2013). Estimation of a nonlinear intervention phase trajectory for multiple baseline design data. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA, April 2012.
4. Center, B. A., Skiba, R. J., & Casey, A. (1985-1986). A methodology for the quantitative synthesis of intra-subject design research. Journal of Special Education, 19, 387-400.
5. Edgington, E. S. & Onghena, P. (2007). Randomization tests (4th edn.). Boca Raton, FL: Chapman & Hall.
6. Fan, X., & Sivo, S. A. (2007). Sensitivity of fit indices to model misspecification and model types. Multivariate Behavioral Research, 42, 509-529.
7. Ferron, J. M., Bell, B. A., Hess, M. R., Rendina-Gobioff, G., & Hibbard, S. T. (2009). Making treatment effect inferences from multiple baseline data: The utility of multilevel modeling approaches. Behavior Research Methods, 41, 372-384.
8. Ferron, J., & Jones, P. K. (2006). Tests for the visual analysis of response-guided multiplebaseline data. Journal of Experimental Education, 75, 66-81.
9. Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2012). A standardized mean difference effect size for single case designs. Research Synthesis Methods, 3, 224-239.
10. Hox, J. (1998). Multilevel modeling: When and why? In I. Balderjahn, R. Mathar, &M. Schader (Eds.), Classification, data analysis, and data highways (pp. 147-154). New York, NY: Springer.
11. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
12. Huitema, B. E. & McKean, J. W. (2000). Design specification issues in time-series intervention models. Educational and Psychological Measurement, 60, 38-58.
13. Jokel, R., Rochon, E., & Anderson, N. D. (2010). Errorless learning of computer-generated words in a patient with semantic dementia. Neuropsychological Rehabilitation, 20, 16-41.
14. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M. & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc-scd.pdf.
15. Moeyaert, M., Ugille, M., Ferron, J., Beretvas, S. N., & Van den Noortgate, W. (2013). Modeling external events in the three-level analysis of multiple-baseline across participants designs: A simulation study. Behavior Research Methods, 45, 547-559.
16. Moeyaert, M., Ugille, M., Ferron, J., Beretvas, S. N., & Van den Noortgate, W. (in press-a). Three-level analysis of standardized single-case experimental data: Empirical validation. Multivariate Behavior Research.
17. Moeyaert, M., Ugille, M., Ferron, J., Beretvas, S. N., & Van den Noortgate, W. (in press-b). Three-level analysis of single-case experimental data: Empirical validation. Journal of Experimental Education.
18. Nugent, W. (1996). Integrating single-case and group comparison designs for evaluation research. Journal of Applied Behavioral Science, 32, 209-226.
19. Owens, C. M., & Ferron, J. M. (2012). Synthesizing single-case studies: A Monte Carlo examination of a three-level meta-analytic model. Behavior Research Methods, 44, 795-805.
20. Parker, R. I., & Vannest, K. (2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40, 357-367.
21. Parker, R. I., Vannest, K., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284-299.
22. Raudenbush, S. W. & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd edn.). Thousand Oaks, CA: Sage.
23. Shadish, W. R., & Rindskopf, D. M. (2007). Methods for evidence-based practice: Quantitative synthesis of single-subject designs. New Directions for Evaluation, 113, 95-109.
24. Shadish, W. R., Rindskopf, D. M., & Hedges, L. V. (2008). The state of the science in the metaanalysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 2, 188-196.
25. Shadish, W. R., & Sullivan, K. J. (2011). Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43, 971-980.
26. Tummers, B. (2006). DataThief III (version 1.6) [software] Available from http://datathief.org/.
27. Ugille, M., Moeyaert, M., Beretvas, S. N., Ferron, J., & Van den Noorgate, W. (2012). Multilevel meta-analysis of single-subject experimental designs: A simulation study. Behavior Research Methods, 44, 1244-1254.
28. Ugille, M., Moeyaert, M., Beretvas, S. N., Ferron, J., & Van den Noortgate, W. (in press). Bias corrections for standardized effect size estimates used with single-subject experimental designs. Journal of Experimental Education.
29. Van den Noortgate, W., & Onghena, P. (2003a). Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly, 18, 325-346.
30. Van den Noortgate, W., & Onghena, P. (2003b). Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments, & Computers, 35, 1-10.
31. Van den Noortgate, W., & Onghena, P. (2007). The aggregation of single-case results using hierarchical linear models. The Behavior Analyst Today, 8, 196-209.
32. Van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence Based Communication Assessment and Intervention, 2, 142-151.
33. Wang, J., Xie, H., & Fisher, J. H. (2012). Multilevel models: Applications using SAS. Berlin/Boston, MA: Higher Education Press and Walter de Gruyter GmbH & Co. KG.
34. Wu, W., West, S. G., & Taylor, A. B. (2009). Evaluating model fit for growth curve models: Integration of fit indices from SEM and MLM frameworks. Psychological Methods, 14, 183-201.