Synthesizing single-case studies: A Monte Carlo examination of a three-level meta-analytic model

Behavior Research Methods

Volumn 44, Issue 3, 2012, Pages 795-805

  Owens, Corina M ^a,b   Ferron, John M ^a  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b BATTELLE MEMORIAL INSTITUTE   (United States)

Author keywords

Hierarchical linear modeling; Multilevel modeling; Research synthesis; Simulation; Single subject

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; EPIDEMIOLOGY; HUMAN; META ANALYSIS (TOPIC); MONTE CARLO METHOD; MULTILEVEL ANALYSIS; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL; TREATMENT OUTCOME;

ANALYSIS OF VARIANCE; BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; MONTE CARLO METHOD; MULTILEVEL ANALYSIS; SAMPLE SIZE; TREATMENT OUTCOME;

EID: 84865656064     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-011-0180-y     Document Type: Article

References (27)

1. Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single-case. Behavior, Research, and Therapy, 31, 621-631.
2. Busk, P. L., & Serlin, R. C. (1992). Meta-analysis for single-case research. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187-212). Hillsdale, NJ: Erlbaum.
3. Center, B. A., Skiba, R. J., & Casey, A. (1985-1986). A methodology for the quantitative synthesis of intrasubject design research. Journal of Special Education, 19, 387-400.
4. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York, NY: Erlbaum.
5. Ferron, J. M., Bell, B. A., Hess, M. R., Rendina-Gobioff, G., & Hibbard, S. T. (2009). Making treatment effect inferences from multiple baseline data: The utility of multilevel modeling approaches. Behavior Research Methods, 41, 372-384.
6. Ferron, J. M., Farmer, J., & Owens, C. M. (2010). Estimating individual treatment effects from multiple-baseline data: A Monte Carlo study. Behavior Research Methods, 42, 930-943.
7. Ferron, J., Owens, C. M., & Bell, B. A. (2010). Multilevel models for combining single-case data: A Monte Carlo examination of treatment effect estimates and inferences. Denver, CO: Paper presented at the Annual Meeting of the American Educational Research Association.
8. Fouladi, R. T., & Shieh, Y. (2004). A comparison of two general approaches to mixed model longitudinal analyses under small sample size conditions. Communications in Statistics: Simulation and Computation, 33, 807-824.
9. Gingerich, W. J. (1984). Meta-analysis of applied time-series data. The Journal of Applied Behavioral Science, 20, 71-79.
10. Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
11. Gomez, E., Schaalje, G. B., & Fellingham, G. W. (2005). Performance of the Kenward-Roger method when the covariance structure is selected using AIC and BIC. Communication in Statistics: Simulation and Computation, 34, 377-392.
12. Kackar, R. N., & Harville, D. A. (1984). Approximations for standard errors of estimators of fixed and random effects in mixed linear models. Journal of the American Statistical Association, 79, 853-862.
13. Kazdin, A. E. (2011). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York, NY: Oxford University Press.
14. Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983-997.
15. Kowalchuk, R. K., Keselman, H. J., Algina, J., & Wolfinger, R. D. (2004). The analysis of repeated measurements with mixed-model adjusted F tests. Educational and Psychological Measurement, 64, 224-242.
16. Kwok, O., West, S. G., & Green, S. B. (2007). The impact of misspecifying the within-subject covariance structure in multiwave longitudinal multilevel models: A Monte Carlo study. Multivariate Behavioral Research, 42, 557-592.
17. Maas, C. J. M., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58, 127-137.
18. Murphy, D. L., & Pituch, K. A. (2009). The performance of multilevel growth curve models under an autoregressive moving average process. The Journal of Experimental Education, 77, 255-282.
19. Onghena, P., & Edgington, E. S. (2005). Customization of pain treatments: Single-case design and analysis. The Clinical Journal of Pain, 21, 56-68.
20. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
21. SAS Institute, Inc. (2008). SAS, release 9. 2 [Computer program]. Carey, NC: SAS Institute.
22. Schaalje, G. B., McBride, J. B., & Fellingham, G. W. (2001). Approximations of distributions of test statistics in complex mixed linear models using SAS Proc MIXED. In Proceedings of the SAS Users' Group International 26th Annual Conference (Paper 262-26). Available at support. sas. com/events/sasglobalforum/previous/index. html.
23. Scruggs, T. E., Mastropieri, M. A., & Castro, G. (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education, 8, 24-33.
24. van den Noortgate, W., & Onghena, P. (2003a). Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly, 18, 325-346.
25. van den Noortgate, W., & Onghena, P. (2003b). Hierarchical linear models for the quantitative integration of effects sizes in single-case research. Behavior Research Methods, Instruments, & Computers, 35, 1-10.
26. van den Noortgate, W., & Onghena, P. (2007). The aggregation of single-case results using hierarchical linear models. Behavior Analyst Today, 8, 196-209.
27. van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment and Intervention, 3, 142-151.