The state of the science in the meta-analysis of single-case experimental designs

Evidence-Based Communication Assessment and Intervention

Volumn 2, Issue 3, 2008, Pages 188-196

  Shadish, William R ^a   Rindskopf, David M ^b   Hedges, Larry V ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Effect size; Meta analysis; Multilevel models; Single case design; Standardized mean difference statistic

Indexed keywords

ACCESS TO INFORMATION; ANALYTIC METHOD; ANALYTICAL PARAMETERS; ARTICLE; BAYES THEOREM; CLINICAL TRIAL; COMPARATIVE STUDY; COMPUTER SIMULATION; CORRELATIONAL STUDY; DATA ANALYSIS; EVIDENCE BASED PRACTICE; EXPERIMENTAL STUDY; HUMAN; INTERNET; INTERVENTION STUDY; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL PARAMETERS; MEDICAL INFORMATION; MEDICAL LITERATURE; MEDICAL RESEARCH; META ANALYSIS; METHODOLOGY; OBSERVATIONAL STUDY; OUTCOME ASSESSMENT; POISSON DISTRIBUTION; PREDICTION; PRIORITY JOURNAL; PSYCHOPHARMACOLOGY; RANDOMIZATION; REFERENCE VALUE; REGRESSION ANALYSIS; RESEARCH SUBJECT; SAMPLE SIZE; SAMPLING; STANDARDIZATION; STATISTICAL ANALYSIS; STATISTICAL MODEL; SYSTEMATIC REVIEW; TREATMENT OUTCOME;

EID: 56549128816     PISSN: 17489539     EISSN: 17489547     Source Type: Journal    
DOI: 10.1080/17489530802581603     Document Type: Article

References (44)

1. Allison, DB and Gorman, BS (1993) Calculating effect sizes for meta-analysis: The case of the single case. Behaviour Research and Therapy, 31, pp. 621-631.
2. Allison, DB and Gorman, BS (1994) "Making things as simple as possible, but no simpler". A rejoinder to Scruggs and Mastropieri. Behaviour Research and Therapy, 32, pp. 885-890.
3. Beretvas, SN and Chung, H. (2008) A review of single-subject experimental design meta-analyses: Methodological issues and practice. Evidence-Based Communication Assessment and Intervention, 2, pp. 129-141.
4. Beretvas, SN and Chung, H. (2008) An evaluation of modified change-in-R2 effect-size indices for single-subject experimental designs. Evidence-Based Communication Assessment and Intervention, 2, pp. 120-128.
5. Box, GEP and Jenkins, GM (1984) Time series analysis, Holden Day, San Francisco
6. Center, BA, Skiba, RJ and Casey, A. (1986) A methodology for the quantitative synthesis of intra-subject design research. Journal of Special Education, 19, pp. 387-400.
7. Davidian, M. and Giltinan, DM (1995) Nonlinear models for repeated measurement data, Chapman & Hall, London
8. DiCarlo, CF and Reid, DH (2004) Increasing pretend toy play of toddlers with disabilities in an inclusive setting. Journal of Applied Behavior Analysis, 37, pp. 197-207.
9. DuMouchel, W. (1994) Hierarchical Bayes linear models for meta-analysis. Technical report 27. National Institute of Statistical Sciences
10. Gentile, JR, Roden, AH and Klein, RD (1972) An analysis-of-variance model for the intrasubject replication design. Journal of Applied Behavior Analysis, 5, pp. 193-198.
11. Gorsuch, RL (1983) Three methods for analyzing limited time series (N of 1) data. Behavioral Assessment, 5, pp. 141-154.
12. Hartmann, DP (1974) Forcing square pegs into round holes: Some comments on "An analysis-of-variance model for the intrasubject replication design". Journal of Applied Behavior Analysis, 7, pp. 635-638.
13. Harvey, A. (1990) Econometric analysis of time series, MIT Press, Cambridge, MA
14. Hedeker, D. and Gibbons, RD (1996) MIXREG: A computer program for mixed-effects regression analysis with autocorrelated errors. Computer Methods and Programs in Biomedicine, 49, pp. 229-252.
15. Hedges, LV and Olkin, I. (1984) Nonparametric estimators of effect size in meta-analysis. Psychological Bulletin, 96, pp. 573-580.
16. Hunt, P., Soto, G., Maier, J. and Doering, K. (2003) Collaborative teaming to support students at risk and students with severe disabilities in general education classrooms. Exceptional Children, 69, pp. 315-322.
17. Hunter, JE and Schmidt, FL (2004) Methods of meta-analysis: Correcting error and bias in research findings, Sage Publications, Newbury Park, CA
18. Kamps, DM, Barbetta, PM, Leonard, BR and Delquadri, J. (1994) Classwide peer tutoring: An integration strategy to improve reading skills and promote peer interactions among students with autism and general education peers. Journal of Applied Behavior Analysis, 27, pp. 49-61.
19. Keselman, HJ and Leventhal, L. (1974) Concerning the statistical procedures enumerated by Gentile et al.: Another perspective. Journal of Applied Behavior Analysis, 7, pp. 643-645.
20. Kraemer, HC and Andrews, G. (1982) A non-parametric technique for meta-analysis effect size calculation. Psychological Bulletin, 91, pp. 404-412.
21. Kratochwill, T., Alden, K., Demuth, D., Dawson, D., Panicucci, C. Arntson, P. et al. (1974) A further consideration in the application of an analysis-of-variance model for the intrasubject replication design. Journal of Applied Behavior Analysis, 7, pp. 629-633.
22. Lambert, MC, Cartledge, G., Heward, WL and Lo, Y. (2006) Effects of response cards on disruptive behavior and academic responding during math lessons by fourth-grade urban students. Journal of Positive Behavior Interventions, 8, pp. 88-99.
23. Ma, HH (2006) An alternative method for quantitative synthesis of single-subject design: Percentage of data points exceeding the median. Behavior Modification, 30, pp. 598-617.
24. Parker, RI, Hagan-Burke, S. and Vannest, K. (2007) Percentage of all non-overlapping data (PAND): An alternative to PND. Journal of Special Education, 40, pp. 194-204.
25. Patterson, K. (2000) Introduction to applied econometrics, St Martin's Press, New York
26. Raudenbush, S., Bryk, A. and Congdon, R. (2005) HLM: Hierarchical Linear and Nonlinear Modeling (Version 6.06), Scientific Software International, Chicago, IL 60615
27. Rindskopf, D. (2002) The use of latent class analysis in medical diagnosis. Proceedings of the Joint Meetings of the American Statistical Association, pp. 2912-2916.
28. Rindskopf, D. (2007) Current methodological issues in single case research: The easy, the difficult, and the impossible. Presented at the 2007 Institute of Education Sciences Research Conference, Washington, DC, USA
29. Rindskopf, D. (2008) Using multilevel models to analyze data from single case designs. Presented as part of a workshop with R. Horner at IES Research Training Institute: Single Case Designs From April 15-16, 2008, Washington, D.C.
30. Schlosser, RW, Lee, DL and Wendt, O. (2008) Application of the percentage of non-overlapping data (PND) in systematic reviews and meta-analyses: A systematic review of reporting characteristics. Evidence-Based Communication Assessment and Intervention, 2, pp. 163-188.
31. Schneider, N., Goldstein, H. and Parker, R. (2008) Social-skills interventions for children with autism: A meta-analytic application of percentage of all non-overlapping data (PAND). Evidence-Based Communication Assessment and Intervention, 2, pp. 152-162.
32. Scruggs, TE, Mastropieri, MA and Casto, G. (1987) The quantitative synthesis of single-case research: Methodology and validation. Remedial and Special Education, 8, pp. 24-33.
33. Shadish, WR (2007) A new method for meta-analysis of single-case designs. Presented at the Second Annual Meeting of the Society for Research Synthesis Methodology, Evanston, IL, USA
34. Shadish, WR, Brasil, ICC, Illingworth, DA, White, K., Galindo, R., Nagler, ED and Rindskopf, DM Using UnGraph̊ to extract data from image files: Verification of reliability and validity. Behavior Research Methods, Instruments, & Computers
35. Shadish, WR, Cook, TD and Campbell, DT (2002) Experimental and quasi-experimental designs for generalized causal inference, Houghton-Mifflin, Boston
36. Shine, LC and Bower, SM (1971) A one-way analysis of variance for single-subject designs. Educational and Psychological Measurement, 31, pp. 105-113.
37. Spiegelhalter, D., Thomas, A., Best, N. and Lunn, D. (2004)
38. Stewart, LA and Tierney, JF (2002) To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Evaluation and the Health Professions, 25, pp. 76-97.
39. Stuart, RB (1967) Behavioral control of overeating. Behavior Research & Therapy, 5, pp. 357-365.
40. van den Noortgate, W and Onghena, P. (2003) Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly, 18, pp. 325-346.
41. van den Noortgate, W and Onghena, P. (2007) The aggregation of single-case results using hierarchical linear models. The Behavior Analyst Today, 8, pp. 196-209.
42. van den Noortgate, W and Onghena, P. (2008) A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment and Intervention, 2, pp. 142-151.
43. White, DM, Rusch, FR, Kazdin, AE and Hartmann, DP (1989) Applications of meta-analysis in individual-subject research. Behavioral Assessment, 11, pp. 281-296.
44. Woodward, P. (2005) BugsXLA: Bayes for the common man. Journal of Statistical Software, 14, pp. 1-18.