A d-statistic for single-case designs that is equivalent to the usual between-groups d-statistic

Neuropsychological Rehabilitation

Volumn 24, Issue 3-4, 2014, Pages 528-553

  Shadish, William R ^a   Hedges, Larry V ^b   Pustejovsky, James E ^b   Boyajian, Jonathan G ^a   Sullivan, Kristynn J ^a   Andrade, Alma ^a   Barrientos, Jeannette L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Analysis; D statistic; Meta analysis; Single case designs; Standardised mean difference

Indexed keywords

HUMAN; META ANALYSIS (TOPIC); METHODOLOGY; STATISTICS AND NUMERICAL DATA;

HUMANS; META-ANALYSIS AS TOPIC; RESEARCH DESIGN;

EID: 84903190726     PISSN: 09602011     EISSN: 14640694     Source Type: Journal    
DOI: 10.1080/09602011.2013.819021     Document Type: Article

References (57)

1. Ballard, K. J., & Thompson, C. K. (1999). Treatment and generalization of complex sentence production in agrammatism. Journal of Speech, Language, and Hearing Research, 42, 690-707. (1).
2. Beeson, P. M., Hirsch, F. M., & Rewega, M. A. (2002). Successful single-word writing treatment: Experimental analysis of four cases. Aphasiology, 16, 473-491. (2).
3. Beeson, P. M., Rising, K., & Volk, J. (2003). Writing treatment for severe aphasia: Who benefits? Journal of Speech, Language, and Hearing Research, 46, 1038-1060. (3).
4. Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50, 1088-1101.
5. Beretvas, N., & Chung, H. (2008). An evaluation of modified R2-change effect size indices for single-subject experimental designs. Evidence-Based Communication Assessment and Intervention, 2, 120-128.
6. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2005). Comprehensive Meta-analysis Version 2. Englewood, NJ: Biostat.
7. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.
8. Brunila, T., Lincoln, N., Lindell, A., Tenovuo, O., & Hamalainen, H. (2002). Experiences of combined visual training and arm activation in the rehabilitation of unilateral visual neglect: A clinical study. Neuropsychological Rehabilitation, 12, 27-40. (4).
9. Busk, P. L., & Serlin, R. C. (2005). Meta-analysis for single-case research. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187-212). Hillsdale, NJ: Lawrence Erlbaum Associates.
10. Cameron, R. M., Wambaubh, J. L., Wright, S. M., & Nessler, C. L. (2006). Effects of a combined semantic/phonologic cueing treatment on word retrieval in discourse. Aphasiology, 20, 269-285. (5).
11. Cicerone, K. D., Dahlberg, C., Kalmar, K., Langenbahn, D. M., Malec, J. F., Bergquist, T. F., & . . .Morse, P. A. (2000). Evidence-based cognitive rehabilitation: Recommendations for clinical practice. Archives of Physical Rehabilitation Medicine, 81, 1596-1615.
12. Cicerone, K. D., Dahlbert, C., Malec, J. F., Langenbahn, D. M., Felicetti, T., Kneipp, S., & Catanese, J. (2005). Evidence-based cognitive rehabilitation: Update of the literature from 1998 through 2002. Archives of Physical Rehabilitation Medicine, 86, 1681-1692. doi: 10.1016/j.apmr.2005.03. 024.
13. Cicerone, K. D., Langenbahn, D. M., Braden, C., Malec, J. F., Kalmar, K., Fraas, M., & . . .Ashman, T. (2011). Evidence-based cognitive rehabilitation: Updated review of the literature from 2003 through 2008. Archives of Physical Rehabilitation Medicine, 92, 519-530.
14. Drew, R. L., & Thompson, C. K. (1999). Model-based semantic treatment for naming deficits in aphasia. Journal of Speech, Language, and Hearing Research, 42, 972-989. (7).
15. Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455-463.
16. Egger, M., Davey Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629-634.
17. Fink, R. B., Brecher, A., Schwartz, M. F., & Robey, R. R. (2002). A computer-implemented protocol for treatment of naming disorders: Evaluation of clinician-guided and partially self-guided instruction. Aphasiology, 16, 1061-1086. (8).
18. Gansler, D. A., & McCaffrey, R. J. (1991). Remediation of chronic attention deficits in traumatic brain-injured patients. Archives of Physical Medicine and Rehabilitation, 6, 335-353. (9).
19. Gorman-Smith, D., & Matson, J. L. (1985). A review of treatment research for self-injurious and stereotyped responding. Journal of Mental Deficiency Research, 29, 295-308.
20. Gray, J. M., & Robertson, I. (1989). Remediation of attentional difficulties following brain injury: Three experimental single case studies. Brain Injury, 3, 163-170. (11).
21. Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128.
22. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
23. Hedges, L. G., Pustejovsky, J. E., & Shadish, W. R. (2012). A standardized mean difference effect size for single-case designs. Research Synthesis Methods, 3, 224-239.
24. Hedges, L. G., Pustejovsky, J. E., & Shadish, W. R. (in press). A standardized mean difference effect size for multiple baseline designs across individuals. Research Synthesis Methods.
25. Hedges, L. V., & Shadish, W. R. (2013a). Power analysis for single case designs, Manuscript in preparation.
26. Hedges, L. V., & Shadish, W. R. (2013b). Power analysis for multiple baseline designs, Manuscript in preparation.
27. Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009). A re-evaluation of randomeffects meta-analysis. Journal of the Royal Statistical Society, 172, 137-159.
28. Huitema, B. (2011). Analysis of covariance and its alternatives: Statistical methods for experiments, quasi-experiments, and single-case studies. New York: John Wiley and Sons.
29. Jacobs, B. J., & Thompson, C. K. (2000). Cross-modal generalization effects of training noncanonical sentence comprehension and production in agrammatic aphasia. Journal of Speech, Language, and Hearing Research, 43, 5-20. (12).
30. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc-scd.pdf.
31. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013). Single-case intervention research design standards. Remedial and Special Education, 34, 26-38. doi: 10.1177/0741932512452794.
32. Light, R. J., & Pillemer, D. B. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.
33. Maggin, D. M., Swaminathan, H., Rogers, H. J., O'Keefe, B. V., Sugai, G., & Horner, R. H. (2011). A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology, 49, 301-321. doi:10.1016/j.jsp.2011.03.004.
34. Mahoney, M. (1977). Publication prejudices: An experimental study of confirmatory bias on the peer review system. Cognitive Therapy and Research, 1, 161-175.
35. Murray, L. L., Ballard, K., & Karcher, L. (2004). Linguistic specific treatment: Just for Broca's aphasia? Aphasiology, 18(9), 785-809. (14).
36. Parker, R. I., Hagan-Burke, S., & Vannest, K. (2007). Percentage of All Non-Overlapping Data (PAND): An alternative to PND. Journal of Special Education, 40, 194-204.
37. Parker, R. I., Vannest, K. J., & Davis, J. L. (2011). Effect size in single case research: A review of nine nonoverlap techniques. Behavior Modification, 35, 303-322. doi: 10.1177/0145445511399147.
38. Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284-299.
39. Rapp, B. (2005). The relationship between treatment outcomes and the underlying cognitive deficit: Evidence from the remediation of acquired dysgraphia. Aphasiology, 19, 994-1008. (16).
40. Richards, K., Singletary, F., Gonzalez Rothi, L. J., Koehler, S., & Crosson, B. (2002). Activation of intentional mechanisms through utilization of nonsymbolic movements in aphasia rehabilitation. Journal of Rehabilitation Research and Development, 39, 445-454. (20).
41. Ringdahl, J. E., Call, N. A., Mews, J. B., Boelter, E. W., & Christensen, T. J. (2008). Assessment and treatment of aggressive behavior without a clear social function. Research in Developmental Disabilities, 29, 351-362. doi: 10.1016/j.ridd.2007.06.003.
42. Rosenbek, J. C., Crucian, G. P., Leon, S. A., Hieber, B., Rodriguez, A. D., Holiway, B., . . .& Gonzalez-Rothi, L. (2004). Novel treatments for expressive aprosodia: A phase I investigation of cognitive linguistic and imitative interventions. Journal of the International Neuropsychological Society, 10, 786-793. (24).
43. Rothstein, H., Sutton, A. J., & Borenstein, M. (Eds.). (2005). Publication bias in meta-analysis: Prevention, assessment and adjustments. New York: Wiley.
44. Shadish, W. R., Brasil, I. C. C., Illingworth, D. A., White, K., Galindo, R., Nagler, E. D., & Rindskopf, D. M. (2009). Using UnGraphw to extract data from image files: Verification of reliability and validity. Behavior Research Methods, 41, 177-183.
45. Shadish, W. R., Hedges, L. V., Pustejovsky, J., Rindskopf, D. M., Boyajian, J. G., & Sullivan, K. J. (in press). Analyzing single-case designs: d, G, multilevel models, Bayesian estimators, generalized additive models, and the hopes and fears of researchers about analyses. In T. R. Kratochwill & J. R. Levin (Eds.), single-case intervention research: Methodological and data-analysis advances. Washington, DC: American Psychological Association.
46. Shadish, W. R., Kyse, E. N., & Rindskopf, D. M. (in press). Analyzing data from single-case designs using multilevel models: New applications and some agenda items for future research. Psychological Methods.
47. Shadish, W. R., & Rindskopf, D. M. (2007). Methods for evidence-based practice: Quantitative synthesis of single-subject designs. In G. Julnes & D. J. Rog (Eds.), Informing federal policies on evaluation method: Building the evidence base for method choice in government sponsored evaluation (pp. 95-109). San Francisco, CA: Jossey-Bass.
48. Shadish, W. R., Rindskopf, D. M., & Hedges, L. V. (2008). The state of the science in the metaanalysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 3, 188-196.
49. Shadish, W. R. & Sullivan, K. J. (2011). Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43, 971-980. doi: 10.3758/s13428-011-0111-y.
50. Stapleton, S., Adams, M., & Atterton, L. (2007). A mobile phone as a memory aid for individuals with traumatic brain injury: A preliminary investigation. Brain Injury, 21, 401-411. (25).
51. Sterne, J. A. C. (Ed.). (2009). Meta-analysis in Stata: An updated collection from the Stata Journal. College Station, Texas: Stata Press.
52. Sullivan, K. J., & Shadish, W. R. (2013). Analyzing longitudinal data with generalized additive models: Applications to single-case designs, Manuscript submitted for publication.
53. Tasky, K. K., Rudrud, E. H., Schulze, K. A., & Rapp, J. T. (2008). Using choice to increase ontask behavior in individuals with traumatic brain injury. Journal of Applied Behavior Analysis, 41(2), 261-265. doi: 10.1901/jaba.2008.41-261.
54. Van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment and Intervention, 2, 142-151.
55. Wambaugh, J., Cameron, R., Kalinyak-Fliszar, M., Nessler, C., & Wright, S. (2004). Retrieval of action names in aphasia: Effects of two cueing treatments. Aphasiology, 19, 979-1004. (29).
56. Webster, J., Jones, S., Blanton, P., Gross, R., Beissel, G., & Wofford, J. (1984). Visual scanning training with stroke patients. Behavioral Therapy, 15, 129-143. (31).
57. Weinhandl, E. D., & Duval, S. (2012). Generalization of trim and fill for application in metaregression. Research Synthesis Methods, 3, 51-67. doi: 10.1002/jrsm.1042.