Inferential Precision in Single-Case Time-Series Data Streams: How Well Does the EM Procedure Perform When Missing Observations Occur in Autocorrelated Data?

Behavior Therapy

Volumn 43, Issue 3, 2012, Pages 679-685

  Smith, Justin D ^a   Borckardt, Jeffrey J ^b   Nash, Michael R ^a  

^a UNIVERSITY OF TENNESSEE   (United States)

^b MEDICAL UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

Autocorrelation; Case based; Missing observations; Power sensitivity; Time series

Indexed keywords

ACCURACY; ALGORITHM; ARTICLE; CALCULATION; EXPECTATION MAXIMIZATION ALGORITHM; METHODOLOGY; MISSING OBSERVATION; MONTE CARLO METHOD; OBSERVATION; OUTCOMES RESEARCH; SENSITIVITY ANALYSIS; STATISTICAL ANALYSIS;

ALGORITHMS; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; MONTE CARLO METHOD; RESEARCH DESIGN;

EID: 84862182493     PISSN: 00057894     EISSN: 18781888     Source Type: Journal    
DOI: 10.1016/j.beth.2011.10.001     Document Type: Article

References (45)

1. Borckardt J.J., Nash M.R., Murphy M.D., Moore M., Shaw D., O'Neil P. Clinical practice as natural laboratory for psychotherapy research. American Psychologist 2008, 63:1-19. 10.1037/0003-066X.63.2.77.
2. Box G.E.P., Jenkins G.M. Time-series analysis: Forecasting and control 1970, Holden-Day, San Francisco.
3. Campbell J.M. Statistical comparison of four effect sizes for single-subject designs. Behavior Modification 2004, 28:234-246. 10.1177/0145445503259264.
4. Center B.A., Skiba R.J., Casey A. A methodology for the quantitative synthesis of intra-subject design research. Journal of Educational Science 1986, 19:387-400. 10.1177/002246698501900404.
5. Cohen J. Statistical power analysis for the bahavioral sciences 1988, Erlbaum, Hillsdale, NJ. 2nd ed.
6. Cohen J. The earth is round (p < .05). American Psychologist 1994, 49:997-1003.
7. Dempster A., Laird N., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 1977, 39(1):1-38.
8. Ferron J., Foster-Johnson L., Kromney J.D. The functioning of single-case randomization tests with and without random assignment. The Journal of Experimental Education 2003, 71:267-288. 10.1080/00220970309602066.
9. Ferron J., Sentovich C. Statistical power of randomization tests used with multiple-baseline designs. The Journal of Experimental Education 2002, 70:165-178.
10. Ferron J., Ware W. Analyzing single-case data: The power of randomization tests. The Journal of Experimental Education 1995, 63:167-178.
11. Green A.S., Rafaeli E., Bolger N., Shrout P.E., Reis H.T. Paper or plastic? Data equivalence in paper and electronic diaries. Psychological Methods 2006, 11:87-105. 10.1037/1082-989X.11.1.87.
12. Horton N.J., Kleinman K.P. Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. The American Statistician 2007, 61:79-90. 10.1198/000313007X172556.
13. Huitema B.E. Autocorrelation in applied behavior analysis: A myth. Behavioral Assessment 1985, 7:107-118.
14. Huitema B.E., McKean J.W. Reduced bias autocorrelation estimation: Three jackknife methods. Educational and Psychological Measurement 1994, 54:654-665. 10.1177/0013164494054003008.
15. Ibrahim J.G., Chen M.-H., Lipsitz S.R., Herring A.H. Missing-data methods for generalized linear models: A comparative review. Journal of the American Statistical Association 2005, 100(469):332-346. 10.1198/016214504000001844.
16. Jones R.R., Vaught R.S., Weinrott M.R. Time-series analysis in operant research. Journal of Behavior Analysis 1977, 10:151-166. 10.1901/jaba.1977.10-151.
17. Kazdin A.E. Research designs in clinical psychology 1992, Allyn & Bacon, Boston. 2nd ed.
18. Kazdin A.E. Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist 2008, 63:146-159. 10.1037/0003-066X.63.3.146.
19. Kirk R.E. Practical significance: A concept whose time has come. Educational and Psychological Measurement 1996, 56:746-759. 10.1177/0013164496056005002.
20. Kratochwill T.R., Hitchcock J., Horner R.H., Levin J.R., Odom S.L., Rindskopf D.M., Shadish W.R. Single-case designs technical documentation Retrieved from The What Works Clearinghouse website:. http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
21. Kratochwill T.R., Levin J.R. Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods 2010, 15:124-144. 10.1037/a0017736.
22. Laird N. Missing data in longitudinal studies. Statistics in Medicine 1988, 7(1-2):305-315. 10.1002/sim.4780070131.
23. Lambert M.J., Bergin A.E., Garfield S.L. Introduction and historical overview. Bergin and Garfield's handbook of psychotherapy and behavior change 2003, 3-15. John Wiley & Sons, Inc., New York. M.J. Lambert (Ed.).
24. Lambert M.J., Ogles B.M. The efficacy and effectiveness of psychotherapy. Bergin and Garfield's Handbook of Psychotherapy and Behavior Change 2004, 139-193. John Wiley & Sons, New York. 5th ed. M.J. Lambert (Ed.).
25. Manolov R., Solanas A. Comparing N = 1 effect sizes in presence of autocorrelation. Behavior Modification 2008, 32:860-875. 10.1177/0145445508318866.
26. Manolov R., Solanas A. Problems of the randomization test for AB designs. Psicológica 2009, 30:137-154.
27. Manolov R., Solanas A., Sierra V., Evans J.J. Choosing among techniques for quantifying single-case intervention effectiveness. Behavior Therapy 2011, 42:533-545. 10.1016/j.beth.2010.12.003.
28. McKnight S.D., McKean J.W., Huitema B.E. A double bootstrap method to analyze linear models with autoregressive error terms. Psychological Methods 2000, 5:87-101.
29. Olive M.L., Smith B.W. Effect size calculations and single subject designs. Educational Psychology 2005, 25(2-3):313-324. 10.1080/0144341042000301238.
30. Parker R.I., Brossart D.F. Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy 2003, 34:189-211. 10.1016/S0005-7894(03)80013-8.
31. Parker R.I., Vannest K. An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy 2009, 40:357-367. 10.1016/j.beth.2008.10.006.
32. Parker R.I., Vannest K., Davis J.L., Sauber S.B. Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy 2011, 42:284-299. 10.1016/j.beth.2010.08.006.
33. PASW Statistics for Windows and Mac. (Version 18.0.0) 2010, SPSS Inc., Chicago.
34. Ragunathan T.E. What do we do with missing data? Some options for analysis of incomplete data. Annual Review of Public Health 2004, 25:99-117. 10.1146/annurev.publhealth.25.102802.124410.
35. Rankin E.D., Marsh J.C. Effects of missing data on the statistical analysis of clinical time-series. Social Work Research and Abstracts 1985, 21:13-16.
36. RealSoftware Inc. RealBasic 3 2011, Austin, TX.
37. Robey R.R., Schultz M.C., Crawford A.B., Sinner C.A. Single-subject clinical-outcome research: Designs, data, effect sizes, and analyses. Aphasiology 1999, 13:445-473. 10.1080/026870399402028.
38. Rubin D.B. Inference and missing data. Biometrika 1976, 63:581-590. 10.1093/biomet/63.3.581.
39. Sharpley C.F. Time-series analysis of behavioural data: An update. Behaviour Change 1987, 4:40-45.
40. Shumway R.H., Stoffer D.S. An approach to time series smoothing and forecasting using the EM algorithm. Journal of Time-Series Analysis 1982, 3(4):253-264.
41. Smith J.D. Single-Case Experimental Designs: A Systematic Review of Published Research and Current Standards 2011, Manuscript submitted for publication.
42. Solanas A., Manolov R., Onghena P. Estimating slope and level change in N = 1 designs. Behavior Modification 2010, 34:195-218. 10.1177/0145445510363306.
43. Velicer W.F., Colby S.M. A comparison of missing-data procedures for ARIMA time-series analysis. Educational and Psychological Measurement 2005, 65:596-615. 10.1177/0013164404272502.
44. Velicer W.F., Colby S.M. Missing data and the general transformation approach to time series analysis. Contemporary psychometrics. A Festschrift to Roderick P. McDonald 2005, 509-535. Lawrence Erlbaum, Hillsdale, NJ. A. Maydeu-Olivares, J.J. McArdle (Eds.).
45. Velicer, W. F., & Fava, J. L. (2003). Time series analysis. In J. Schinka & W. F. Velicer (Eds.), Research methods in psychology (Vol. 2 of Handbook of Psychology, I. B. Weiner, Editor-in-Chief). New York: John Wiley & Sons.