An introduction to modeling longitudinal data with generalized additive models: Applications to single-case designs

Psychological Methods

Volumn 20, Issue 1, 2015, Pages 26-42

  Sullivan, Kristynn J ^a   Shadish, William R ^a   Steiner, Peter M ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Generalized additive models; Nonlinearity; Single case designs

Indexed keywords

HUMAN; MEDICAL RESEARCH; METHODOLOGY; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA;

BIOMEDICAL RESEARCH; HUMANS; MODELS, STATISTICAL; RESEARCH DESIGN;

EID: 84926373373     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000020     Document Type: Article

References (85)

1. Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behaviour Research and Therapy, 31, 621-631. doi:10.1016/0005-7967(93)90115-B
2. Bandura, A. (1969). Principles of behavior modification. New York, NY: Holt, Rinehart and Winston.
3. Box, G. E. P., & Tiao, G. C. (1975). Intervention analysis with applications to economic and environmental problems. Journal of the American Statistical Association, 70, 70-79. doi:10.1080/01621459.1975.10480264
4. Brown, C. H. (1993). Analyzing preventive trials with generalized additive models. American Journal of Community Psychology, 21, 635-664. doi:10.1007/BF00942175
5. Chilcoat, H. D., & Schütz, C. G. (1996). Age-specific patterns of hallucinogen use in the US population: An analysis using generalized additive models. Drug and Alcohol Dependence, 43, 143-153. doi:10.1016/S0376-8716(96)01297-5
6. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences. (3rd ed.). New York, NY: Routledge.
7. Davison, A. C. (2003). Statistical models. Cambridge, England: Cambridge University Press. doi:10.1017/CBO9780511815850
8. DeProspero, A., & Cohen, S. (1979). Inconsistent visual analysis of intrasubject data. Journal of Applied Behavior Analysis, 12, 573-579. doi: 10.1901/jaba.1979.12-573
9. Dominici, F., McDermott, A., Zeger, S. L., & Samet, J. M. (2002). On the use of generalized additive models in time-series studies of air pollution and health. American Journal of Epidemiology, 156, 193-203. doi: 10.1093/aje/kwf062
10. Durrleman, S., & Simon, R. (1989). Flexible regression models with cubic splines. Statistics in Medicine, 8, 551-561. doi:10.1002/sim.4780080504
11. Edgington, E. S., & Onghena, P. (2007). Randomization tests. (4th ed.). Boca Raton, FL: Chapman & Hall/CRC.
12. Ferron, J. M., & Levin, J. R. (in press). Single-case permutation and randomization statistical tests: Present status, promising new developments. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case intervention research: Methodological and statistical advances. Washington, DC: American Psychological Association.
13. Foster-Johnson, L. (1995). Methods of data analysis reported in 20 years of the Journal of Applied Behavior Analysis. Unpublished manuscript, University of South Florida, Tampa.
14. Gabler, N. B., Duan, N., Vohra, S., & Kravitz, R. L. (2011). N-of-1 trials in the medical literature: A systematic review. Medical Care, 49, 761-768. doi:10.1097/MLR.0b013e318215d90d
15. Gorsuch, R. (1983). Three methods for analyzing limited time series (N_1) data. Behavioral Assessment, 5, 141-154.
16. Gottman, J. M., & Glass, G. V. (1978). Analysis of single-subject experiments. In T. R. Kratochwill (Ed.), Single subject research: Strategies for evaluating change (pp. 197-235). New York, NY: Academic Press. doi:10.1016/B978-0-12-425850-1.50011-9
17. Hastie, T., & Tibshirani, R. (1986). Generalized additive models. Statistical Science, 1, 297-310. doi:10.1214/ss/1177013604
18. Hastie, T., & Tibshirani, R. (1987). Generalized additive models: Some applications. Journal of the American Statistical Association, 82, 371-386. doi:10.1080/01621459.1987.10478440
19. Hastie, T., & Tibshirani, R. (1990). Generalized additive models. New York, NY: Chapman & Hall.
20. Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2012). A standardized mean difference effect size for single case designs. Research Synthesis Methods, 3, 224-239. doi:10.1002/jrsm.1052
21. Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2013). A standardized mean difference effect size for multiple baseline designs across individuals. Research Synthesis Methods, 4, 324-341. doi:10.1002/jrsm.1086
22. Heimberg, R. G., & Becker, R. E. (2002). Cognitive-behavioral group therapy for social phobia: Basic mechanisms and clinical strategies. New York, NY: Guilford Press.
23. Hemmi, M. H., Schneider, S., Müller, S., Meyer, A. H., & Wilhelm, F. H. (2011). Analyzing temporal patterns of infant sleep and negative affective behavior: A comparison between different statistical models. Infant Behavior and Development, 34, 541-551. doi:10.1016/j.infbeh.2011.06.010
24. Hothorn, T., & Everitt, B. S. (2010). A handbook of statistical analyses using R. (2nd ed.). Boca Raton, FL: Chapman & Hall/CRC.
25. Howick, J., Chalmers, I., Glasziou, P., Greenhalgh, T., Heneghan, C., Liberati, A., . . . Thornton, H. (2011). The 2011 Oxford CEBM Levels of Evidence: Introductory document. Retrieved from http://www.cebm.net/index.aspx?o_8111
26. Huitema, B. E. (2011). The analysis of covariance and alternatives: Statistical methods for experiments, quasi-experiments, and single-case studies. (2nd ed.). Hoboken, NJ: Wiley. doi:10.1002/9781118067475
27. Huitema, B. E., & McKean, J. W. (1991). Autocorrelation estimation and inference with small samples. Psychological Bulletin, 110, 291-304. doi:10.1037/0033-2909.110.2.291
28. Huitema, B. E., & McKean, J. W. (2000a). Design specification issues in time-series intervention models. Educational and Psychological Measurement, 60, 38-58. doi:10.1177/00131640021970358
29. Huitema, B. E., & McKean, J. W. (2000b). A simple and powerful test for autocorrelations errors in OLS intervention models. Psychological Reports, 87, 3-20. doi:10.2466/pr0.2000.87.1.3
30. Jones, R. R., Vaught, R. S., & Weinrott, M. (1977). Time-series analysis in operant research. Journal of Applied Behavior Analysis, 10, 151-166. doi:10.1901/jaba.1977.10-151
31. Kazdin, A. E. (1978). Methodological and interpretive problems of singlecase experimental designs. Journal of Consulting and Clinical Psychology, 46, 629-642. doi:10.1037/0022-006X.46.4.629
32. Kazdin, A. E. (2012). Single-case research designs: Methods for clinical and applied settings. New York, NY: Oxford University Press.
33. Keele, L. (2008). Semiparametric regression for the social sciences. Chichester, England: Wiley.
34. Knapp, T. J. (1983). Behavior analysts' visual appraisal of behavior change in graphic display. Behavioral Assessment, 5, 155-164.
35. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf
36. Kratochwill, T. R., & Levin, J. R. (2010). Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods, 15, 124-144. doi:10.1037/a0017736
37. Kratochwill, T. R., & Stoiber, K. C. (2002). Evidence-based interventions in school psychology: Conceptual foundations of the procedural and coding manual of Division 16 and the Society for the Study of School Psychology Task Force. School Psychology Quarterly, 17, 341-389. doi:10.1521/scpq.17.4.341.20872
38. Kromrey, J. D., & Foster-Johnson, L. (1996). Determining the efficacy of intervention: The use of effect sizes for data analysis in single-subject research. Journal of Experimental Education, 65, 73-93. doi:10.1080/00220973.1996.9943464
39. Kurtz, P. F., Chin, M. D., Rush, K. S., & Dixon, D. R. (2008). Treatment of challenging behavior exhibited by children with prenatal drug exposure. Research in Developmental Disabilities, 29, 582-594. doi:10.1016/j.ridd.2007.05.007
40. Lagakos, S. W. (1988). Effects of mismodeling and mismeasuring explanatory variables on tests of their association with a response variable. Statistics in Medicine, 7, 257-274. doi:10.1002/sim.4780070126
41. Levin, J. R., Ferron, J. M., & Kratochwill, T. R. (2012). Nonparametric statistical tests for single-case systematic and randomized ABAB . . . AB and alternating treatment intervention designs: New developments, new directions. Journal of School Psychology, 50, 599-624. doi:10.1016/j .jsp.2012.05.001
42. Liber, D. B., Frea, W. D., & Symon, J. B. G. (2008). Using time-delay to improve social play skills with peers for children with autism. Journal of Autism and Developmental Disorders, 38, 312-323. doi:10.1007/s10803-007-0395-z
43. Light, R. J., Singer, J. D., & Willett, J. B. (1990). By design: Planning research in higher education. Cambridge, MA: Harvard University Press.
44. Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000). Win-BUGS-A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325-337. doi:10.1023/A: 1008929526011
45. MacCready, R. A. (1974). Admissions of phenylketonuric patients to residential institutions before and after screening programs of the newborn infant. Journal of Pediatrics, 85, 383-385. doi:10.1016/S0022-3476(74)80124-1
46. Maggin, D. M., Swaminathan, H., Rogers, H. J., O'Keefe, B. V., Sugai, G., & Horner, R. H. (2011). A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology, 49, 301-321. doi:10.1016/j.jsp.2011.03.004
47. Manly, B. F. J. (2007). [Review of the book Randomization tests (4th ed.), by E. S. Edgington & P. Onghena]. International Statistical Review, 75, 269. doi:10.1111/j.1751-5823.2007.00015_21.x
48. Marra, G., & Wood, S. N. (2012). Coverage properties of confidence intervals for generalized additive model components. Scandinavian Journal of Statistics, 39, 53-74. doi:10.1111/j.1467-9469.2011.00760.x
49. McCleary, R. D. (2000). The evolution of the time series experiment. In L. Bickman (Ed.), Research design: Donald Campbell's legacy (Vol. 2, pp. 215-234). Thousand Oaks, CA: Sage.
50. McCullagh, P., & Nelder, J. A. (1989). Generalized linear models. (2nd ed.). London, England: Chapman & Hall. doi:10.1007/978-1-4899-3242-6
51. McKillip, J. (1992). Research without control groups: A control construct design. In F. B. Bryant, J. Edwards, R. S. Tindale, E. J. Posavac, L. Heath, E. Henderson, & Y. Suarez-Balcazar (Eds.), Methodological issues in applied social psychology (pp. 159-175). New York, NY: Plenum Press.
52. Nishith, P., Resick, P. A., & Griffin, M. G. (2002). Patterns of change in prolonged exposure and cognitive-processing therapy for female rape victims with posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 70, 880-886. doi:10.1037/0022-006X.70.4.880
53. Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284-299. doi:10.1016/j.beth.2010.08.006
54. Parsonson, B. S., & Baer, D. M. (1978). The analysis and presentation of graphic data. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change (pp. 101-165). New York, NY: Academic Press. doi:10.1016/B978-0-12-425850-1.50009-0
55. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. (2nd ed.). Thousand Oaks, CA: Sage.
56. Reding, G. R., & Raphelson, M. (1995). Around-the-clock mobile psychiatric crisis intervention: Another effective alternative to psychiatric hospitalization. Community Mental Health Journal, 31, 179-187. doi: 10.1007/BF02188767
57. Rindskopf, D., Shadish, W. R., & Hedges, L. V. (2012, March). A simple effect size estimator for single-case designs using WinBUGS. Paper presented at the Annual Conference of the Society for Research on Educational Effectiveness, Washington, D.C.
58. Ruppert, D., Wand, M. P., & Carroll, R. J. (2003). Semiparametric regression. New York, NY: Cambridge University Press. doi:10.1017/CBO9780511755453
59. Scruggs, T. E., Mastropieri, M. A., & Castro, G. (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education, 8, 24-33. doi:10.1177/074193258700800206
60. Shadish, W. R., Hedges, L. V., Pustejovsky, J., Rindskopf, D. M., Boyajian, J. G., & Sullivan, K. J. (in press). Analyzing single-case designs:d, G, hierarchical models, Bayesian estimators, generalized additive models, and the hopes and fears of researchers about analyses. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case intervention research: Methodological and statistical advances. Washington, DC: American Psychological Association.
61. Shadish, W. R., Kyse, E. N., & Rindskopf, D. M. (2013). Analyzing data from single-case designs using multilevel models: New applications and some agenda items for future research. Psychological Methods, 18, 385-405. doi:10.1037/a0032964
62. Shadish, W. R., & Sullivan, K. J. (2011). Characteristics of single case designs used to assess Intervention effects in 2008. Behavior Research Methods, 43, 971-980. doi:10.3758/s13428-011-0111-y
63. Shadish, W. R., Zuur, A. F., & Sullivan, K. J. (2014). Using generalized additive (mixed) models to analyze single case designs. Journal of School Psychology, 52, 149-178. doi:10.1016/j.jsp.2013.11.004
64. Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel modeling: An introduction to basic and advanced multilevel modeling. (2nd ed.). London, England: Sage.
65. Spiegelhalter, D., Thomas, A., Best, N., & Lunn, D. (2004). WinBUGS User Manual, Version 2.0. Retrieved from http://mathstat.helsinki.fi/openbugs/ManualsFrames.html
66. Stanton-Chapman, T. L., Denning, C. B., & Jamison, K. R. (2008). Exploring the effects of a social communication intervention for improving request and word diversity in preschoolers with disabilities. Psychology in the Schools, 45, 644-664. doi:10.1002/pits.20315
67. Sun, D., & Speckman, P. L. (2008). Bayesian hierarchical linear mixed models for additive smoothing splines. Annals of the Institute of Statistical Mathematics, 60, 499-517. doi:10.1007/s10463-007-0127-3
68. Thompson, S. B. (2011). Simple formulas for standard errors that cluster by both firm and time. Journal of Financial Economics, 99, 1-10. doi:10.1016/j.jfineco.2010.08.016
69. Tzur-Bitan, D., Meiran, N., Steinberg, D. M., & Shahar, G. (2012). Is the looming maladaptive cognitive style a central mechanism in the (generalized) anxiety-(major) depression comorbidity: An intra-individual time series study. International Journal of Cognitive Therapy, 5, 170-185. doi:10.1521/ijct.2012.5.2.170
70. Van den Noortgate, W., & Onghena, P. (2003a). Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly, 18, 325-346. doi:10.1521/scpq.18.3.325.22577
71. Van den Noortgate, W., & Onghena, P. (2003b). Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments & Computers, 35, 1-10. doi: 10.3758/BF03195492
72. Van den Noortgate, W., & Onghena, P. (2007). The aggregation of singlecase results using hierarchical linear models. Behavior Analyst Today, 8, 196-209.
73. Van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment and Intervention, 2, 142-151. doi:10.1080/17489530802505362
74. Velicer, W. F. (1994). Time series models of individual substance abusers. NIDA Research Monographs, 142, 264-301.
75. Ver Hoef, J. M., & Boveng, P. L. (2007). Quasi-Poisson vs. negative binomial regression: How should we model overdispersed count data. Ecology, 88, 2766-2772. doi:10.1890/07-0043.1
76. Wood, S. N. (2005a, September 30). [R] Smooth terms significance in GAM models. [Online help message]. Retrieved from https://stat.ethz.ch/pipermail/r-help/2005-September/079945.html
77. Wood, S. N. (2005b, October 24). [R] Testing nonlinear component in mgcv:gam. [Online help message]. Retrieved from https://stat.ethz.ch/pipermail/r-help/2005-October/081360.html
78. Wood, S. N. (2006). Generalized additive models: An introduction with R. Boca Raton, FL: Chapman & Hall/CRC.
79. Wood, S. (2009). gamm4: Generalized additive mixed models using mgcv and lme4 (R package Version 0.1-6) [Computer software]. Available from http://www.r-project.org
80. Wood, S. (2010). mgcv: GAMs with GCV/AIC/REML smoothness estimation and GAMMs by PQL [Computer software]. Available from http://cran.r-project.org/package_mgcv
81. Zajacova, A., & Burgard, S. A. (2012). Shape of the BMI-mortality association by cause of death, using generalized additive models: NHIS 1986-2006. Journal of Aging and Health, 24, 191-211. doi:10.1177/0898264311406268
82. Zeger, S. L., & Diggle, P. J. (1994). Semiparametric models for longitudinal data with application to CD4 cell numbers in HIV seroconverters. Biometrics, 50, 689-699. doi:10.2307/2532783
83. Zhang, D., & Davidian, M. (2004). Likelihood and conditional likelihood inference for generalized additive mixed models for clustered data. Journal of Multivariate Analysis, 91, 90-106. doi:10.1016/j.jmva.2004.04.007
84. Zhang, Y., Xie, Y., & Li, L. (2012). Crash frequency analysis of different types of urban roadway segments using generalized additive model. Journal of Safety Research, 43, 107-114. doi:10.1016/j.jsr.2012.01.003
85. Zuur, A. F. (2012). A beginner's guide to generalized additive models with R. Newburgh, England: Highland Statistics.