Single-case experimental designs: A systematic review of published research and current standards

Psychological Methods

Volumn 17, Issue 4, 2012, Pages 510-550

  Smith, Justin D ^a  

^a UNIVERSITY OF OREGON   (United States)

Author keywords

Daily diary; Research standards; Single case experimental design; Systematic review; Timeseries

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; QUALITY CONTROL; STANDARD;

BENCHMARKING; HUMANS; RESEARCH DESIGN;

EID: 84870945764     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029312     Document Type: Article

References (137)

1. Albright, J. J., & Marinova, D. M. (2010). Estimating multilevel models using SPSS, Stata, and SAS. Indiana University, Bloomington, IN. Retrieved from http://www.iub.edu/%7Estatmath/stat/all/hlm/hlm.pdf
2. Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behaviour Research and Therapy, 31, 621-631. doi:10.1016/0005-7967(93)90115-B
3. Alloy, L. B., Just, N., & Panzarella, C. (1997). Attributional style, daily life events, and hopelessness depression: Subtype validation by prospective variability and specificity of symptoms. Cognitive Therapy and Research, 21, 321-344. doi:10.1023/A:1021878516875
4. Arbuckle, J. L. (2006). Amos (Version 7.0). Chicago, IL: SPSS.
5. Barlow, D. H., Nock, M. K., & Hersen, M. (2008). Single case research designs: Strategies for studying behavior change (3rd ed.). New York, NY: Allyn & Bacon.
6. Barrett, L. F., & Barrett, D. J. (2001). An introduction to computerized experience sampling in psychology. Social Science Computer Review, 19, 175-185. doi:10.1177/089443930101900204
7. Bloom, M., Fisher, J., & Orme, J. G. (2003). Evaluating practice: Guidelines for the accountable professional (4th ed.). Boston, MA: Allyn & Bacon.
8. Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616. doi:10.1146/annurev.psych.54.101601.145030
9. Borckardt, J. J. (2006). Simulation modeling analysis: Time series analysis program for short time series data streams (Version 8.3.3). Charleston, SC: Medical University of South Carolina.
10. Borckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D., & O'Neil, P. (2008). Clinical practice as natural laboratory for psychotherapy research. American Psychologist, 63, 77-95. doi:10.1037/0003-066X.63.2.77
11. Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review, 110, 203-219. doi:10.1037/0033-295X.110.2.203
12. Bower, G. H. (1981). Mood and memory. American Psychologist, 36, 129-148. doi:10.1037/0003-066X.36.2.129
13. Box, G. E. P., & Jenkins, G. M. (1970). Time-series analysis: Forecasting and control. San Francisco, CA: Holden-Day.
14. Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30, 531-563. doi:10.1177/0145445503261167
15. Browne, M. W., & Nesselroade, J. R. (2005). Representing psychological processes with dynamic factor models: Some promising uses and extensions of autoregressive moving average time series models. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics: A festschrift for Roderick P. McDonald (pp. 415-452). Mahwah, NJ: Erlbaum.
16. Busk, P. L., & Marascuilo, L. A. (1992). Statistical analysis in single-case research: Issues, procedures, and recommendations, with applications to multiple behaviors. In T. R. Kratochwill & J. R. Levin (Eds.), Singlecase research design and analysis: New directions for psychology and education (pp. 159-185): Hillsdale, NJ: Erlbaum.
17. Busk, P. L., & Marascuilo, R. C. (1988). Autocorrelation in single-subject research: A counter-argument to the myth of no autocorrelation. Behavioral Assessment, 10, 229-242.
18. Campbell, J. M. (2004). Statistical comparison of four effect sizes for single-subject designs. Behavior Modification, 28, 234-246. doi: 10.1177/0145445503259264
19. Carr, E. G., Horner, R. H., Turnbull, A. P., Marquis, J. G., Magito McLaughlin, D., McAtee, M. L., ... Doolabh, A. (1999). Positive behavior support for people with developmental disabilities: A research synthesis. Washington, DC: American Association on Mental Retardation.
20. Center, B. A., Skiba, R. J., & Casey, A. (1986). A methodology for the quantitative synthesis of intra-subject design research. Journal of Educational Science, 19, 387-400. doi:10.1177/002246698501900404
21. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18. doi:10.1037/0022-006X.66.1.7
22. Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685-716. doi:10.1146/annurev.psych.52.1.685
23. Chow, S.-M., Ho, M.-H. R., Hamaker, E. L., & Dolan, C. V. (2010). Equivalence and differences between structural equation modeling and state-space modeling techniques. Structural Equation Modeling, 17, 303-332. doi:10.1080/10705511003661553
24. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
25. Cohen, J. (1994). The earth is round (p Universal-GreekwithMathPi.-1.H11021 . 05). American Psychologist, 49, 997-1003. doi:10.1037/0003-066X.49.12.997
26. Crosbie, J. (1993). Interrupted time-series analysis with brief single-subject data. Journal of Consulting and Clinical Psychology, 61, 966-974. doi:10.1037/0022-006X.61.6.966
27. Dattilio, F. M., Edwards, J. A., & Fishman, D. B. (2010). Case studies within a mixed methods paradigm: Toward a resolution of the alienation between researcher and practitioner in psychotherapy research. Psychotherapy: Theory, Research, Practice, Training, 47, 427-441. doi: 10.1037/a0021181
28. Dempster, A., Laird, N., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39, 1-38.
29. Des Jarlais, D. C., Lyles, C., & Crepaz, N. (2004). Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: The TREND statement. American Journal of Public Health, 94, 361-366. doi:10.2105/AJPH.94.3.361
30. Diggle, P., & Liang, K. Y. (2001). Analyses of longitudinal data. New York, NY: Oxford University Press.
31. Doss, B. D., & Atkins, D. C. (2006). Investigating treatment mediators when simple random assignment to a control group is not possible. Clinical Psychology: Science and Practice, 13, 321-336. doi:10.1111/j.1468-2850.2006.00045.x
32. du Toit, S. H. C., & Browne, M. W. (2001). The covariance structure of a vector ARMA time series. In R. Cudeck, S. H. C. du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future (pp. 279-314). Lincolnwood, IL: Scientific Software International.
33. du Toit, S. H. C., & Browne, M. W. (2007). Structural equation modeling of multivariate time series. Multivariate Behavioral Research, 42, 67-101. doi:10.1080/00273170701340953
34. Fechner, G. T. (1889). Elemente der psychophysik [Elements of psychophysics]. Leipzig, Germany: Breitkopf & Hartel.
35. Ferron, J., & Sentovich, C. (2002). Statistical power of randomization tests used with multiple-baseline designs. Journal of Experimental Education, 70, 165-178. doi:10.1080/00220970209599504
36. Ferron, J., & Ware, W. (1995). Analyzing single-case data: The power of randomization tests. Journal of Experimental Education, 63, 167-178. doi:10.1080/00220973.1995.9943820
37. Fox, J. (2006). TEACHER'S CORNER: Structural equation modeling with the SEM package in R. Structural Equation Modeling, 13, 465-486. doi:10.1207/s15328007sem1303_7
38. Franklin, R. D., Allison, D. B., & Gorman, B. S. (Eds.). (1997). Design and analysis of single-case research. Mahwah, NJ: Erlbaum.
39. Franklin, R. D., Gorman, B. S., Beasley, T. M., & Allison, D. B. (1997). Graphical display and visual analysis. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single-case research (pp. 119-158). Mahwah, NJ: Erlbaum.
40. Gardner, W., Mulvey, E. P., & Shaw, E. C. (1995). Regression analyses of counts and rates: Poisson, overdispersed Poisson, and negative binomial models. Psychological Bulletin, 118, 392-404. doi:10.1037/0033-2909.118.3.392
41. Green, A. S., Rafaeli, E., Bolger, N., Shrout, P. E., & Reis, H. T. (2006). Paper or plastic? Data equivalence in paper and electronic diaries. Psychological Methods, 11, 87-105. doi:10.1037/1082-989X.11.1.87
42. Hamilton, J. D. (1994). Time series analysis. Princeton, NJ: Princeton University Press.
43. Hammond, D., & Gast, D. L. (2010). Descriptive analysis of single-subject research designs: 1983-2007. Education and Training in Autism and Developmental Disabilities, 45, 187-202.
44. Hanson, M. D., & Chen, E. (2010). Daily stress, cortisol, and sleep: The moderating role of childhood psychosocial environments. Health Psychology, 29, 394-402. doi:10.1037/a0019879
45. Harvey, A. C. (2001). Forecasting, structural time series models and the Kalman filter. Cambridge, MA: Cambridge University Press.
46. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165-179.
47. Horner, R. H., & Spaulding, S. (2010). Single-case research designs. In N. J. Salkind (Ed.), Encyclopedia of research design (pp. 1386-1394). Thousand Oaks, CA: Sage.
48. Horton, N. J., & Kleinman, K. P. (2007). Much ado about nothing: A comparison of missing data methods and software to fit incomplete data regression models. The American Statistician, 61, 79-90. doi:10.1198/000313007X172556
49. Hser, Y., Shen, H., Chou, C., Messer, S. C., & Anglin, M. D. (2001). Analytic approaches for assessing long-term treatment effects. Evaluation Review, 25, 233-262. doi:10.1177/0193841X0102500206
50. Huitema, B. E. (1985). Autocorrelation in applied behavior analysis: A myth. Behavioral Assessment, 7, 107-118.
51. Huitema, B. E., & McKean, J. W. (1994). Reduced bias autocorrelation estimation: Three jackknife methods. Educational and Psychological Measurement, 54, 654-665. doi:10.1177/0013164494054003008
52. Ibrahim, J. G., Chen, M.-H., Lipsitz, S. R., & Herring, A. H. (2005). Missing-data methods for generalized linear models: A comparative review. Journal of the American Statistical Association, 100, 332-346. doi:10.1198/016214504000001844
53. Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press.
54. Jacobson, N. S., & Christensen, A. (1996). Studying the effectiveness of psychotherapy: How well can clinical trials do the job? American Psychologist, 51, 1031-1039. doi:10.1037/0003-066X.51.10.1031
55. Jones, R. R., Vaught, R. S., & Weinrott, M. R. (1977). Time-series analysis in operant research. Journal of Applied Behavior Analysis, 10, 151-166. doi:10.1901/jaba.1977.10-151
56. Jones, W. P. (2003). Single-case time series with Bayesian analysis: A practitioner's guide. Measurement and Evaluation in Counseling and Development, 36, 28-39.
57. Kanfer, H. (1970). Self-monitoring: Methodological limitations and clinical applications. Journal of Consulting and Clinical Psychology, 35, 148-152. doi:10.1037/h0029874
58. Kazdin, A. E. (1981). Drawing valid inferences from case studies. Journal of Consulting and Clinical Psychology, 49, 183-192. doi:10.1037/0022-006X.49.2.183
59. Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1-27. doi: 10.1146/annurev.clinpsy.3.022806.091432
60. Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146-159. doi:10.1037/0003-066X.63.3.146
61. Kazdin, A. E. (2009). Understanding how and why psychotherapy leads to change. Psychotherapy Research, 19, 418-428. doi:10.1080/10503300802448899
62. Kazdin, A. E. (2010). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York, NY: Oxford University Press.
63. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759. doi: 10.1177/0013164496056005002
64. Kratochwill, T. R. (2007). Preparing psychologists for evidence-based school practice: Lessons learned and challenges ahead. American Psychologist, 62, 829-843. doi:10.1037/0003-066X.62.8.829
65. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf
66. Kratochwill, T. R., & Levin, J. R. (1992). Single-case research design and analysis: New directions for psychology and education. Hillsdale, NJ: Erlbaum.
67. Kratochwill, T. R., & Levin, J. R. (2010). Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods, 15, 124-144. doi:10.1037/a0017736
68. Kratochwill, T. R., Levin, J. R., Horner, R. H., & Swoboda, C. (2011). Visual analysis of single-case intervention research: Conceptual and methodological considerations (WCER Working Paper No. 2011-6). University of Wisconsin-Madison, Wisconsin Center for Education Research. Retrieved from http://www.wcer.wisc.edu/publications/workingPapers/papers.php
69. Lambert, D. (1992). Zero-inflated Poisson regression, with an application to defects in manufacturing. Technometrics, 34, 1-14. doi:10.2307/1269547
70. Lambert, M. J., Hansen, N. B., & Harmon, S. C. (2010). Outcome Questionnaire System (The OQ System): Development and practical applications in healthcare settings. In M. Barkham, G. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 139-154). Chichester, England: Wiley.
71. Littell, J. H., Corcoran, J., & Pillai, V. K. (2008). Systematic reviews and meta-analysis. New York, NY: Oxford University Press. doi:10.1093/acprof:oso/9780195326543.001.0001
72. Liu, L. M., & Hudack, G. B. (1995). The SCA statistical system: Vector ARMA modeling of multiple time series. Oak Brook, IL: Scientific Computing Associates Corporation.
73. Lubke, G. H., & Muthén, B. O. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10, 21-39. doi:10.1037/1082-989X.10.1.21
74. Manolov, R., & Solanas, A. (2008). Comparing N = 1 effect sizes in presence of autocorrelation. Behavior Modification, 32, 860-875. doi: 10.1177/0145445508318866
75. Marshall, R. J. (1980). Autocorrelation estimation of time series with randomly missing observations. Biometrika, 67, 567-570. doi:10.1093/biomet/67.3.567
76. Matyas, T. A., & Greenwood, K. M. (1990). Visual analysis of single-case time series: Effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavior Analysis, 23, 341-351. doi:10.1901/jaba.1990.23-341
77. Members of the Task Force on Evidence-Based Interventions in School Psychology. (2003). Procedural and coding manual for review of evidence-based interventions. Retrieved from http://www.sp-ebi.org/documents/_workingfiles/EBImanual1.pdf
78. Moher, D., Schulz, K. F., Altman, D. F., & the CONSORT Group. (2001). The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Journal of the American Medical Association, 285, 1987-1991. doi:10.1001/jama.285.15.1987
79. Morgan, D. L., & Morgan, R. K. (2001). Single-participant research design: Bringing science to managed care. American Psychologist, 56, 119-127. doi:10.1037/0003-066X.56.2.119
80. Muthén, B. O., & Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2, 371-402. doi:10.1037/1082-989X.2.4.371
81. Muthén, L. K., & Muthén, B. O. (2010). Mplus (Version 6.11). Los Angeles, CA: Muthén & Muthén.
82. Nagin, D. S. (1999). Analyzing developmental trajectories: A semiparametric, group-based approach. Psychological Methods, 4, 139-157. doi:10.1037/1082-989X.4.2.139
83. National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction (NIH Publication No. 00-4769). Washington, DC: U.S. Government Printing Office.
84. Olive, M. L., & Smith, B. W. (2005). Effect size calculations and single subject designs. Educational Psychology, 25, 313-324. doi:10.1080/0144341042000301238
85. Oslin, D. W., Cary, M., Slaymaker, V., Colleran, C., & Blow, F. C. (2009). Daily ratings measures of alcohol craving during an inpatient stay define subtypes of alcohol addiction that predict subsequent risk for resumption of drinking. Drug and Alcohol Dependence, 103, 131-136. doi:10.1016/J.Drugalcdep.2009.03.009
86. Palermo, T. M., Valenzuela, D., & Stork, P. P. (2004). A randomized trial of electronic versus paper pain diaries in children: Impact on compliance, accuracy, and acceptability. Pain, 107, 213-219. doi:10.1016/j.pain.2003.10.005
87. Parker, R. I., & Brossart, D. F. (2003). Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy, 34, 189-211. doi:10.1016/S0005-7894(03)80013-8
88. Parker, R. I., Cryer, J., & Byrns, G. (2006). Controlling baseline trend in single case research. School Psychology Quarterly, 21, 418-444. doi: 10.1037/h0084131
89. Parker, R. I., & Vannest, K. (2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40, 357-367. doi:10.1016/j.beth.2008.10.006
90. Parsonson, B. S., & Baer, D. M. (1978). The analysis and presentation of graphic data. In T. R. Kratochwill (Ed.), Single subject research (pp. 101-166). New York, NY: Academic Press.
91. Parsonson, B. S., & Baer, D. M. (1992). The visual analysis of data, and current research into the stimuli controlling it. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 15-40). Hillsdale, NJ: Erlbaum.
92. Piasecki, T. M., Hufford, M. R., Solham, M., & Trull, T. J. (2007). Assessing clients in their natural environments with electronic diaries: Rationale, benefits, limitations, and barriers. Psychological Assessment, 19, 25-43. doi:10.1037/1040-3590.19.1.25
93. Raghunathan, T. E. (2004). What do we do with missing data? Some options for analysis of incomplete data. Annual Review of Public Health, 25, 99-117. doi:10.1146/annurev.publhealth.25.102802.124410
94. Raudenbush, S. W., Bryk, A. S., & Congdon, R. (2011). HLM 7: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.
95. R Development Core Team. (2005). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
96. Redelmeier, D. A., & Kahneman, D. (1996). Patients' memories of painful medical treatments: Real-time and retrospective evaluations of two minimally invasive procedures. Pain, 66, 3-8. doi:10.1016/0304-3959(96)02994-6
97. Reis, H. T. (1994). Domains of experience: Investigating relationship processes from three perspectives. In R. Erber & R. Gilmore (Eds.), Theoretical frameworks in personal relationships (pp. 87-110). Mahwah, NJ: Erlbaum.
98. Reis, H. T., & Gable, S. L. (2000). Event sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 190-222). New York, NY: Cambridge University Press.
99. Robey, R. R., Schultz, M. C., Crawford, A. B., & Sinner, C. A. (1999). Single-subject clinical-outcome research: Designs, data, effect sizes, and analyses. Aphasiology, 13, 445-473. doi:10.1080/026870399402028
100. Rossi, P. H., & Freeman, H. E. (1993). Evaluation: A systematic approach (5th ed.). Thousand Oaks, CA: Sage.
101. Schmidt, M., Perels, F., & Schmitz, B. (2010). How to perform idiographic and a combination of idiographic and nomothetic approaches: A comparison of time series analyses and hierarchical linear modeling. Journal of Psychology, 218, 166-174. doi:10.1027/0044-3409/a000026
102. Scollon, C. N., Kim-Pietro, C., & Diener, E. (2003). Experience sampling: Promises and pitfalls, strengths and weaknesses. Journal of Happiness Studies, 4, 5-34. doi:10.1007/978-90-481-2354-4_8
103. Scruggs, T. E., & Mastropieri, M. A. (1998). Summarizing single-subject research: Issues and applications. Behavior Modification, 22, 221-242. doi:10.1177/01454455980223001
104. Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research. Remedial & Special Education, 8, 24-33. doi:10.1177/074193258700800206
105. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
106. Shadish, W. R., Rindskopf, D. M., & Hedges, L. V. (2008). The state of the science in the meta-analysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 2, 188-196. doi:10.1080/17489530802581603
107. Shadish, W. R., & Sullivan, K. J. (2011). Characteristics of single-case designs used to assess treatment effects in 2008. Behavior Research Methods, 43, 971-980. doi:10.3758/s13428-011-0111-y
108. Sharpley, C. F. (1987). Time-series analysis of behavioural data: An update. Behaviour Change, 4, 40-45.
109. Shiffman, S., Hufford, M., Hickcox, M., Paty, J. A., Gnys, M., & Kassel, J. D. (1997). Remember that? A comparison of real-time versus retrospective recall of smoking lapses. Journal of Consulting and Clinical Psychology, 65, 292-300. doi:10.1037/0022-006X.65.2.292.a
110. Shiffman, S., & Stone, A. A. (1998). Ecological momentary assessment: A new tool for behavioral medicine research. In D. S. Krantz & A. Baum (Eds.), Technology and methods in behavioral medicine (pp. 117-131). Mahwah, NJ: Erlbaum.
111. Shiffman, S., Stone, A. A., & Hufford, M. R. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1-32. doi: 10.1146/annurev.clinpsy.3.022806.091415
112. Shumway, R. H., & Stoffer, D. S. (1982). An approach to time series smoothing and forecasting using the EM Algorithm. Journal of Time Series Analysis, 3, 253-264. doi:10.1111/j.1467-9892.1982.tb00349.x
113. Skinner, B. F. (1938). The behavior of organisms. New York, NY: Appleton-Century-Crofts.
114. Smith, J. D., Borckardt, J. J., & Nash, M. R. (2012). Inferential precision in single-case time-series datastreams: How well does the EM procedure perform when missing observations occur in autocorrelated data? Behavior Therapy, 43, 679-685. doi:10.1016/j.beth.2011.10.001
115. Smith, J. D., Handler, L., & Nash, M. R. (2010). Therapeutic assessment for preadolescent boys with oppositional-defiant disorder: A replicated single-case time-series design. Psychological Assessment, 22, 593-602. doi:10.1037/a0019697
116. Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
117. Soliday, E., Moore, K. J., & Lande, M. B. (2002). Daily reports and pooled time series analysis: Pediatric psychology applications. Journal of Pediatric Psychology, 27, 67-76. doi:10.1093/jpepsy/27.1.67
118. StataCorp. (2011). Stata statistical software (Release 12). College Station, TX: Author.
119. Stone, A. A., Broderick, J. E., Kaell, A. T., Deles-Paul, P. A. E. G., & Porter, L. E. (2000). Does the peak-end phenomenon observed in laboratory pain studies apply to real-world pain in rheumatoid arthritics? The Journal of Pain, 1, 212-217. doi:10.1054/jpai.2000.7568
120. Stone, A. A., & Shiffman, S. (2002). Capturing momentary, self-report data: A proposal for reporting guidelines. Annals of Behavioral Medicine, 24, 236-243. doi:10.1207/S15324796ABM2403_09
121. Stout, R. L. (2007). Advancing the analysis of treatment process. Addiction, 102, 1539-1545. doi:10.1111/j.1360-0443.2007.01880.x
122. Tate, R. L., McDonald, S., Perdices, M., Togher, L., Schultz, R., & Savage, S. (2008). Rating the methodological quality of single-subject designs and N-of-1 trials: Introducing the Single-Case Experimental Design (SCED) Scale. Neuropsychological Rehabilitation, 18, 385-401. doi: 10.1080/09602010802009201
123. Thiele, C., Laireiter, A.-R., & Baumann, U. (2002). Diaries in clinical psychology and psychotherapy: A selective review. Clinical Psychology & Psychotherapy, 9, 1-37. doi:10.1002/cpp.302
124. Tiao, G. C., & Box, G. E. P. (1981). Modeling multiple time series with applications. Journal of the American Statistical Association, 76, 802-816.
125. Tschacher, W., & Ramseyer, F. (2009). Modeling psychotherapy process by time-series panel analysis (TSPA). Psychotherapy Research, 19, 469-481. doi:10.1080/10503300802654496
126. Velicer, W. F., & Colby, S. M. (2005a). A comparison of missing-data procedures for ARIMA time-series analysis. Educational and Psychological Measurement, 65, 596-615. doi:10.1177/0013164404272502
127. Velicer, W. F., & Colby, S. M. (2005b). Missing data and the general transformation approach to time series analysis. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics: A festschrift to Roderick P. McDonald (pp. 509-535). Hillsdale, NJ: Erlbaum.
128. Velicer, W. F., & Fava, J. L. (2003). Time series analysis. In J. Schinka & W. F. Velicer (Eds.), Research methods in psychology (Vol. 2). New York, NY: Wiley.
129. Wachtel, P. L. (2010). Beyond "ESTs": Problematic assumptions in the pursuit of evidence-based practice. Psychoanalytic Psychology, 27, 251-272. doi:10.1037/a0020532
130. Watson, J. B. (1925). Behaviorism. New York, NY: Norton.
131. Weisz, J. R., & Hawley, K. M. (1998). Finding, evaluating, refining, and applying empirically supported treatments for children and adolescents. Journal of Clinical Child Psychology, 27, 206-216. doi:10.1207/s15374424jccp2702_7
132. Weisz, J. R., & Hawley, K. M. (1999). Procedural and coding manual for identification of beneficial treatments. Washington, DC: American Psychological Association, Society for Clinical Psychology, Division 12, Committee on Science and Practice.
133. Westen, D., & Bradley, R. (2005). Empirically supported complexity. Current Directions in Psychological Science, 14, 266-271. doi:10.1111/j.0963-7214.2005.00378.x
134. Westen, D., Novotny, C. M., & Thompson-Brenner, H. K. (2004). The empirical status of empirically supported psychotherapies: Assumptions, findings, and reporting controlled clinical trials. Psychological Bulletin, 130, 631-663. doi:10.1037/0033-2909.130.4.631
135. Wilkinson, L., & The Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604. doi:10.1037/0003-066X.54.8.594
136. Wolery, M., Busick, M., Reichow, B., & Barton, E. E. (2010). Comparison of overlap methods for quantitatively synthesizing single-subject data. The Journal of Special Education, 44, 18-28. doi:10.1177/0022466908328009
137. Wu, Z., Huang, N. E., Long, S. R., & Peng, C.-K. (2007). On the trend, detrending, and variability of nonlinear and nonstationary time series. Proceedings of the National Academy of Sciences, USA, 104, 14889-14894. doi:10.1073/pnas.0701020104