Data-division-specific robustness and power of randomization tests for ABAB designs

Journal of Experimental Education

Volumn 78, Issue 2, 2009, Pages 191-214

  Manolov, Rumen ^a   Solanas, Antonio ^a   Bulté, Isis ^b   Onghena, Patrick ^b  

^a UNIVERSITY OF BARCELONA   (Spain)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

ABAB design; Monte Carlo; Power; Randomization tests; Robustness

Indexed keywords

EID: 73849105951     PISSN: 00220973     EISSN: None     Source Type: Journal    
DOI: 10.1080/00220970903292827     Document Type: Article

References (40)

1. Blumberg, C. J. (1984). Comments on "A simplified time-series analysis for evaluating treatment interventions." Journal of Applied Behavior Analysis, 17, 539-542.
2. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
3. Cox, D. R., & Hinkley, D. V. (1974). Theoretical statistics. London: Chapman & Hall.
4. Crosbie, J. (1987). The inability of the binomial test to control Type I error with single-subject data. Behavioral Assessment, 9, 141-150.
5. Edgington, E. S. (1980). Random assignment and statistical tests for one-subject experiments. Behavioral Assessment, 2, 19-28.
6. Edgington, E. S., & Onghena, P. (2007). Randomization tests (4th ed.). Boca Raton, FL: Chapman & Hall/CRC.
7. Ferron, J. (2002). Reconsidering the use of the general linear model with single-case data. Behavior Research Methods, Instruments, & Computers, 34, 324-331.
8. Ferron, J., Foster-Johnson, L. & Kromrey, J. D. (2003). The functioning of single-case randomization tests with and without random assignment. The Journal of Experimental Education, 71, 267-288.
9. Ferron, J., & Jones, P. K. (2006). Tests for the visual analysis of response-guided multiple-baseline data. The Journal of Experimental Education, 75, 66-81.
10. Ferron, J., & Onghena, P. (1996). The power of randomization tests for single-case phase designs. The Journal of Experimental Education, 64, 231-239.
11. Ferron, J.,&Sentovich, C. (2002). Statistical power of randomization tests used with multiple-baseline designs. The Journal of Experimental Education, 70, 165-178.
12. Ferron, J., & Ware, W. (1995). Analyzing single-case data: The power of randomization tests. The Journal of Experimental Education, 63, 167-178.
13. Gorman, B. S., & Allison, D. B. (1996). Statistical alternatives for single-case designs. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single-case research (pp. 159-214). Mahwah, NJ: Erlbaum.
14. Greenwood, K. M., & Matyas, T. A. (1990). Problems with application of interrupted time series analysis for brief single-subject data. Behavioral Assessment, 12, 355-370.
15. Hayes, A. F. (1996). Permutation test is not distribution-free: Testing H0 = 0. Psychological Methods, 1, 184-198.
16. Huitema, B. E. (1985). Autocorrelation in behavior analysis: A myth. Behavioral Assessment, 7, 107-118.
17. Huitema, B. E.,&McKean, J.W. (1991). Autocorrelation estimation and inference with small samples. Psychological Bulletin, 110, 291-304.
18. Huitema, B. E., & McKean, J. W. (1998). Irrelevant autocorrelation in least squares intervention models. Psychological Methods, 3, 104-116.
19. Huitema, B. E., McKean, J. W., & McKnight, S. (1999). Autocorrelation effects on least-squares intervention analysis of short time series. Educational and Psychological Measurement, 59, 767-786.
20. Jones, R. R., Weinrott, M. R., & Vaught, R. S. (1978). Effects of serial dependency on the agreement between visual and statistical inference. Journal of Applied Behavior Analysis, 11, 277-283.
21. Kazdin, A. (1980). Obstacles in using randomization tests in single-case experimentation. Journal of Educational Statistics, 5, 253-260.
22. Kratochwill, T. R., & Levin, J. R. (1980). On the applicability of various data analysis procedures to the simultaneous and alternating treatment designs in behavior therapy research. Behavioral Assessment, 2, 353-360.
23. Lall, V. F., & Levin, J. R. (2004). An empirical investigation of the statistical properties of generalized single-case randomization tests. Journal of School Psychology, 42, 61-86.
24. Levin, J. R., Marascuilo, L. A., & Hubert, L. J. (1978). N = nonparametric randomization tests. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change (pp. 167-196). New York: Academic Press.
25. Levin, J. R., &Wampold, B. E. (1999). Generalized single-case randomization tests: Flexible analyses for a variety of situations. School Psychology Quarterly, 14, 59-93.
26. Manolov, R., & Solanas, A. (2009). Problems of the randomization test for AB designs. Psicoĺogica, 30, 137-154.
27. Marascuilo, L. A., & Busk, P. L. (1988). Combining statistics for multiple-baseline AB and replicated ABAB designs across subjects. Behavioral Assessment, 10, 1-28.
28. Matyas, T. A., & Greenwood, K. M. (1990). Visual analysis for single-case time series: effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavior Analysis, 23, 341-351.
29. Matyas, T. A., & Greenwood, K. M. (1991). Problems in the estimation of autocorrelation in brief time series and some implications for behavioral data. Behavioral Assessment, 13, 137-157.
30. Onghena, P. (1992). Randomization tests for extensions and variations of ABAB single-case experimental designs: A rejoinder. Behavioral Assessment, 14, 153-171.
31. Onghena, P.,&Edgington, E. (1994). Randomization tests for restricted alternating treatments designs. Behaviour Research and Therapy, 32, 783-786.
32. Parker, R. I. (2006). Increased reliability for single-case research results: Is bootstrap the answer? Behavior Therapy, 37, 326-338.
33. Parker, R. I., & Brossart, D. F. (2003). Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy, 34, 189-211.
34. Parsonson, B. S., & Baer, D. M. (1986). The graphic analysis of data. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 157-186). New York: Plenum Press.
35. Robey, R. R., & Barcikowski, R. S. (1992). Type I error and the number of iterations in Monte Carlo studies of robustness. British Journal of Mathematical and Statistical Psychology, 45, 283-288.
36. Sierra, V., Quera, V., & Solanas, A. (2000). Autocorrelation effect on Type I error rate of Revusky's Rn test: A Monte Carlo study. Psicoĺogica, 21, 91-114.
37. Sierra, V., Solanas, A., & Quera, V. (2005). Randomization tests for systematic single-case designs are not always appropriate. The Journal of Experimental Education, 73, 140-160.
38. Toothaker, L. E., Banz, M., Noble, C., Camp, J., & Davis, D. (1983). N = 1 designs: The failure of ANOVA-based tests. Journal of Educational Statistics, 4, 289-309.
39. Wampold, B. E., & Furlong, M. J. (1981). Randomization tests in single-subject designs: Illustrative examples. Journal of Behavioral Assessment, 3, 329-341.
40. Wampold, B. E., & Worsham, N. L. (1986). Randomization tests for multiple-baseline designs. Behavioral Assessment, 8, 135-143.