Nonparametric statistical tests for single-case systematic and randomized ABAB... AB and alternating treatment intervention designs: New developments, new directions

Journal of School Psychology

Volumn 50, Issue 5, 2012, Pages 599-624

  Levin, Joel R ^a   Ferron, John M ^b   Kratochwill, Thomas R ^c  

^a UNIVERSITY OF ARIZONA   (United States)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

ABAB.. AB and alternating treatment designs; Nonparametric permutation and randomization tests; Single case research; Statistical analysis

Indexed keywords

ARTICLE; CLINICAL TRIAL (TOPIC); HUMAN; METHODOLOGY; NONPARAMETRIC TEST; PSYCHOLOGY; RANDOMIZED CONTROLLED TRIAL (TOPIC); STATISTICAL ANALYSIS;

CLINICAL TRIALS AS TOPIC; DATA INTERPRETATION, STATISTICAL; HUMANS; PSYCHOLOGY, EDUCATIONAL; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; STATISTICS, NONPARAMETRIC;

EID: 84867209389     PISSN: 00224405     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsp.2012.05.001     Document Type: Article

References (77)

1. Austin J., Aluero A.M., Olson R. Prompting patron safety belt use at a restaurant. Journal of Applied Behavior Analysis 1998, 3:655-657.
2. Barcikowski R.S. Statistical power with group mean as the unit of analysis. Journal of Educational Statistics 1981, 6:267-285.
3. Barlow D.H., Nock M.K., Hersen M. Single-case experimental designs: Strategies for studying behavior change 2009, Allyn & Bacon, Boston. 3rd ed.
4. 2-change effect size indices for single-subject experimental designs. Evidence-Based Communication Assessment and Intervention 2008, 2(3):120-128.
5. Bradley J.V. Distribution-free statistical tests 1968, Prentice-Hall, Englewood Cliffs, NJ.
6. Busk P.L., Marascuilo L.A. Autocorrelation in single-subject research: A counterargument to the myth of no autocorrelation. Behavioral Assessment 1988, 10:229-242.
7. Busk P.L., Marascuilo L.A. Statistical analysis in single-case research: Issues, procedures, and recommendations, with applications to multiple behaviors. Single-case research design and analysis: New directions for psychology and education 1992, 159-185. Erlbaum, Hillsdale, NJ. T.R. Kratochwill, J.R. Levin (Eds.).
8. Codding R.S., Eckert T.L., Fanning E., Shiyko M., Solomon E. Comparing mathematics interventions: The effects of cover-copy-compare alone and combined with performance feedback on digits correct and incorrect. Journal of Behavioral Education 2007, 16:125-141.
9. Cohen J. Statistical power analysis for the behavioral sciences 1988, Erlbaum, Hillsdale, NJ. rev. ed.
10. Crosbie J. The inability of the binomial test to control Type I error with single-subject data. Behavioral Assessment 1987, 9:141-146.
11. Edgington E.S. Statistical inference from N=1 experiments. Journal of Psychology 1967, 65:195.
12. Edgington E.S. Randomization tests for one-subject operant experiments. Journal of Psychology 1975, 90:57-68.
13. Edgington E.S. Validity of randomization tests for one-subject experiments. Journal of Educational Statistics 1980, 5:235-251.
14. Edgington E.S. Nonparametric tests for single-case experiments. Single-case research design and analysis 1992, 133-157. Erlbaum, Hillsdale, NJ. T. Kratochwill, J. Levin (Eds.).
15. Edgington E.S., Onghena P. Randomization tests 2007, Chapman & Hall/CRC, Boca Raton, FL. 4th ed.
16. Ferron J. Reconsidering the use of the general linear model with single-case data. Behavior Research Methods, Instruments, & Computers 2002, 34:324-331.
17. Ferron J., Foster-Johnson L. Analyzing single-case data with visually guided randomization tests. Behavior Research Methods, Instruments, & Computers 1998, 30:698-706.
18. Ferron J., Foster-Johnson L., Kromrey J.D. The functioning of single-case randomization tests with and without random assignment. The Journal of Experimental Education 2003, 71:267-288.
19. Ferron J., Jones P.K. Tests for the visual analysis of response-guided multiple-baseline data. The Journal of Experimental Education 2006, 75:66-81.
20. Ferron J., Onghena P. The power of randomization tests for single-case phase designs. The Journal of Experimental Education 1996, 64:231-239.
21. Ferron J., Sentovich C. Statistical power of randomization tests used with multiple-baseline designs. The Journal of Experimental Education 2002, 70:165-178.
22. Ferron J.M., Ware W.B. Analyzing single-case data: The power of randomization tests. The Journal of Experimental Education 1995, 63:167-178.
23. Fisher R.A. The design of experiments 1935, Hafner, New York, NY.
24. Fisher W.W., Kelley M.E., Lomas J.E. Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs. Journal of Applied Behavior Analysis 2003, 36:387-406.
25. Design and analysis of single-case research 1997, Erlbaum, Mahwah, NJ. R.D. Franklin, D.B. Allison, B.S. Gorman (Eds.).
26. Gast D.L. Single subject research methodology in behavioral sciences 2010, Routledge, New York, NY.
27. Gilbertson D., Maxfield J., Hughes J. Evaluating responsiveness to intervention for English-language learners: A comparison of response modes on letter naming rates. Journal of Behavioral Education 2007, 16:259-279.
28. Glass G.V., Willson V.L., Gottman J.M. Design and analysis of time series experiments 1975, University of Colorado Press, Boulder, CO.
29. Hayes S.C. Single-case experimental designs and empirical clinical practice. Journal of Consulting and Clinical Psychology 1981, 49:193-211.
30. Higbee K.L. Some pseudo-limitations of mnemonics. Practical aspects of memory 1978, 147-154. Academic Press, New York, NY. M.M. Gruneberg, P.E. Morris, R.N. Sykes (Eds.).
31. Horner R.H., Carr E.G., Halle J., McGee G., Odom S., Wolery M. The use of single-subject research to identify evidence-based practice in special education. Exceptional Children 2005, 71:165-179.
32. Huitema B.E. Autocorrelation in behavioral research: Wherefore art thou?. Research methods in applied behavior analysis: Issues and advances 1986, 187-208. Plenum, New York, NY. A. Poling, R.W. Fuqua (Eds.).
33. Huitema B.E., McKean J.W. Autocorrelation estimation and inference with small samples. Psychological Bulletin 1991, 110:291-304.
34. Johnson J.M., Pennypacker H.S. Strategies and tactics of behavioral research 2009, Routledge, New York, NY. 3rd ed.
35. Jones R.R., Vaught R.S., Weinrott M. Time-series analysis in operant research. Journal of Applied Behavior Analysis 1977, 10:151-166.
36. Kazdin A.E. Single-case research designs: Methods for clinical and applied settings 2011, Oxford University Press, New York, NY. 2nd ed.
37. Kelly M.E., Fisher W.W., Lomas J.E., Sanders R.Q. Some effects of stimulant medication on response allocation: A double-blind analysis. Journal of Applied Behavior Analysis 2006, 39:243-247.
38. Koehler M.J., Levin J.R. Regulated randomization: A potentially sharper analytical tool for the multiple-baseline design. Psychological Methods 1998, 3:206-217.
39. Single subject research: Strategies for evaluating change 1978, Academic Press, New York, NY. T.R. Kratochwill (Ed.).
40. Kratochwill T.R. Single-case research design and analysis: An overview. Single-case research design and analysis: New directions for psychology and education 1992, 1-14. Erlbaum, Hillsdale, NJ. T.R. Kratochwill, J.R. Levin (Eds.).
41. Kratochwill T.R., Alden D.D., Dawson D., Panicucci C., Arntson P., McMurray N., Hempstead J., Levin J. A further consideration in the application of an analysis-of-variance model for the intrasubject replication design. Journal of Applied Behavior Analysis 1974, 7:629-633.
42. Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (in press). Single-case intervention research design standards: Remedial and Special Education.
43. Single-case research design and analysis: New directions for psychology and education 1992, Erlbaum, Hillsdale, NJ. T.R. Kratochwill, J.R. Levin (Eds.).
44. Kratochwill T.R., Levin J.R. Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods 2010, 15:122-144.
45. Kratochwill T.R., Levin J.R., Horner R.H., Swoboda C.M. Visual analysis of single-case intervention research: Conceptual and methodological considerations. Working Paper No. 2011-6 2011, Wisconsin Center for Education Research, Madison, Wisconsin.
46. Lehmann E.L. Nonparametrics: Statistical methods based on ranks 1975, Holden-Day, San Francisco.
47. Levin J.R. Some methodological and statistical "bugs" in research on children's learning. Cognitive learning and memory in children 1985, 205-233. Springer-Verlag, New York, NY. M. Pressley, C.J. Brainerd (Eds.).
48. Levin J.R. Single-case research design and analysis: Comments and concerns. Single-case research design and analysis: New directions for psychology and education 1992, 213-224. Erlbaum, Hillsdale, NJ. T.R. Kratochwill, J.R. Levin (Eds.).
49. Levin J.R. Crafting educational intervention research that's both credible and creditable. Educational Psychology Review 1994, 6:231-243.
50. Levin J.R. Random thoughts on the (in)credibility of educational-psychological intervention research. Educational Psychologist 2004, 39:173-184.
51. Levin J.R. Randomized classroom trials on trial. Empirical methods for evaluating educational interventions 2005, 3-27. Elsevier Academic Press, San Diego, CA. G.D. Phye, D.H. Robinson, J.R. Levin (Eds.).
52. Levin J.R. Randomization tests: Statistical tools for assessing the effects of educational interventions when resources are scarce. Real data analysis 2007, 115-123. Information Age, Greenwich, CT. S. Sawilowsky (Ed.).
53. Levin J.R., Lall V.F., Kratochwill T.R. Extensions of a versatile randomization test for assessing single-case intervention effects. Journal of School Psychology 2011, 49:55-79.
54. Levin J.R., Marascuilo L.A., Hubert L.J. N = nonparametric randomization tests. Single subject research: Strategies for evaluating change 1978, 167-196. Academic Press, New York, NY. T.R. Kratochwill (Ed.).
55. Levin J.R., Wampold B.E. Generalized single-case randomization tests: Flexible analyses for a variety of situations. School Psychology Quarterly 1999, 14:59-93.
56. Lewka A., Ysseldyke J. Dissertation research in school psychology: Changes in topics and methodology over the past 25years. Journal of Applied School Psychology 2010, 26:17-37.
57. Ludbrook J., Dudley H. Why permutation tests are superior to t and F tests in biomedical research. The American Statistician 1998, 52:127-132.
58. Manolov R., Solanas A. Problems of the randomization test for AB designs. Psicológica 2009, 30:137-154.
59. Manolov R., Solanas A., Bulté I., Onghena P. Data-division-specific robustness and power of randomization tests for ABAB designs. The Journal of Experimental Education 2010, 78:191-214.
60. Marascuilo L.A., Busk P.L. Combining statistics for multiple-baseline AB and replicated ABAB designs across subjects. Behavioral Assessment 1988, 10:1-28.
61. Marascuilo L.A., McSweeney M. Nonparametric and distribution-free methods for the social sciences 1977, Brooks/Cole, Monterey, CA.
62. Marriott F.H.C., Pope J.A. Bias in the estimation of autocorrelations. Biometrika 1954, 41:390-402.
63. Matyas T.A., Greenwood K.M. Serial dependency in single-case time series. Design and analysis of single-case research 1997, 215-243. Erlbaum, Mahwah, NY. R.D. Franklin, D.B. Allison, B.S. Gorman (Eds.).
64. Onghena P. Randomization tests for extensions and variations of ABAB single-case experimental designs: A rejoinder. Behavioral Assessment 1992, 14:153-171.
65. Parsonson B.S., Baer D.M. The graphic analysis of data. Research methods in applied behavior analysis: Issues and advances 1986, 157-186. Plenum, New York, NY. A. Poling, R.W. Fuqua (Eds.).
66. Parsonson B.S., Baer D.M. The visual analysis of data, and current research into the stimuli controlling it. Single-case research design and analysis: New directions for psychology and education 1992, 15-40. Erlbaum, Hillsdale, NJ. T.R. Kratochwill, J.R. Levin (Eds.).
67. Raudenbush S.W. Statistical analysis and optimal design for cluster randomized trials. Psychological Methods 1997, 2:173-185.
68. Riviello C., Beretvas S.N. Detecting lag-one autocorrelation in interrupted time-series experiments with small datasets. Journal of Modern Applied Statistical Methods 2009, 8:469-477.
69. Rogers L.A., Graham S. A meta-analysis of single subject design writing intervention research. Journal of Educational Psychology 2008, 100:879-906.
70. Schmidgall M., Joseph L.M. Comparison of phonic analysis and whole word-reading on first graders' cumulative words read and cumulative reading rate: An extension in examining instructional effectiveness and efficiency. Psychology in the Schools 2007, 44:319-332.
71. Shadish W.R., Sullivan K.J. Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods 2011, 43:971-980.
72. Sideridis G.D., Greenwood C.R. Is human behavior autocorrelated?: An empirical analysis. Journal of Behavioral Education 1997, 7:273-293.
73. Sierra V., Solanas A., Quera V. Randomization tests for systematic single-case designs are not always appropriate. The Journal of Experimental Education 2005, 73:140-160.
74. The Behavior Analyst Special Section on Statistical Inference 1999, 2:83-121.
75. Todman J.B., Dugard P. Single-case and small-n experimental designs: A practical guide to randomization tests 2001, Erlbaum, New York, NY.
76. Toothaker L.E., Banz M., Noble C., Camp J., Davis D. N=1 designs: The failure of ANOVA-based tests. Journal of Educational Statistics 1983, 8:289-309.
77. Wampold B.E., Worsham N.L. Randomization tests for multiple-baseline designs. Behavioral Assessment 1986, 8:135-143.