Examining Estimates of Effect Using Non-Overlap of All Pairs in Multiple Baseline Studies of Academic Intervention

Journal of Behavioral Education

Volumn 21, Issue 3, 2012, Pages 203-216

  Petersen Brown, Shawna ^a   Karich, Abbey C ^a   Symons, Frank J ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Effect size; Meta analysis; Multiple baseline design; Single subject

Indexed keywords

EID: 84865423513     PISSN: 10530819     EISSN: 15733513     Source Type: Journal    
DOI: 10.1007/s10864-012-9154-0     Document Type: Article

References (109)

1. *Alber-Morgan, S. R., Matheson Ramp, E., Anderson, L. L., & Martin, C. M. (2007). Effects of repeated readings, error correction, and performance feedback on the fluency and comprehension of middle school students with behavior problems. The Journal of Special Education, 41, 17-30.
2. Analytical Perspectives (2010) Budget of the United States Government. Retrieved from http://www. whitehouse. gov/sites/default/files/omb/budget/fy2012/assets/spec. pdf.
3. Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91-97.
4. *Bergeron, J. P., Lederberg, A. R., & Connor, C. M. D. (2009). Building the alphabetic principle in young children who are deaf or hard of hearing. Volta, 109, 87-119.
5. *Beveridge, B. R., Weber, K. P., Derby, K. M., & McLaughlin, T. (2005). The effects of a math racetrack with two elementary students with learning disabilities. International Journal of Special Education, 20, 58-65.
6. *Binger, C., Maguire-Marshall, M., & Kent-Walsh, J. (2011). Using aided AAC models, recasts, and contrastive targets to teach grammatical morphemes to children who use AAC. Journal of Speech, Language, and Hearing Research, 54, 160-176.
7. *Blankenship, T. L., Ayres, K. M., & Langone, J. (2005). Effects of computer-based cognitive mapping on reading comprehension for students with emotional behavior disorders. Journal of Special Education Technology, 20, 15-23.
8. *Bliss, S., Skinner, C., & Adams, R. (2006). Enhancing an English language learning fifth-grade student's sight-word reading with a time-delay taped-words intervention. School Psychology Review, 35, 663-670.
9. *Bonfiglio, C. M., Daly, E. J., Persampieri, M., & Andersen, M. (2006). An experimental analysis of the effects of reading interventions in a small group reading instruction context. Journal of Behavioral Education, 15, 92-108.
10. *Bouck, E. C., Bassette, L., Taber-Doughty, T., Flanagan, S. M., & Szwed, K. (2009). Pentop computers as tools for teaching multiplication to students with mild intellectual disabilities. Education and Training in Developmental Disabilities, 44, 367-380.
11. *Boulineau, T., Fore, C., Hagan-Burke, S., & Burke, M. D. (2004). Use of story-mapping to increase the story-grammar text comprehension of elementary students with learning disabilities. Learning Disability Quarterly, 27, 105-121.
12. Bramlett, R., Cates, G. L., Savina, E., & Lauinger, B. (2010). Assessing effectiveness and efficiency of academic interventions in school psychology journals: 1995-2005. Psychology in the Schools, 47, 114-125.
13. Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30, 531-563.
14. *Burns, M. K. (2005). Using incremental rehearsal to increase fluency of single-digit multiplication facts with children identified as learning disabled in mathematics computation. Education and Treatment of Children, 28, 237-249.
15. *Burns, M. K., Ganuza, Z. M., & London, R. M. (2009). Brief experimental analysis of written letter formation: Single-case demonstration. Journal of Behavioral Education, 18, 20-34.
16. *Carlson, B., McLaughlin, T., Derby, K. M., & Blecher, J. (2009). Teaching preschool children with autism and developmental delays to write. Electronic Journal of Research in Educational Psychology, 7, 225-238.
17. *Cieslar, W., McLaughlin, T., & Derby, K. M. (2008). Effects of the copy, cover, and compare procedure on the math and spelling performance of a high school student with behavioral disorder: A case report. Preventing School Failure, 52(4), 45-52.
18. *Clarfield, J., & Stoner, G. (2005). The effects of computerized reading instruction on the academic performance of students identified with ADHD. School Psychology Review, 34, 246-255.
19. *Cohen, E. J., & Brady, M. P. (2011). Acquisition and generalization of word decoding in students with reading disabilities by integrating vowel pattern analysis and Children's literature. Education and Treatment of Children, 34, 81-113.
20. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
21. Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis. New York: Russell Sage Foundation.
22. *Crabtree, T., Alber-Morgan, S. R., & Konrad, M. (2010). The effects of self-monitoring of story elements on the reading comprehension of high school seniors with learning disabilities. Education and Treatment of Children, 33, 187-203.
23. *Daly, E. J., Garbacz, S. A., Olson, S. C., Persampieri, M., & Ni, H. (2006). Improving oral reading fluency by influencing students' choice of instructional procedures: An experimental analysis with two students with behavioral disorders. Behavioral Interventions, 21(1), 13-30.
24. *Daly, E. J., Johnson, S., & LeClair, C. (2009). An experimental analysis of phoneme blending and segmenting skills. Journal of Behavioral Education, 18, 5-19.
25. *De La Paz, S. (2001). Teaching writing to students with attention deficit disorders and specific language impairment. The Journal of Educational Research, 95, 37-47.
26. *Dimling, L. M. (2010). Conceptually based vocabulary intervention: Second graders' development of vocabulary words. American Annals of the Deaf, 155, 425-448.
27. *Dowrick, P. W., Kim-Rupnow, W. S., & Power, T. J. (2006). Video feedforward for reading. The Journal of Special Education, 39, 194-207.
28. *Dufrene, B. A., Reisener, C. D., Olmi, D. J., Zoder-Martell, K., McNutt, M. R., & Horn, D. R. (2010). Peer tutoring for reading fluency as a feasible and effective alternative in response to intervention systems. Journal of Behavioral Education, 19, 1-18.
29. *Duhon, G. J., House, S. E., Poncy, B. C., Hastings, K. W., & McClurg, S. C. (2010). An examination of two techniques for promoting response generalization of early literacy skills. Journal of Behavioral Education, 19, 62-75.
30. *Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27, 861-874.
31. *Fevre, D. M., Moore, D. W., & Wilkinson, I. A. G. (2003). Tape assisted reciprocal teaching: Cognitive bootstrapping for poor decoders. British Journal of Educational Psychology, 73, 37-58.
32. *Fritschmann, S., Deshler, D. D., & Schumaker, B. (2007). The effects of instruction in an inference strategy on the reading comprehension skills of adolescents with disabilities. Learning Disability Quarterly, 30, 245-262.
33. *Fung, I. Y. Y., Wilkinson, I. A. G., & Moore, D. W. (2003). L1-assisted reciprocal teaching to improve ESL students' comprehension of English expository text. Learning and Instruction, 13, 1-31.
34. *Ganz, J. B., & Flores, M. M. (2009). The effectiveness of direct instruction for teaching language to children with autism spectrum disorders: Identifying materials. Journal of Autism and Developmental Disorders, 39, 75-83.
35. *Glover, P., McLaughlin, T., Derby, K. M., & Gower, J. (2010). Using a direct instruction flashcard system with two students with learning disabilities. Electronic Journal of Research in Educational Psychology, 8, 457-472.
36. *Gyovai, L. K., Cartledge, G., Kourea, L., Yurick, A., & Gibson, L. (2009). Early reading intervention: Responding to the learning needs of young at-risk English language learners. Learning Disability Quarterly, 32, 143-162.
37. Hammond, D., & Gast, D. L. (2010). Descriptive analysis of single subject research designs: 1983-2007. Education and Training in Autism and Developmental Disabilities, 45, 187-202.
38. *Hanser, G. A., & Erickson, K. A. (2007). Integrated word identification and communication instruction for students with complex communication needs. Focus on Autism and Other Developmental Disabilities, 22, 268-278.
39. *Harris, P. J., Oakes, W. P., Lane, K. L., & Rutherford, R. (2009). Improving the early literacy skills of students at risk for internalizing or externalizing behaviors with limited reading skills. Behavioral Disorders, 34, 72-90.
40. *Hindin, A., & Paratore, J. R. (2007). Supporting young children's literacy learning through home-school partnerships: The effectiveness of a home repeated-reading intervention. Journal of Literacy Research, 39, 307-333.
41. *Hines, S. J. (2009). The effectiveness of a color coded, onset rime decoding intervention with first Grade students at serious risk for reading disabilities. Learning Disabilities Research & Practice, 24, 21-32.
42. *Hitchcock, C. H., Prater, M. A., & Dowrick, P. W. (2004). Reading comprehension and fluency: Examining the effects of tutoring and video self-modeling on first-grade students with reading difficulties. Learning Disability Quarterly, 27, 89-103.
43. *Jacobson, L. T., & Reid, R. (2010). Improving the persuasive essay writing of high school students with ADHD. Exceptional Children, 76, 157-174.
44. *Jitendra, A. K., Edwards, L. L., Starosta, K., Sacks, G., Jacobson, L. A., & Choutka, C. M. (2004). Early reading instruction for children with reading difficulties. Journal of Learning Disabilities, 37, 421-439.
45. *Jones, K. M., Wickstrom, K. F., Noltemeyer, A. L., Brown, S. M., Schuka, J. R., & Therrien, W. J. (2009). An experimental analysis of reading fluency. Journal of Behavioral Education, 18, 35-55.
46. *Joseph, L. M., & Hunter, A. D. (2001). Differential application of a cue card strategy for solving fraction problems: Exploring instructional utility of the cognitive assessment system. Child Study Journal, 31, 123-136.
47. *Joseph, L. M., & Orlins, A. (2005). Multiple uses of a word study technique. Reading Improvement, 42, 73-79.
48. Kavale, K. A., & Forness, S. R. (2000). Policy decisions in special education: The role of meta-analysis. In R. Gersten, E. P. Schiller, & S. Vaughn (Eds.), Contemporary special education research: Syntheses of the knowledge base on critical instructional issues (pp. 281-326). Mahwah, NJ: Erlbaum.
49. *Kourea, L., Cartledge, G., & Musti-Rao, S. (2007). Improving the reading skills of urban elementary students through total class peer tutoring. Remedial and Special Education, 28, 95-107.
50. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case design technical documentation. Retrieved from What Works Clearinghouse website: http://ies. ed. gov/ncee/wwc/pdf/wwc_scd. pdf.
51. Kratochwill, T. R., & Shernoff, E. S. (2003). Evidence-based practice: Promoting evidence-based interventions in school psychology. School Psychology Quarterly, 18, 389-408.
52. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
53. *Lane, K. L., Graham, S., Harris, K. R., Little, M. A., Sandmel, K., & Brindle, M. (2010). Story writing: The effects of self-regulated strategy development for second-grade students with writing and behavioral difficulties. Journal of Special Education, 44, 107-128.
54. *Lane, K. L., Harris, K. R., Graham, S., Weisenbach, J. L., Brindle, M., & Morphy, P. (2008). The effects of self-regulated strategy development on the writing performance of second-grade students with behavioral and writing difficulties. The Journal of Special Education, 41, 234-253.
55. *Lane, K. L., Little, M. A., Redding-Rhodes, J., Phillips, A., & Welsh, M. T. (2007). Outcomes of a teacher-led reading intervention for elementary students at risk for behavioral disorders. Exceptional Children, 74, 47-70.
56. *Lawson, T. R., & Greer, R. D. (2006). Teaching the function of writing to middle school students with academic delays. Journal of Early and Intensive Behavior Intervention, 3, 151-170.
57. *Lee, Y., & Vail, C. O. (2005). Computer-based reading instruction for young children with disabilities. Journal of Special Education Technology, 20, 5-18.
58. *Li, D. (2007). Story mapping and its effects on the writing fluency and word diversity of students with learning disabilities. Learning Disabilities: A Contemporary Journal, 5(1), 77-93.
59. *Lovelace, S., & Stewart, S. R. (2007). Increasing print awareness in preschoolers with language impairment using non-evocative print referencing. Language, Speech, and Hearing Services in Schools, 38, 16-30.
60. Ma, H. H. (2006). An alternative method for quantitative synthesis of single-subject researches. Behavior Modification, 30, 598-617.
61. *Marvin, K. L., Rapp, J. T., Stenske, M. T., Rojas, N. R., Swanson, G. J., & Bartlett, S. M. (2010). Response repetition as an error-correction procedure for sight-word reading: A replication and extension. Behavioral Interventions, 25, 109-127.
62. *Mason, L. H., Kubina, R. M, Jr, Valasa, L. L., & Cramer, A. M. (2010). Evaluating effective writing instruction for adolescent students in an emotional and behavior support setting. Behavioral Disorders, 35, 140-156.
63. *Mayfield, K. H., & Vollmer, T. R. (2007). Teaching math skills to at-risk students using home-based peer tutoring. Journal of Applied Behavior Analysis, 40, 223-237.
64. *McCallum, R. S., Fearrington, J. Y., & Skinner, C. H. (2011). Increasing math assignment completion using solution-focused brief counseling. Education and Treatment of Children, 34, 61-80.
65. *McCurdy, M., Daly, E., Gortmaker, V., Bonfiglio, C., & Persampieri, M. (2007). Use of brief instructional trials to identify small group reading strategies: A two experiment study. Journal of Behavioral Education, 16, 7-26.
66. *McCurdy, M., Skinner, C., Watson, S., & Shriver, M. (2008). Examining the effects of a comprehensive writing program on the writing performance of middle school students with learning disabilities in written expression. School Psychology Quarterly, 23, 571-586.
67. McNeily, B. J., & Hanley, J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.
68. *Mesmer, E. M., Duhon, G. J., Hogan, K., Newry, B., Hommema, S., Fletcher, C., et al. (2010). Generalization of sight word accuracy using a common stimulus procedure: A preliminary investigation. Journal of Behavioral Education, 19, 47-61.
69. *Miao, Y., Darch, C., & Rabren, K. (2002). Use of precorrection strategies to enhance reading performance of students with learning and behavior problems. Journal of Instructional Psychology, 29, 162-174.
70. *Mims, P. J., Browder, D. M., Baker, J. N., Lee, A., & Spooner, F. (2009). Increasing comprehension of students with significant intellectual disabilities and visual impairments during shared stories. Education and Training in Developmental Disabilities, 44, 409-420.
71. *Morgan, L., & Goldstein, H. (2004). Teaching mothers of low socioeconomic status to use decontextualized language during storybook reading. Journal of Early Intervention, 26, 235-252.
72. Muller, M. P., Tomlinson, G., Marrie, T. J., Tang, P., McGreer, A., Low, D. E., et al. (2005). Can routine laboratory tests discriminate between severe acute respiratory syndrome and other causes of community-acquired pneumonia? Clinical Infectious Diseases, 40, 1079-1086.
73. *Musti-Rao, S., & Cartledge, G. (2007). Effects of a supplemental early reading intervention with at-risk urban learners. Topics in Early Childhood Special Education, 27, 70-85.
74. *Musti-Rao, S., Hawkins, R. O., & Barkley, E. A. (2009). Effects of repeated readings on the oral reading fluency of urban fourth-grade students: Implications for practice. Preventing School Failure, 54(1), 12-23.
75. No Child Left Behind Act of 2001, Pub. L. No. 107-110, 115 Stat. 1425 (2001).
76. *Noell, G. H., Freeland, J. T., Witt, J. C., & Gansle, K. A. (2001). Using brief assessments to identify effective interventions for individual students. Journal of School Psychology, 39, 335-355.
77. *Oddo, M., Barnett, D. W., Hawkins, R. O., & Musti-Rao, S. (2010). Reciprocal peer tutoring and repeated reading: Increasing practicality using student groups. Psychology in the Schools, 47, 842-858.
78. *Ortiz Lienemann, T., Graham, S., Leader-Janssen, B., & Reid, R. (2006). Improving the writing performance of struggling writers in second grade. The Journal of Special Education, 40, 66-78.
79. Parker, R. I., Brossart, D. F., Callicott, K. J., Long, J. R., Garcia de Alba, R., Baugh, F. G., et al. (2005). Effect sizes in single case research: How large is large? School Psychology Review, 34, 124-136.
80. Parker, R. I., & Brossart, D. F. (2003). Evaluating single-case data: A comparison of several methods. Behavior Therapy, 34, 189-211.
81. Parker, R. I., & Hagan-Burke, S. (2007). Useful effect size interpretations for single case research. Behavior Therapy, 38, 95-105.
82. Parker, R. I., Hagan-Burke, S., & Vannest, K. (2007). Percentage of all non-overlapping data (PAND). The Journal of Special Education, 40, 194-204.
83. Parker, R. I., & Vannest, K. (2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40, 357-367.
84. Parsonson, B. S., & Baer, D. M. (1978). The analysis and presentation of graphic data. In T. R. Kratochwill (Ed.), Single subject research: Strategies for evaluating change (pp. 101-165). Orlando, FL: Academic Press, Inc.
85. *Persampieri, M., Gortmaker, V., Daly, E. J, I. I. I., Sheridan, S. M., & McCurdy, M. (2006). Promoting parent use of empirically supported reading interventions: Two experimental investigations of child outcomes. Behavioral Interventions, 21, 31-57.
86. *Petursdottir, A. L., McMaster, K., McComas, J. J., Bradfield, T., Braganza, V., Koch-McDonald, J., et al. (2009). Brief experimental analysis of early reading interventions. Journal of School Psychology, 47, 215-243.
87. *Poncy, B. C., & Skinner, C. H. (2011). Enhancing first-grade students' addition-fact fluency using classwide cover, copy, and compare, a sprint, and group rewards. Journal of Applied School Psychology, 27, 1-20.
88. *Poncy, B. C., Skinner, C. H., & Axtell, P. K. (2010). An investigation of detect, practice, and repair to remedy math fact deficits in a group of third grade students. Psychology in the Schools, 47, 342-353.
89. *Pullen, P. C., Lane, H. B., Lloyd, J. W., Nowak, R., & Ryals, J. (2005). Effects of explicit instruction on decoding of struggling first grade students: A data-based case study. Education & Treatment of Children, 28, 63-76.
90. *Resetar, J. L., Noell, G. H., & Pellegrin, A. L. (2006). Teaching parents to use research-supported systematic strategies to tutor their children in reading. School Psychology Quarterly, 21, 241-261.
91. *Ridge, A. D., & Skinner, C. H. (2011). Using the TELLS prereading procedure to enhance comprehension levels and rates in secondary students. Psychology in the Schools, 48, 46-58.
92. *Saddler, B. (2006). Increasing story-writing ability through self-regulated strategy development: Effects on young writers with learning disabilities. Learning Disability Quarterly, 29, 291-305.
93. Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research. Remedial and Special Education, 8, 24.
94. *Simon, R., & Hanrahan, J. (2004). An evaluation of the touch math method for teaching addition to students with learning disabilities in mathematics. European Journal of Special Needs Education, 19, 191-209.
95. *Spooner, F., Rivera, C. J., Browder, D. M., Baker, J. N., & Salas, S. (2009). Teaching emergent literacy skills using cultural contextual story-based lessons. Research and Practice for Persons with Severe Disabilities, 34, 102-112.
96. *Stagliano, C., & Boon, R. T. (2009). The effects of a story-mapping procedure to improve the comprehension skills of expository text passages for elementary students with learning disabilities. Learning Disabilities: A Contemporary Journal, 7(2), 35-58.
97. *Strong, A. C., Wehby, J. H., Falk, K. B., & Lane, K. L. (2004). The impact of a structured reading curriculum and repeated reading on the performance of junior high students with emotional and behavioral disorders. School Psychology Review, 33, 561-582.
98. Swanson, H. L., Hoskyn, M., & Lee, C. (1999). Interventions for students with learning disabilities: A meta-analysis of treatment outcomes. New York: The Guilford Press.
99. Swets, J. A., Dawes, R. M., & Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1, 1-26.
100. *Test, D. W., & Ellis, M. F. (2005). The effects of LAP fractions on addition and subtraction of fractions with students with mild disabilities. Education and Treatment of Children, 28, 11-25.
101. *Valleley, R. J., & Shriver, M. D. (2003). An examination of the effects of repeated readings with secondary students. Journal of Behavioral Education, 12, 55-76.
102. van *Norman, R. K., & Wood, C. L. (2008). Effects of prerecorded sight words on the accuracy of tutor feedback. Remedial and Special Education, 29, 96-107.
103. *Viel Ruma, K., Houchins, D. E., Jolivette, K., Fredrick, L. D., & Gama, R. (2010). Direct instruction in written expression: The effects on English speakers and English language learners with disabilities. Learning Disabilities Research & Practice, 25, 97-108.
104. *Walker, B., Shippen, M. E., Alberto, P., Houchins, D. E., & Cihak, D. F. (2005). Using the expressive writing program to improve the writing skills of high school students with learning disabilities. Learning Disabilities Research & Practice, 20, 175-183.
105. *Whalon, K., & Hanline, M. F. (2008). Effects of a reciprocal questioning intervention on the question generation and responding of children with autism spectrum disorder. Education and Training in Developmental Disabilities, 43, 367-387.
106. *Windingstad, S., Skinner, C. H., Rowland, E., Cardin, E., & Fearrington, J. Y. (2009). Extending research on a math fluency building intervention: Applying taped problems in a second-grade classroom. Journal of Applied School Psychology, 25, 364-381.
107. *Xin, Y. P., Wiles, B., & Lin, Y. Y. (2008). Teaching conceptual model-based word problem story grammar to enhance mathematics problem solving. The Journal of Special Education, 42, 163-178.
108. *Ziolkowski, R. A., & Goldstein, H. (2008). Effects of an embedded phonological awareness intervention during repeated book reading on preschool children with language delays. Journal of Early Intervention, 31, 67-90.
109. Zweig, M. H., & Campbell, G. (1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39, 561-577.