Is Performance Feedback for Educators an Evidence-Based Practice? A Systematic Review and Evaluation Based on Single-Case Research

Exceptional Children

Volumn 81, Issue 2, 2015, Pages 227-246

  Fallon, Lindsay M ^a   Collier Meek, Melissa A ^b   Maggin, Daniel M ^c   Sanetti, Lisa M H ^d   Johnson, Austin H ^d  

^a BRIDGEWATER STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MASSACHUSETTS BOSTON   (United States)

^c UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^d UNIVERSITY OF CONNECTICUT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EVIDENCE BASED PRACTICE CENTER; HUMAN; PRACTICE GUIDELINE; SYSTEMATIC REVIEW;

EID: 84993812311     PISSN: 00144029     EISSN: None     Source Type: Journal    
DOI: 10.1177/0014402914551738     Document Type: Article

References (68)

1. ∗Auld R. G. Belfiore P. J. Scheeler M. (2010). Increasing pre-service teachers- use of differential reinforcement: Effects of performance feedback on consequences for student behavior. Journal of Behavioral Education, 19, 169-183. doi:10.1007/s10864-010-9107-4
2. ∗Barton E. E. Wolery M. (2007). Evaluation of e-mail feedback on the verbal behaviors of pre-service teachers. Journal of Early Intervention, 30, 55-72. doi:10.1177/105381510703000105
3. Biggs B. K. Vernberg E. M. Twemlow S. W. Fonagy P. Dill E. J. (2008). Teacher adherence and its relation to teacher attitudes and student outcomes in an elementary school-based violence prevention program. School Psychology Review, 37, 533-549.
4. ∗Bradley T. A. (1999). Increasing integrity of classroom interventions: A comparison of performance feedback and social support. Retrieved from ProQuest Dissertations and Theses. (UMI No. 9946494)
5. Burns M. K. Peter R. Noell G. H. (2008). Using performance feedback to enhance implementation fidelity of the problem-solving team process. Journal of School Psychology, 46, 537-550. doi:10.1016/j.jsp.2008.04.001
6. Busk P. L. Serlin R. C. (1992). Meta-analysis for single-case research. In KratochwillT. R., LevinJ. R.,(Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187-212). Hillsdale, NJ: Lawrence Erlbaum.
7. Cochrane W. S. Laux J. M. (2008). A survey investigating school psychologists- measurement of treatment integrity in school-based interventions and their beliefs about its importance. Psychology in the Schools, 46, 499-507. doi:10.1002/pits.20319
8. ∗Codding R. S. Livanis A. Pace G. M. Vaca L. (2008). Using performance feedback to improve the integrity of classwide behavior plans: An investigation of observer reactivity. Journal of Applied Behavior Analysis, 41, 417-422. doi:10.1901/jaba.2008.41-417
9. ∗Codding R. S. Smyth C. (2008). Using performance feedback to decrease classroom transition time and examine collateral effects on academic engagement. Journal of Educational and Psychological Consultation, 18, 325-345. doi:10.1080/10474410802463312
10. Connell J. E. (2010). Applications of performance feedback: Consultation in the home. International Journal of. Behavioral Consultation and Therapy, 6, 17-23.
11. Collier-Meek M. A. Fallon L. M. Sanetti L. M. H. Maggin D. (2013). Focus on implementation: Strategies for problem-solving teams to assess and promote treatment fidelity. TEACHING Exceptional Children, 45, 52-59.
12. Cossairt A. Hall R. V. Hopkins B. L. (1973). The effects of experimenter-s instructions, feedback, and praise on teacher praise and student attending behavior. Journal of Applied Behavior Analysis, 6, 89-100. doi:10.1901/jaba.1973.6-89
13. ∗DiGennaro F. D. Martens B. K. Kleinmann A. E. (2007). A comparison of performance feedback procedures on teachers- treatment implementation integrity and students- inappropriate behavior in special education classrooms. Journal of Applied Behavior Analysis, 40, 447-461. doi:10.1901/jaba.2007.40-447
14. DiGennaro F. D. Martens B. K. McIntyre L. L. (2005). Increasing treatment integrity through negative reinforcement: Effects on teacher and student behavior. School Psychology Review, 34, 220-231.
15. Downs A. Downs R. Rau K. (2008). Effects of training and feedback on discrete trial teaching skills and student performance. Research in Developmental Disabilities: A Multidisciplinary Journal, 29, 235-246. doi:10.1016/j.ridd.2007.05.001
16. ∗Duchaine E. L. Jolivette K. Fredrick L. D. (2011). The effect of teacher coaching with performance feedback on behavior-specific praise in inclusion classrooms. Education and Treatment of Children, 34, 209-227. doi:10.1353/etc.2011.0009
17. ∗Duhon G. J. Mesmer E. M. Gregerson L. Witt J. C. (2009). Effects of public feedback during RTI team meetings on teacher implementation integrity and student academic performance. Journal of School Psychology, 47, 19-37. doi:10.1016/j.jsp.2008.09.002
18. Fuchs D. Fuchs L. S. (2006). Introduction to responsiveness-to-intervention: What, why, and how valid is it? Reading Research Quarterly, 41, 92-99.
19. Geomatrix. (2010). XYit Image Digitizer [Computer software]. North Lincolnshire, England: Geomatrix Solutions and Applications.
20. ∗Gilberston D. Witt J. C. Singletary L. L. VanDerHeyden A. (2007). Supporting teacher use of interventions: Effects of response dependent performance feedback on teacher implementation of a math intervention. Journal of Behavior Education, 16, 311-326. doi:10.1007/s10864-007-9043-0
21. Gresham F. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18, 37-50.
22. ∗Hall L. J. Macvean M. L. (1997). Increases in communicative behaviours of students with cerebral palsy as a result of feedback to, and the selection of goals by, paraprofessionals. Behaviour Change, 14, 174-184.
23. ∗Hawkins S. Heflin L. J. (2011). Increasing secondary teachers- behavior-specific praise using a video self-modeling and visual performance feedback intervention. Journal of Positive Behavioral Interventions, 13, 97-108. doi:10.1177/1098300709358110
24. ∗Hemmeter M. L. Snyder P. Kinder K. Artman K. (2011). Impact of performance feedback delivered via electronic mail on preschool teachers- use of descriptive praise. Early Childhood Research Quarterly, 26, 96-109. doi:10.1016/j.ecresq.2010.05.004
25. Holm S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
26. Horner R. H. Carr E. G. Halle J. McGee G. Odom S. Wolery M. (2005). The use of single subject research to identify evidence-based practice in special education. Exceptional Children 71, 165-179.
27. Horner R. H. Sugai G. Anderson C. M. (2010). Examining the evidence base for school-wide positive behavior support. Focus on Exceptionality, 42(8), 1-14.
28. Individuals with Disabilities Education Act, 20 U.S.C. §§ 1400 et seq. (2006 & Supp. V. 2011).
29. ∗Ingham P. Greer R. D. (1992). Changes in student and teacher responses in observed and generalized settings as a function of supervisor observations. Journal of Applied Behavior Analysis, 25, 153-164. doi:10.1901/jaba.1992.25-153
30. Jenson W. R. Clark E. Kircher J. C. Kristjansson S. D. (2007). Statistical reform: Evidence-based practice, meta-analyses, and single-subject designs. Psychology in the Schools, 44, 483-493.
31. Kelleher C. Riley-Tillman T. C. Power T. J. (2008). Partnership-based consultation: Intervention design and its impact on treatment integrity. Journal of Educational and Psychological Consultation, 18, 294-324. doi:10.1080/10474410802491040
32. Kratochwill T. R. Hitchcock J. Horner R. H. Levin J. R. Odom S. L. Rindskopf D. M. Shadish W. R. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse web site: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
33. ∗Leblanc M. Ricciardi J. N. Luiselli J. K. (2005). Improving discrete trial instruction by paraprofessional staff through an abbreviated performance feedback intervention. Education and Treatment of Children, 28(1), 76-82. Retrieved from http://www.scopus.com
34. Maggin D. M. Briesch A. M. Chafouleas S. M. (2013). An application of the What Works Clearinghouse standards for evaluating single-subject research: Synthesis of the self-management literature-base. Remedial and Special Education. Advance online publication. doi:10.1177/0741932511435176
35. Maggin D. M. O-Keeffe B. V. Johnson A. H. (2011). A quantitative synthesis of methodology in the meta-analysis of single-subject research for students with disabilities: 1985-2009. Exceptionality, 19, 109-135. doi:10.1080/09362835.2011.565725
36. Maggin D. M. Swaminathan H. Rogers H. J. O-Keeffe B. V. Sugai G. Horner R. H. (2011). A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology, 49, 301-320. doi:10.1016/j.jsp.2011.03.004
37. ∗Martin E. J. (2001). Increasing treatment integrity of functional behavior assessment based support plans in general education settings through performance feedback. Retrieved from ProQuest Dissertations and Theses. (UMI No. 3024522)
38. Miller F. G. Lee D. L. (2013). Do functional behavioral assessments improve intervention effectiveness for students diagnosed with ADHD? A single-subject meta-analysis. Journal of Behavioral Education, 22, 253-282. doi:10.1007/s10864-013-9174-4
39. ∗Moore J. W. Edwards R. P. Sterling-Turner H. E. Riley J. DuBard M. McGeorge A. (2002). Teacher acquisition of functional analysis methodology. Journal of Applied Behavior Analysis, 35, 73-77. doi:10.1901/jaba.2002.35-73
40. ∗Mortenson B. P. Witt J. C. (1998). The use of weekly performance feedback to increase teacher implementation of a prereferral academic intervention. School Psychology Review, 27, 613-627.
41. ∗Myers D. Simonsen B. Sugai G. (2011). Increasing teachers- use of praise with a response to intervention approach. Education and Treatment of Children, 34, 35-59.
42. No Child Left Behind Act of 2001, 20 U.S.C. §§ 6301 et seq. (2006 & Supp. V. 2011)
43. Noell G. H. (2010). Empirical and pragmatic issues in assessing and supporting intervention implementation in school. In PeackockG. G., ErvinR. A., DalyE. J., MerrellK. W.,(Eds.), Practical handbook in school psychology (pp. 513-530). New York, NY: Guilford.
44. ∗Noell G. H. Duhon G. J. Gatti S. L. Connell J. E. (2002). Consultation, follow-up, and implementation of behavior management interventions in general education. School Psychology Review, 31, 217-234.
45. Noell G. H. Witt J. C. Gilbertson D. N. Ranier D. D. Freeland J. T. (1997). Increasing teacher intervention implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12, 77-88. doi:10.1037/h0088949
46. ∗Noell G. H. Witt J. C. LaFleur L. H. Mortenson B. P. Ranier D. D. LeVelle J. (2000). Increasing intervention implementation in general education following consultation: A comparison of two follow-up strategies. Journal of Applied Behavior Analysis, 33, 271-284. doi:10.1901/jaba.2000.33-271
47. Noell G. H. Witt J. C. Slider N. J. Connell J. E. Gatti S. L. Williams K. L. Duhon G. J. (2005). Treatment implementation following behavioral consultation in schools: A comparison of three follow-up strategies. School Psychology Review, 34, 87-106.
48. Parker R. I. Vannest K. J. Brown L. (2009). The improvement rate difference for single-case research. Exceptional Children, 75, 135-150.
49. ∗Pellecchia M. Connell J. E. Eisenhart D. Kane M. Schoener C. Turkel K. Mandell D. S. (2011). We-re all in this together now: Group performance feedback to increase classroom team data collection. Journal of School Psychology, 49, 411-431. doi:10.1016/j.jsp.2011.04.003
50. ∗Penton C. E. (1999). Intervention implementation and intervention outcomes for teenage mothers in school-based treatment for social and academic problems (Doctoral dissertation). Retrieved from ProQuest Dissertation and Theses. (UMI No. 9945732)
51. Reinke W. M. Lewis-Palmer T. Martin E. (2007). The effect of visual performance feedback on teacher behavior-specific praise. Behavior Modification, 31, 247-263.
52. ∗Reinke W. M. Lewis-Palmer T. Merrell K. (2008). The Classroom Check-Up: A classwide teacher consultation model for increasing praise and decreasing disruptive behavior. School Psychology Review, 37, 315-332.
53. ∗Rodriguez B. Loman S. L. Horner R. H. (2009). A preliminary analysis of the effects of coaching feedback on teacher implementation fidelity of First Step to Success. Behavior Analysis in Practice, 2, 11-21.
54. Sanetti L. M. H. Fallon L. M. Collier-Meek M. A. (2011). Treatment integrity assessment and intervention by school-based personnel: Practical applications from a preliminary study. School Psychology Forum, 5, 87-102.
55. Sanetti L. M. H. Fallon L. M. Collier-Meek M. A. (2013). Performance feedback provided by school personnel to increase teachers- intervention implementation: An evaluation of effectiveness, procedural integrity, and feasibility. Psychology in the Schools, 50, 134-150.
56. Sanetti L. M. H. DiGennaro Reed F. M. (2012). Barriers to implementing treatment integrity procedures in school psychology research: Survey of treatment outcome researchers. Assessment for Effective Intervention, 37, 195-202. doi:10.1177/1534508411432466
57. Sanetti L. M. H. Kratochwill T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38, 445-459.
58. Sanetti L. M. H. Kratochwill T. R. Long A. C. J. (2013). Applying adult behavior change theory to support mediator-based intervention implementation. School Psychology Quarterly, 28, 47-62. doi:10.1037/spq0000007
59. Sanetti L. M. H. Long A. C. J. Byron J. R. Kratochwill T. R. Collier-Meek M. A. (2013). Increasing teacher treatment integrity of behavior support plans through consultation and implementation planning. Manuscript submitted for publication.
60. ∗Sanetti L. M. H. Luiselli J. K. Handler M. W. (2007). Effects of verbal and graphic performance feedback on behavior support plan implementation in public elementary school. Behavior Modification, 31, 454-465. doi:10.1177/0145445506297583
61. Scruggs T. E. Mastropieri M. A. (1998). Summarizing single-subject research: Issues and applications. Behavior Modification, 22, 221-242.
62. Scruggs T. E. Mastropieri M. A. Casto G. (1987). The quantitative synthesis of single subject research: Methodology and validation. Remedial and Special Education, 8, 24-33. doi:10.1177/074193258700800206
63. Simonsen B. Myers D. DeLuca C. (2010). Providing teachers with training and performance feedback to increase use of three classroom management skills: Prompts, opportunities to respond, and reinforcement. Teacher Education in Special Education, 33, 300-318. doi:10.1177/0888406409359905
64. Solomon B. G. Klein S. A. Politylo B. C. (2012). The effect of performance feedback on teachers- treatment integrity: A meta-analysis of the single-case literature. School Psychology Review, 41, 160-175.
65. Sterling-Turner H. E. Watson T. S. Moore J. W. (2002). The effects of direct training and treatment integrity on treatment outcomes in school consultation. School Psychology Quarterly, 17, 47-77. doi:10.1521/scpq.17.1.47.19906
66. ∗Sutherland K. S. Wehby J. H. Copeland S. R. (2000). Effect of varying rates of behavior-specific praise on the on-task behavior of students with EBD. Journal of Emotional and Behavioral Disorders, 8, 2-8, 26. doi:10.1177/106342660000800101
67. ∗Thier K. S. (2003). Effects of preferred components of performance feedback interventions on treatment integrity scores of teacher implemented function-based student behavior support plans. Retrieved from ProQuest Dissertations and Theses. (UMI No. 3102192)
68. ∗Witt J. C. Noell G. H. LaFleur L. H. Mortenson B. P. (1997). Teacher use of interventions in general education settings: Measurement and analysis of the independent variable. Journal of Applied Behavior Analysis, 30, 693-696. doi:10.1901/jaba.1997.30-693