Behaviorally anchored rating scales: An application for evaluating teaching practice

Teaching and Teacher Education

Volumn 59, Issue , 2016, Pages 414-419

  Martin Raugh, Michelle ^a   Tannenbaum, Richard J ^a   Tocci, Cynthia M ^a   Reese, Clyde ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Appraisal; Behaviorally anchored rating scales (BARS); Evaluation; Framework for Teaching (FfT)

Indexed keywords

EID: 84982839370     PISSN: 0742051X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tate.2016.07.026     Document Type: Article

References (45)

1. Ball, D.L., Forzani, F.M., Teaching skillful teaching. Educational Leadership 68 (2010), 40–45.
2. Ball, D.L., Forzani, F., Identifying high-leverage practices for teacher education. Paper presented at the American educational research association annual meeting, Philadelphia, Pennsylvania, 2011.
3. Ball, D.L., Hill, H.C., Measuring teacher quality in practice. Gitomer, D.H., (eds.) Measurement issues and assessment for teaching quality, 2008, Sage Publications, Thousand Oaks, CA, 80–98.
4. Bernardin, H.J., Beatty, R.W., Performance appraisal: Assessing human behavior at work. 1984, Kent, Boston, MA.
5. Bernardin, H.J., Smith, P.C., A clarification of some issues regarding the development and use of behaviorally anchored ratings scales (BARS). Journal of Applied Psychology 66 (1981), 458–463.
6. Bill and Melinda Gates Foundation, Gathering feedback for teaching: Combining high- quality observations with student surveys and achievement gains. 2012, Author, Seattle, WA Retrieved from: http://www.metproject.org/downloads/MET_Gathering_Feedback_Research_Paper.pdf.
7. Bill & Melinda Gates Foundation, Learning about Teaching: Initial findings from the measures of effective teaching project. 2010 MET Project Research Paper.
8. Borman, W.C., Dunnette, M.D., Behavior-based versus trait-oriented performance ratings: An empirical study. Journal of Applied Psychology 60 (1975), 561–565.
9. Borman, W.C., Hough, L.M., Dunnette, M.D., Development of behaviorally based rating scales for evaluating the performance of US navy recruits. 1976, Personnel Decisions Research Inst., Minneapolis, MN.
10. Casabianca, J.M., Lockwood, J.R., McCaffrey, D.F., Trends in classroom observation scores. Educational and Psychological Measurement 75 (2015), 311–337.
11. Casabianca, J.M., McCaffrey, D.F., Gitomer, D., Bell, C., Hamre, B.K., Pianta, R.C., Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement 73 (2013), 757–783.
12. Cook, S.S., Improving the quality of student ratings of instruction: A look at two strategies. Research in Higher Education 30 (1989), 31–45.
13. Danielson, C., Enhancing professional practice: A framework for teaching. 1996, Association for Supervision and Curriculum Development, Alexandria, VA.
14. Danielson, C., Enhancing professional practice: A framework for teaching. 2007, Association for Supervision and Curriculum Development, Alexandria, VA.
15. Danielson, C., The 2013 framework for teaching evaluation instrument. 2013, The Charlotte Danielson Group.
16. Entwisle, D.R., Hayduk, L.A., Lasting effects of elementary school. Sociology of Education 61 (1988), 147–159.
17. Flanagan, J.C., The critical incident technique. Psychological Bulletin 51 (1954), 327–358.
18. Glazerman, S., Loeb, S., Goldhaber, D., Staiger, D., Raudenbush, S., Whitehurst, G., “Evaluating Teachers: The Important Role of Value-Added.” Brown Center on Education Policy. 2010, Brookings Institution, Washington, DC.
19. Goe, L., The link between teacher quality and student outcomes: A research synthesis. 2007, National Comprehensive Center for Teacher Quality Retrieved March 3, 2009 from http://www.tqsource.org/publications/LinkBetweenTQandStudentOutcomes.pdf.
20. Goe, L., Bell, C., Little, O., Approaches to evaluating teacher effectiveness: A research synthesis. 2008, National Comprehensive Center for Teacher Quality Retrieved March 3, 2009 from http://www.tqsource.org/publications/EvaluatingTeachEffectiveness.pdf.
21. Harari, O., Zedeck, S., Development of behaviorally anchored scales for the evaluation of faculty teaching. Journal of Applied Psychology 58 (1973), 261–265.
22. Harris, D., Rutledge, S., Models and predictors of teacher effectiveness: A comparison of research about teaching and other occupations. The Teachers College Record 112 (2010), 914–960.
23. Hartmann, D.P., Considerations in the choice of interobserver reliability measures. Journal of Applied Behavior Analysis 10 (1977), 103–116.
24. Hayes, J.R., Hatch, J.A., Issues in measuring reliability correlation versus percentage of agreement. Written Communication 16 (1999), 354–367.
25. Hill, H.C., Charalambous, C.Y., Kraft, M.A., When rater reliability is not enough: Teacher observation systems and a case for the generalizability study. Educational Researcher 41 (2012), 56–64.
26. Jamil, F.M., Sabol, T.J., Hamre, B.K., Pianta, R.C., Assessing teachers' skills in detecting and identifying effective interactions in the classroom. The Elementary School Journal 115 (2015), 407–432.
27. Jonsson, A., Svingby, G., The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review 2 (2007), 130–144.
28. Kingsbury, F.A., Analyzing ratings and training raters. Journal of Personnel Research 1 (1922), 377–383.
29. Landy, F.J., Farr, J.L., Performance rating. Psychological Bulletin 87 (1980), 72–107.
30. Landy, F.J., Guion, R.M., Development of scales for the measurement of work motivation. Organizational Behavior and Human Performance 5 (1970), 95–103.
31. Latham, G.P., Saari, L.M., Pursell, E.D., Campion, M.A., The situational interview. Journal of Applied Psychology 65 (1980), 422–427.
32. Little, O., Goe, L., Bell, C., A practical guide to evaluating teacher effectiveness. 2009, National Comprehensive Center for Teacher Quality Retrieved July 18, 2016 from: http://files.eric.ed.gov/fulltext/ED543776.pdf.
33. Martin-Raugh, M.P., Kell, H.J., Motowidlo, S.J., Prosocial knowledge mediates effects of agreeableness and emotional intelligence on prosocial behavior. Personality and Individual Differences 90 (2016), 41–49.
34. McCaffrey, D.F., Yuan, K., Savitsky, T.D., Lockwood, J.R., Edelen, M.O., Uncovering multivariate structure in classroom observations in the presence of rater errors. Educational Measurement: Issues and Practice 34 (2014), 34–46.
35. McCartney, K., Dearing, E., Taylor, B.A., Bub, K.L., Quality child care supports the achievement of low-income children: Direct and indirect pathways through caregiving and the home environment. Journal of Applied Developmental Psychology 28 (2007), 411–426.
36. McCloy, R.A., Ramifications of the performance/effectiveness distinction for teacher evaluation. 2013, August 20 Retrieved from https://www.humrro.org/corpsite/blog/2013-08-20/teacher-evaluation-part-2.
37. Medley, D.M., Coker, H., The accuracy of principals' judgments of teacher performance. The Journal of Educational Research 80 (1987), 242–247.
38. Motowidlo, S.J., Crook, A.E., Kell, H.J., Naemi, B., Measuring procedural Knowledge more simply with a single-response situational judgment test. Journal of Business and Psychology 24 (2009), 281–288.
39. Porter, A., McMaken, J., Hwang, J., Yang, R., Common core standards: The new U.S. intended curriculum. Educational Researcher 40 (2011), 103–116.
40. Pounder, J.S., A behaviourally anchored rating scales approach to institutional self- assessment in higher education. Assessment & Evaluation in Higher Education 25 (2000), 171–182.
41. Saal, F.E., Downey, R.G., Lahey, M.A., Rating the ratings: Assessing the psychometric quality of rating data. Psychological Bulletin 88 (1980), 413–428.
42. Schultz, M.M., Zedeck, S., Predicting lawyer effectiveness: Broadening the basis for law school admission decisions. Law & Social Inquiry 36 (2011), 620–661.
43. Schwab, D.P., Heneman, H.G., DeCotiis, T.A., Behaviorally anchored rating scales: A review of the literature. Personnel Psychology 28 (1975), 549–562.
44. Smith, P.C., Kendall, L.M., Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology 47 (1963), 9–155.
45. Thorndike, E.L., A constant error in psychological ratings. Journal of Applied Psychology 4 (1920), 25–29.