Predicting Student Achievement in University-Level Business and Economics Classes: Peer Observation of Classroom Instruction and Student Ratings of Teaching Effectiveness

College Teaching

Volumn 60, Issue 2, 2012, Pages 48-55

  Galbraith, Craig S ^a   Merrill, Gregory B ^b  

^a UNIVERSITY OF NORTH CAROLINA WILMINGTON   (United States)

^b SAINT MARY'S COLLEGE OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84901001307     PISSN: 87567555     EISSN: 19308299     Source Type: Journal    
DOI: 10.1080/87567555.2011.627896     Document Type: Article

References (76)

1. Abrami, P., Levanthal, L., and Perry, R., 1982. Educational seduction. Review of Educational Research, 52: 446–464.
2. Ambady, N., and Rosenthal, R., 1993. Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology, 64: 431–441.
3. Anderson, K., and Smith, G., 2005. Students preconceptions of professors: Benefits and barriers according to ethnicity and gender. Hispanic Journal of Behavioral Sciences, 27 (2): 184–201.
4. Arreola, R., 2007. Developing a comprehensive faculty evaluation system, 3rd ed., Bolton, MA: Anker Publishing.
5. Atamian, R., and Ganguli, G., 1993. Teacher popularity and teaching effectiveness: Viewpoint of accounting students. Journal of Education for Business, 68 (3): 163–169.
6. Baarveld, F., Kollen, B., and Groenier, K., 2007. Expertise in sports medicine among family physicians: What are the benefits?. The Open Sports Medicine Journal, 1: 1–4.
7. Balam, E., and Shannon, D., 2010. Student ratings of college teaching: A comparison of faculty and their students. Assessment and Evaluation in Higher Education, 35 (2): 209–221.
8. Barrett, J., Hart, K., Schmerier, J., Willmartch, K., Carey, J., and Mohammed, S., 2009. Criterion validity of the financial skills subscale of the direct assessment of functional status scale. Psychiatry Research, 166 (2/3): 148–157.
9. Bernstein, D., 2008. Peer review and the evaluation of the intellectual work of teaching. Change, March/April: 48–51.
10. Bernstein, D., Burnett, A., Goodburn, A., and Savory, P., 2006. Making teaching and learning visible: Course portfolios and the peer review of teaching., Bolton, MA: Anker Publishing.
11. Bernstein, D., and Edwards, R., 2001. We need objective, rigourous peer review of teaching. Chronicle of Higher Education, 47 (17): B24
12. Blackhart, G., Peruche, B., DeWall, C., and Joiner, T., 2006. Factors influencing teaching evaluations in higher education. Teaching of Psychology, 33: 37–39.
13. Bolotin, A., 2006. Fuzzy logic approach to robust regression of uncertain medical categories. World Academy of Science, Engineering and Technology, 22: 106–111.
14. Bowling, N., 2008. Does the relationship between student ratings of course easiness and course quality vary across schools? The role of school academic rankings. Assessment and Evaluation in Higher Education, 33 (4): 455–464.
15. Boysen, G., 2008. Revenge and student evaluations of teaching. Teaching of Psychology, 35 (3): 218–222.
16. Buck, S., and Tiene, D., 1989. The impact of physical attractiveness, gender, and teaching philosophy on teacher evaluations. Journal of Educational Research, 82: 172–177.
17. Burns, C., 1998. Peer evaluation of teaching: Claims vs. research., Little Rock, AK: University of Arkansas. http://eric.ed.gov/ERICWebPortal/search/detailmini.jsp?_nfpb=trueand_andERICExtSearch_SearchValue_0= ED421470andERICExtSearch_SearchType_0=noandaccno=ED421470
18. Campbell, J., and Bozeman, W., 2008. The value of student ratings: Perceptions of students, teachers, and administrators. Community College Journal of Research and Practice, 32 (1): 13–24.
19. Carrell, S., and West, J., 2010. Does professor quality matter? Evidence from random assignments of students to professors. Journal of Political Economy, 118 (3): 409–432.
20. Cavanagh, R., 1996. Formative and summative evaluation in the faculty peer review of teaching. Innovative Higher Education, 20 (4): 235–240.
21. Centra, J., 1993. Reflective faculty evaluation, San Francisco: Jossey-Bass.
22. Centra, J., 1994. The use of teaching portfolios and student evaluations for summative evaluation. Journal of Higher Education, 65: 555–570.
23. Chism, N., 2007. Peer review of teaching: A sourcebook, 2nd ed., Bolton, MA: Anker Publishing.
24. Cohen, J., 1969. Statistical power analysis for the behavioural sciences, San Diego, CA: Academic Press.
25. Cohen, J., 1981. “ 2nd ed ”. In Statistical power analysis for the behavioural sciences, Hillsdale, NJ: Lawrence Erlbaum Associates.
26. Cohen, P., 1981. Student ratings of instruction and student achievement. Review of Educational Research, 51 (3): 281–309.
27. Cohen, P., 1982. Validity of student ratings in psychology courses: A research synthesis. Teaching of Psychology, 9 (2): 78–82.
28. Cohen, P., 1983. Comment on a selective review of the validity of student ratings of teaching. Journal of Higher Education, 54 (4): 448–458.
29. Cohen, P., and McKeachie, W., 1980. The role of colleagues in the evaluation of college teaching. Improving college and university teaching, 28 (4): 147–154.
30. Costello, J., Pateman, B., Pusey, H., and Longshaw, K., 2001. Peer review of classroom teaching: An interim report. Nurse Education Today, 21: 444–454.
31. Costin, P., 1987. Do student ratings of college teachers predict student achievement?. Teaching of Psychology, 5 (2): 86–88.
32. Courneya, C., Pratt, D., and Collins, J., 2007. Through what perspective do we judge the teaching of peers?. Teaching and Teacher Education, 24: 69–79.
33. Davies, M., Hirschberg, J., Lye, J., and Johnston, C., 2007. Systematic influences on teaching evaluations: The Case for Caution. Australian Economic Papers, 46 (1): 18–38.
34. DeZure, D., 1999. “ Evaluating teaching through peer classroom observation ”. In Changing practices in evaluating teaching, Edited by: P. Seldin. Bolton, MA: Anker Publishing.
35. Dowel, D., and Neal, J., 1982. A selective review of the validity of student ratings of teaching. Journal of Higher Education, 32 (1): 51–62.
36. Dowell, D., and Neal, J., 1983. The validity and accuracy of student ratings of instruction: A reply to Peter A. Cohen. Journal of Higher Education, 54 (4): 459–463.
37. Emery, C., Kramer, T., and Tian, R., 2003. Return to academic standards: A critique of student evaluations of teaching effectiveness. Quality Assurance in Education, 11 (1): 37–46.
38. Feldman, K., 1989a. The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. Research in Higher Education, 30 (6): 583–645.
39. Feldman, K., 1989b. Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Research in Higher Education, 30 (2): 137–194.
40. Feldman, K. 2007. “ Identifying exemplary teachers and teaching: Evidence from student ratings ”. In The scholarship of teaching and learning in higher education: An evidence-based perspective, Edited by: Perry, R., and Smart, J., 93–129. Dordrecht, The Netherlands: Springer.
41. Felton, J., Mitchell, J., and Stinson, J., 2004. Web-based student evaluations of professors: The relations between perceived quality, easiness and sexiness. Assessment and Evaluation in Higher Education, 29 (1): 91–108.
42. Fetterley, J., 2005. Teaching and “my work”. American Literary History, 17 (4): 741–752.
43. Galbraith, C., Merrill, G., and Kline, D., 2011. Are student evaluations of teaching effectiveness valid for measuring student learning outcomes in business related classes? A neural network and Bayesian analysis. Research in Higher Education,: 1–22. http://www.springerlink.com/content/2058756205016652
44. Glazerman, S. S., Loeb, D., Goldhaber, S., Raudenbush, D., Staiger, G., and Whitehurst, G., 2010. Evaluating teachers: The important role of value-added., Palo Alto, CA: Center for Educational Policy Analysis, Stanford University.
45. Hon, J., Lagden, K., McLaren, A., O’Sullivan, D., Orr, L., Houghton, P., and Woodbury, M., 2010. A prospective multicenter study to validate use of the PUSH© in patients with diabetic, venous, and pressure ulcers. Ostomy Wound Management, 56 (2): 26–36.
46. Hutchings, P., 1996. The peer review of teaching: Progress, issues and prospects. Innovative Higher Education, 20 (4): 221–234.
47. Hutchings, P., 1998. The course portfolio, Sterling, VA: Stylus.
48. Johnson, I., 2010. Class size and student performance at a public research university: A cross-classified model. Research in Higher Education, http://www.springerlink.com/content/0l35t1821172j857/fulltext.pdf
49. Kremer, J. 1990. Construct validity of multiple measures in teaching, research, and service and reliability of peer ratings. Journal of Educational Psychology, 82: 213–218.
50. Kohut, G., Burnap, C., and Yon, M., 2007. Peer observation of teaching: Perceptions of the observer and the observed. College Teaching, 55 (1): 19–25.
51. Langbein, L., 2008. Management by results: Student evaluation of faculty teaching and the mis-measurement of performance. Economics of Education Review, 27 (4): 417–428.
52. Lopus, J., and Maxwell, N., 1995. Should we teach microeconomic principles before macroeconomic principles?. Economic Inquiry, 33 (2): 336–350.
53. Malik, D., 1996. Peer review of teaching: External review of course content. Innovative Higher Education, 20 (4): 277–286.
54. Mazumdar, M., and Glassman, R., 2000. Categorizing a prognostic variable: Review of methods, code for easy implementation and applications to decision-making about cancer treatments. Statistics Medicine, 19: 113–132.
55. McCallum, L., 1984. A meta-analysis of course evaluation data and its use in the tenure decision. Research in Higher Education, 21: 150–158.
56. McKeachie, W., 1979. Student ratings of faculty: A reprise. Academe, 65 (6): 384–397.
57. McKeachie, W., 1996. “ Student ratings of teaching. Occasional Paper No. 33 ”. In American Council of Learned Societies, University of Michigan. http://archives.acls.org/op/33_Professonal_Evaluation_of_Teaching.htm
58. McNatt, B., 2010. Negative reputation and biases student evaluations of teaching: Longitudinal results from a naturally occurring experiment. Academy of Management Learning and Education, 9 (2): 225–242.
59. Muennig, P., Sohler, N., and Mahato, B., 2007. Scoioeconomic status as an independent predictor of physiological biomarkers of cardiovascular disease: Evidence from NHANES. Preventive Medicine, http://www.sciencedirect.com
60. Muthén, B., and Speckart, G., 1983. Categorizing skewed, limited dependent variables. Evaluation Review, 7 (2): 257–269.
61. Naftulin, D., Ware, J., and Donnelly, F., 1973. The Doctor Fox lecture: A paradigm of educational seduction. Journal of Medical Education, 48: 630–635.
62. Pascarella, E., and Terenzini, P., 2005. How college affects students: A third decade of research, San Francisco: Jossey-Bass.
63. Peel, D., 2005. Peer observation as a transformatory tool?. Teaching in Higher Education, 10 (4): 489–504.
64. Peterson, K., 2000. Teacher evaluation: A comprehensive guide to new directions and practices, 2nd ed., Thousand Oaks, CA: Corwin Press.
65. Pounder, J., 2007. Is student evaluation of teaching worthwhile? An analytical framework for answering the question. Quality Assurance in Education, 15 (2): 178–191.
66. Riniolo, T., Johnson, K., Sherman, T., and Misso, J., 2006. Hot or not: Do professors perceived as physically attractive receive higher student evaluations?. The Journal of General Psycholog, 133 (1): 19–35.
67. Shortland, S. 2004. Peer observation: A tool for staff development or compliance?. Journal of Further and Higher Education, 28: 219–227.
68. Smith, B., 2007. Student ratings of teaching effectiveness: An analysis of end-of-course faculty evaluations. College Student Journal, 471 (4): 788–800.
69. Steward, R., and Phelps, R., 2000. Faculty of color and university students: Rethinking the evaluation of faculty teaching. Journal of the Research Association of Minority Professors, 4 (2): 49–56.
70. Sutkin, G., Wagner, E., Harris, I., and Schiffer, R., 2008. What makes a good clinical teacher in medicine? A review of the literature. Academic Medicine, 83 (5): 452–466.
71. Taylor, J., 2007. The teaching/research nexus: A model for institutional management. Higher Education, 54 (6): 867–884.
72. Varni, J., Seid, M., and Kurtin, P., 2001. PedsQL™ 4.0: Reliability and validity of the Pediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales in healthy and patient populations. Medical Care, 39 (8): 800–812.
73. Whitfield, K., Buchbinder, R., Segal, L., and Osborne, R., 2006. Parsimonious and efficient assessment of health-related quality of life in osteoarthritis research, validation of the Assessment of Quality of Life (AQoL) instrument. Health and Quality of Life Outcomes, 4 (19) http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1538577/#B19
74. Yon, M., Burnap, C., and Kohut, G., 2002. Evidence of effective teaching: Perceptions of peer reviewers. College Teaching, 50 (3): 104–110.
75. Youmans, R., and Jee, B., 2007. Fudging the numbers: Distributing chocolate influences student evaluations of an undergraduate course. Teaching of Psychology, 34 (4): 245–247.
76. Zietz, J., and Cochran, H., 1997. Containing cost without sacrificing achievement: Some evidence from college-level economics classes. Journal of Education Finance, 23: 177–192.