Creating confusion or creative evaluation? The use of student evaluation of teaching surveys in Japanese tertiary education

Educational Assessment, Evaluation and Accountability

Volumn 22, Issue 2, 2010, Pages 97-117

  Burden, Peter ^a  

^a OKAYAMA SHOKA UNIVERSITY   (Japan)

Author keywords

Creative; Evaluation; Improvement; Japan; Teaching; Usefulness

Indexed keywords

EID: 77953026997     PISSN: 18748597     EISSN: 18748600     Source Type: Journal    
DOI: 10.1007/s11092-010-9093-z     Document Type: Article

References (65)

1. Adams, J. (1997). Student evaluations: the ratings game. Inquiry, 1(2), 10-16.
2. Benesch, S. (1997). Needs analysis and curriculum development in EAP: An example of a critical approach. TESOL Quarterly, 30(4), 723-738.
3. Block, D. (1998a). Exploring interpretations of questionnaire items. System, 26, 403-425.
4. Block, D. (1998b). Tales of a language learner. Language Teaching Research, 2(2), 148-172.
5. Braskamp, L., & Ory, J. (1994). Assessing faculty effectiveness. San Francisco: Jossey Bass.
6. Braskamp, L., Brandenburg, D., & Ory, J. (1984). Evaluating teaching effectiveness: A practical guide. Thousand Oaks: Sage.
7. Cashin, W. (1990). Student ratings of teaching: Some recommendations for use. IDEA paper No. 22 (pp. 1-5). Manhattan: Kansas State University, Center for Faculty Evaluation and Development.
8. Cashin, W. (1995). Student ratings of teaching: The data revisited. IDEA paper No. 32 (pp. 1-9). Manhattan: Kansas State University, Center for Faculty Evaluation and Development.
9. Centra, J. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. San Francisco: Jossey-Bass.
10. Chen, Y., & Hoshower, L. (2003). Student evaluation of teaching effectiveness: an assessment of student perception and motivation. Assessment and Evaluation in Higher Education, 28(1), 71-89.
11. Crabbe, D. (2003). The quality of language learning opportunities. TESOL Quarterly, 37(1), 9-34.
12. d'Apollonia, S., & Abrami, P. (1997). Navigating student ratings of instruction. American Psychologist, 52(11), 1198-1208.
13. Darling-Hammond, L., & Snyder, J. (2000). Authentic assessment of teaching in context. Teaching and Teacher Education, 16, 523-545.
14. Dickey, D., & Pearson, C. (2005). Recency effect in college student course evaluations. Practical Assessment, Research and Evaluation, 10(6). Retrieved from http://pareonline. net/getvn. asp?v=10& n=6 December 3 2007.
15. Duke, D., & Stiggins, R. (1990). Beyond minimal competence: Evaluation for professional development. In J. Millman & L. Darling-Hammond (Eds.), The new handbook of teacher evaluation (pp. 241-256). Newbury Park: Corwin.
16. Dunegan, K., & Hrivnak, M. (2003). Characteristics of mindless teaching evaluations and the moderating effects of image compatibility. Journal of Management Education, 27(3), 280-303.
17. Eiszler, C. (2002). College students' evaluations of teaching and grade inflation. Research in Higher Education, 43(4), 483-501.
18. Emery, C., Kramer, T., & Tian, R. (2003). Returning to academic standards: a critique of student evaluations of teaching effectiveness. Quality Assurance in Education, 11(1), 37-46.
19. Gibbs, G. (1996). Promoting excellent teachers at Oxford Brookes University: From profiles to peer review in ten years. In R. Aylett & K. Gregory (Eds.), Evaluating teacher quality in higher education (pp. 42-55). London: Falmer.
20. Greene, J. (1999). The inequality of performance measures. Evaluation, 5(2), 160-172.
21. Harvey, L. (1997). Student satisfaction manual. Buckingham: Society for Research into Higher Education/ Open University Press.
22. Hopkins, D. (1989). Evaluation for school development. Milton Keynes: Open University Press.
23. Johnson, B. (1996). An organizational analysis of multiple perspectives of effective teaching: Implications for teacher evaluation. Journal of Personnel Evaluation in Education, 11, 69-87.
24. Johnson, R. (2000). The authority of the student evaluation questionnaire. Teaching in Higher Education, 15(4), 419-434.
25. Leckey, J., & Neill, N. (2001). Quantifying quality: the importance of student feedback. Quality in Higher Education, 7(1), 19-33.
26. Lincoln, Y., & Guba, E. (1985). Naturalistic inquiry. Newbury Park: Sage.
27. MacBeath, J., & McGlynn, A. (2002). Self evaluation. What's in it for schools? London: RoutledgeFarmer.
28. McIntyre, D. (1989). Criterion-referenced assessment of teaching. In H. Simons & J. Elliot (Eds.), Rethinking appraisal and assessment (pp. 64-71). Buckingham: Open University Press.
29. McKeachie, W. (1997). Student ratings: the validity of use. American Psychologist, 52(11), 1218-1225.
30. McVeigh, B. (2002). Japanese higher education as myth. New York: M. E. Sharpe.
31. Miles, M., & Huberman, A. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks: Sage.
32. stCentury. The Rainbow Plan. Available at www. mext. go. jp/english/topics/21plan/010301. htm 2 March 2005.
33. Ministry of Education, Culture, Sports, Science and Technology (MEXT) (2004). Retrieved from FY2003 white paper on Education, Culture, sports, science and technology. Available at www. mext. go. jp/english/news/2004/05/04052401. htm 2 March 2005.
34. Miyoshi, M. (2000). The university and the "global" economy: the cases of the United States and Japan. The South Atlantic Quarterly, 99(4), 668-697.
35. Moore, S., & Kuol, N. (2005). Students evaluating teachers: exploring the importance of faculty reaction to feedback on teaching. Teaching in Higher Education, 10(1), 57-73.
36. Motani, Y. (2005). Hopes and challenges for progressive educators in Japan: assessment of the 'progressive turn' in the 2002 educational reform. Comparative Education, 41(3), 309-327.
37. Nasser, F., & Fresko, B. (2002). Faculty views of student evaluation of college teaching. Assessment and Evaluation in Higher Education, 27(2), 187-196.
38. Newport, J. (1996). Rating teaching in the US: probing the qualifications of student raters and novice teachers. Assessment and Evaluation in Higher Education, 21(1), 17-23.
39. Norris, J. (2006). The why (and how) of assessing student learning outcomes in college foreign language programs. The Modern Language Journal, 90, 576-583.
40. Patton, M. (1996). Utilization-focused evaluation. Thousand Oaks: Sage.
41. Pennington, M., & Young, A. (1989). Approaches to faculty evaluation for ESL. TESOL Quarterly, 23(4), 619-643.
42. Rea-Dickins, P. (1994). Evaluation and English language teaching. Language Teaching, 27(2), 71-91.
43. Rennert-Ariev, P. (2005). A theoretical model for the authentic assessment of teaching. Practical Assessment, Research and Evaluation, 10(2). Retrieved from http://pareonline. net/getvn. asp?v=10& n=2 December 3 2007.
44. Rubin, H., & Rubin, I. (2005). Qualitative interviewing: The art of hearing. Thousand Oaks: Sage.
45. Scriven, M. (1981). Summative teacher evaluation. In J. Millman (Ed.), Handbook of teacher evaluation (pp. 244-271). Beverly Hills: Sage.
46. Seldin, P. (1993). The use and abuse of student ratings of professors. The Chronicle of Higher Education, 39, 40-43.
47. Simpson, P., & Siguaw, J. (2000). Student evaluation of teaching: an exploratory study of the faculty response. Journal of Marketing Education, 22(3), 199-213.
48. Smyth, J. (1988). A critical pedagogy of teacher evaluation. Geelong: Deakin University.
49. Spencer, K., & Schmelkin, L. (2002). Student perspectives on teaching and its evaluation. Assessment and Evaluation in Higher Education, 27(5), 397-409.
50. Spolsky, B. (1992). Conditions for second language learning. Oxford: Oxford University Press.
51. Stiggins, R., & Duke, D. (1988). The case for commitment to teacher growth: Research on teacher evaluation. Albany: State University of New York Press.
52. Stronge, J. (2006). Teacher evaluation and school improvement. In J. Stronge (Ed.), Evaluating teaching: A guide to current thinking and best practice (pp. 1-23). Thousand Oaks: Corwin.
53. Stronge, J., & Tucker, P. (1999). The politics of teacher evaluation: A case study of new system design and implementation. Journal of Personnel Evaluation in Education, 13(4), 339-359.
54. Stufflebeam, D. (1997). A standards-based perspective on evaluation. In L. Mabry (Ed.), Advances in program evaluation (pp. 41-61). Greenwich: JAI.
55. Svinicki, M. (2001). Encouraging your students to give feedback. In K. Lewis (Ed.), Techniques and strategies for interpreting student evaluations (pp. p17-p24). San Francisco: Jossey-Bass.
56. Taut, S., & Brauns, D. (2003). Resistance to evaluation: a psychological perspective. Evaluation, 9(3), 247-264.
57. Theall, M., & Franklin, J. (2001). Looking for bias in all the wrong places: A search for truth or a witch hunt in student ratings of instruction. In M. Theall, P. Abrami, & L. Mets (Eds.), The student ratings debate: Are they valid? How can we best use them? (pp. 45-56). San Francisco: Jossey Bass.
58. Tsurata, Y. (2003). Globalisation and Japanese higher education. In R. Goodman & D. Phillips (Eds.), Can the Japanese change their education system? (pp. 119-151). Oxford: Symposium Books.
59. Wachtel, H. (1998). Student evaluation of college teaching effectiveness: a brief overview. Assessment and Evaluation in Higher Education, 23(2), 191-213.
60. Wheeler, P., & Scriven, M. (2006). Building the foundation: Teacher roles and responsibilities. In J. Stronge (Ed.), Evaluating teaching: A guide to current thinking and best practice (pp. 27-54). Thousand Oaks: Corwin.
61. Wilkerson, D., Manatt, R., Rogers, M., & Maughan, R. (2000). Validation of student, principal, and self-ratings in 360 degree feedback for teacher evaluation. Journal of Personnel Evaluation in Education, 14(2), 179-192.
62. Yamada, R. (2001). University reform in the post-massification era in Japan: analysis of government education policy for the 21st century. Higher Education Policy, 14, 277-291.
63. Yamamoto, S. (2005). Government and the national universities: Ministerial bureaucrats and dependent universities. In J. Eades, R. Goodman, & Y. Hada (Eds.), The "Big Bang" in Japanese higher education (pp. 94-105). Melbourne: Trans Pacific.
64. Yao, Y., & Grady, M. (2005). How do faculty make formative use of student evaluation feedback?: A multiple case study. Journal of Personnel Evaluation in Education, 18, 107-126.
65. Yonezawa, A. (2002). The new quality assurance system for Japanese higher education: its social background, tasks and future. Research in University Evaluation, 2, 23-33.