National student survey: Are differences between universities and courses reliable and meaningful?

Oxford Review of Education

Volumn 36, Issue 6, 2010, Pages 693-712

  Cheng, Jacqueline H S ^a   Marsh, Herbert W ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 78649805729     PISSN: 03054985     EISSN: 14653915     Source Type: Journal    
DOI: 10.1080/03054985.2010.491179     Document Type: Article

References (43)

1. Abrami, P. C., d'Apollonia, S. & Cohen, P. A. (1990) Validity of student ratings of instruction: what we know and what we do not, Journal of Educational Psychology, 82, 219-231.
2. Australian Council for Educational Research (2000) Evaluation and validation of the trial Postgraduate Research Experience Questionnaires (Canberra, Australian Council for Educational Research).
3. Bliese, P. D. (2000) Within-group agreement, non-independence, and reliability: implications for data aggregation and analysis, in: K. J. Klein & S. W. J. Kozlowski (Eds) Multilevel theory, research, and methods in organizations: foundations, extensions, and new directions (San Francisco, Jossey-Bass).
4. Bryk, A. S. & Raudenbush, S. W. (1992) Hierarchical linear models: applications and data analysis methods (Thousand Oaks, Sage).
5. Cashin, W. E. (1988) Student ratings of teaching. A summary of research (IDEA paper No. 20) (Kansas State University, Division of Continuing Education).
6. Cohen, P. A. (1980) Effectiveness of student-rating feedback for improving college instruction: a meta-analysis, Research in Higher Education, 13, 321-341.
7. d'Appollonia, S. & Abrami, P. C. (1997) Navigating student ratings of instruction, American Psychologist, 52, 1198-1208.
8. Enders, C. K. (2006) A primer on the use of modern missing-data methods in psychosomatic medicine research, Psychosomatic Medicine, 68, 427-736.
9. Ethington, C. A. (1996). A hierarchical linear modelling approach to studying college effects, in: J. C. Smart (Ed.) Higher education: handbook of theory and research (Vol. 12) (New York, Agathon Press).
10. Feldman, K. A. (1989a) Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers, Research in Higher Education, 30, 137-194.
11. Feldman, K. A. (1989b) Association between student ratings of specific instructional dimensions and student achievement: refining and extending the synthesis of data from multisection validity studies, Research in Higher Education, 30, 583-645.
12. Feldman, K. A. (1997) Identifying exemplary teachers and teaching: evidence from student ratings, in: R. P. Perry & J. C. Smart (Eds) Effective teaching in higher education: research and practice (New York, Agathon), 368-395.
13. Feldman, K. A. (1998) Reflections on the effective study of college teaching and student ratings: one continuing quest and two unresolved issues, in: J. C. Smart (Ed.) Higher education: handbook of theory and research (New York, Agathon), 35-74.
14. Gilmore, G. M., Kane, M. T. & Naccarato, R. W. (1978) The generalizability of student ratings of instruction: estimates of teacher and course components, Journal of Educational Measurement, 15, 1-13.
15. Goldstein, H. (1995) Multilevel statistical models (2nd edn.) (London, Arnold).
16. Graham, J. W. (2009) Missing data analysis: making it work in the real world, Annual Review of Psychology, 60, 549-576.
17. Graham, J. W. & Hoffer, S. M. (2000) Multiple imputation in multivariate research, in: T. D. Little, K. U. Schnable & J. Baumert (Eds) Modeling longitudinal and multilevel data: practical issues, applied approaches, and specific examples (Hillsdale NJ, Erlbaum), 201-218.
18. Greenwald, A. G. & Gillmore, G. M. (1997) No pain, no gain? The importance of measuring course workload in student ratings of instruction, Journal of Educational Psychology, 89, 743-751.
19. HEFCE (2001) Quality assurance in higher education: proposals for consultation. Consultation 01/45, 1-16. Higher Education Funding Council for England, Quality Assurance Agency for Higher Education, Universities UK, Standing Conference of Principals.
20. HEFCE (2003) National student survey: administration. Circular letter 22/2003, 1. Higher Education Funding Council for England, Quality Assurance Agency for Higher Education, Universities UK, Standing Conference of Principals.
21. Higher Education Statistics Agency (2007) Available online at: http://www.hesa.ac.uk/index.php/component/option,com_studrec/task,show_file/Itemid,233/mnl,07051/href,a%5E_%5EULN.html/ (accessed 1 December 2007).
22. Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T. & Muthén, B. (2008) The multilevel latent covariate model: a new, more reliable approach to group-level effects in contextual studies, Psychological Methods, 13, 203-229.
23. Marsh, H. W. (1980) The influence of student, course and instructor characteristics on evaluations of university teaching, American Educational Research Journal, 17, 219-237.
24. Marsh, H. W. (1982) SEEQ: A reliable, valid, and useful instrument for collecting students' evaluations of university teaching, British Journal of Educational Psychology, 52, 77-95.
25. Marsh, H. W. (1984) Students' evaluations of university teaching: dimensionality, reliability, validity, potential biases, and utility, Journal of Educational Psychology, 76, 707-754.
26. Marsh, H. W. (1987) Students' evaluations of university teaching: research findings, methodological issues, and directions for future research, International Journal of Educational Research, 11, 253-388 (whole issue).
27. Marsh, H. W. (1991) Multidimensional students' evaluations of teaching effectiveness: a test of alternative higher-order structures, Journal of Educational Psychology, 83, 285-296.
28. Marsh, H. W. (2007) Students' evaluations of university teaching: a multidimensional perspective, in: R. P. Perry & J. C. Smart (Eds) The scholarship of teaching and learning in higher education: an evidence-based perspective (New York, Springer).
29. Marsh, H. W. & Dunkin, M. (1997) Students' evaluations of university teaching: a multidimensional perspective, in: R. P. Perry & J. C. Smart (Eds) Effective teaching in higher education: research and practice (New York, Agathon), 241-320.
30. Marsh, H. W. & Cheng, J. H.S. (2008) NSS: Dimensionality, multilevel structure, and differentiation at the level of university and discipline. Available at: http://www.heacademy.ac.uk/resources/detail/ourwork/research/NSS_herb_marsh.
31. Marsh, H. W. & Roche, L. A (1997) Making students' evaluations of teaching effectiveness effective, American Psychologist, 52, 1187-1197.
32. Marsh, H. W. & Roche, L. A. (2000) Effects of grading leniency and low workloads on students' evaluations of teaching: popular myth, bias, validity or innocent bystanders? Journal of Educational Psychology, 92, 202-228.
33. Marsh, H. W., Rowe, K. & Martin, A. (2002) PhD students' evaluations of research supervision: issues, complexities and challenges in a nationwide Australian experiment in benchmarking universities, Journal of Higher Education, 73(3), 313-348.
34. McKeachie, W. J. (1979) Student ratings of faculty: a reprise, Academe, 65, 384-397.
35. McKeachie, W. J. (1997) Student ratings: the validity of use, American Psychologist, 52, 1218-225.
36. McKinnon, K. R., Walker, S. H. & Davis, D. (2000) Benchmarking: a manual for Australian universities (Canberra, Australian Department of Education, Training and Youth Affairs).
37. O'Leary, J., Hindmarsh, A. & Kingston, B. (2006) The Times good university guide 2007 (London, Times Books).
38. Rasbash, J., Steele, F., Browne, W. & Prosser, B. (2005). A user's guide to MLwiN version 2.0 (Bristol, University of Bristol).
39. Richardson, J. (2005) National student survey: interim assessment of the 2005 questionnaire. A report to the Higher Education Funding Council, 1-31.
40. Sinharay, S., Stern, H. S. & Russell, D. (2001) The use of multiple imputation for the analysis of missing data, Psychological Methods, 6(4), 317-329.
41. Snijders, T. A. B. & Bosker, R. J. (1999) Multilevel analysis: an introduction to basic and advanced multilevel modeling (Thousand Oaks, Sage).
42. Surridge, P. (2006) The National Student Survey 2005: findings. A report to the Higher Education Funding Council, 1-127.
43. Surridge, P. (2007) The National Student Survey 2006: findings. A report to the Higher Education Funding Council, 1-132.