Exploratory structural equation modeling, integrating CFA and EFA: Application to students' evaluations of university teaching

Structural Equation Modeling

Volumn 16, Issue 3, 2009, Pages 439-476

  Marsh, Herbert W ^a   Muthén, Bengt ^b   Asparouhov, Tihomir ^c   Lüdtke, Oliver ^d   Robitzsch, Alexander ^e   Morin, Alexandre J S ^f   Trautwein, Ulrich ^d  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Muthe n and Muthe n   (United States)

^d MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^e Institute for Educational Progress   (Germany)

^f UNIVERSITÉ DE SHERBROOKE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRUCT VALIDITY; DIAGNOSTIC FEEDBACK; EXPLORATORY FACTOR ANALYSIS; MULTIPLE INDICATORS; QUADRATIC EFFECT; STRUCTURAL EQUATION MODELING; STUDENTS' EVALUATIONS; UNIVERSITY TEACHING;

STATISTICAL METHODS;

EID: 70449592059     PISSN: 10705511     EISSN: None     Source Type: Journal    
DOI: 10.1080/10705510903008220     Document Type: Article

References (78)

1. Abrami, P. C., & d'Apollonia, S. (1991). Multidimensional students' evaluations of teaching effectiveness: Generalizability of N D 1 research. Comment on Marsh (1991). Journal of Educational Psychology, 30, 221-227.
2. Asparohov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling, 16(3), 397-438.
3. Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.
4. Braskamp, L. A., Brandenburg, D. C., & Ory, J. C. (1985). Evaluating teaching effectiveness: A practical guide. Beverly Hills, CA: Sage.
5. Browne, M. W. (2000). Cross-validation methods. Journal of Mathematical Psychology, 44, 108-132.
6. Browne, M. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111-150.
7. Carroll, J. B. (1953). An analytical solution for approximating simple structure in factor analysis. Psychometrika, 18, 23-38.
8. Cashin, W. E. (1988). Student ratings of teaching: A summary of research. (IDEA Paper No. 20). Manhattan, KS: Kansas State University, Division of Continuing Education. (ERIC Document Reproduction Service No. ED 302 567)
9. Centra, J. A. (1993). Reflective faculty evaluation. San Francisco, CA: Jossey-Bass.
10. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
11. Cheung, G. W., & Rensvold, R. B. (2001). The effects of model parsimony and sampling error on the fit of structural equation models. Organizational Research Methods, 4, 236-264.
12. Cliff, N. (1966). Orthogonal rotation to congruence. Psychometrika, 31, 33-42.
13. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
14. Cohen, P. A. (1980). Effectiveness of student-rating feedback for improving college instruction: A meta-analysis. Research in Higher Education, 13, 321-341.
15. Cohen, P. A. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research, 51, 281-309.
16. Costin, F., Greenough, W. T., & Menges, R. J. (1971). Student ratings of college teaching: Reliability, validity and usefulness. Review of Educational Research, 41, 511-536.
17. de Wolf, W. A. (1974). Student ratings of instruction in post secondary institutions: A comprehensive annotated bibliography of research reported since 1968 (Vol. 1). Seattle: University of Washington Educational Assessment Center.
18. Feldman, K. A. (1976). The superior college teacher from the student's view. Research in Higher Education, 5, 243-288.
19. Feldman, K. A. (1977). Consistency and variability among college students in rating their teachers and courses. Research in Higher Education, 6, 223-274.
20. Feldman, K. A. (1978). Course characteristics and college students' ratings of their teachers and courses: What we know and what we don't. Research in Higher Education, 9, 199-242.
21. Feldman, K. A. (1989a). Association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. Research in Higher Education, 30, 583-645.
22. Feldman, K. A. (1989b). Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Research in Higher Education, 30, 137-194.
23. Feldman, K. A. (1997). Identifying exemplary teachers and teaching: Evidence from student ratings. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 368-395). New York: Agathon.
24. Grayson, D. A., Mackinnon, A., Jorm, A. F., Creasey, H., & Broe, G. A. (2000). Item bias in the Center for Epidemiologic Studies Depression scale: Effects of physical disorders and disability in an elderly community sample. Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 5, 273-282.
25. Holzinger, K. J., & Harman, H. H. (1941). Factor analysis. Chicago: University of Chicago Press.
26. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
27. Jackson, D. L., Teal, C. R., Raines, S. J., Nansel, T. R., Force, R. C., & Burdsal, C. A. (1999). The dimensions of students' perceptions of teaching effectiveness. Educational and Psychological Measurement, 59, 580-596.
28. Jöreskog, K. G., & Sörbom, D. (1979). Advances in factor analysis and structural equation models. Cambridge, MA: Abt Books.
29. Jöreskog, K. G., & Sörbom, D. (1988). LISREL 7-A guide to the program and applications (2nd ed.). Chicago: SPSS.
30. Kaiser, H. F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23, 187-200.
31. Kaplan, D. (2000). Structural equation modeling: Foundations and extensions. Newbury Park, CA: Sage.
32. Marsh, H. W. (1982a). SEEQ: A reliable, valid, and useful instrument for collecting students' evaluations of university teaching. British Journal of Educational Psychology, 52, 77-95.
33. Marsh, H. W. (1982b). Validity of students' evaluations of college teaching: A multitrait-multimethod analysis. Journal of Educational Psychology, 74, 264-279.
34. Marsh, H. W. (1983). Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. Journal of Educational Psychology, 75, 150-166.
35. Marsh, H. W. (1984). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology, 76, 707-754.
36. Marsh, H. W. (1987). Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research, 11, 253-388.
37. Marsh, H. W. (1991a). A multidimensional perspective on students' evaluations of teaching effectiveness: A reply to Abrami and d'Apollonia (1991). Journal of Educational Psychology, 83, 416-421.
38. Marsh, H. W. (1991b). Multidimensional students' evaluations of teaching effectiveness: A test of alternative higherorder structures. Journal of Educational Psychology, 83, 285-296.
39. Marsh, H. W. (1994). Confirmatory factor analysis models of factorial invariance: A multifaceted approach. Structural Equation Modeling, 1, 5-34.
40. Marsh, H. W. (2007a). Application of confirmatory factor analysis and structural equation modeling in sport/exercise psychology. In G. Tenenbaum & R. C. Eklund (Eds.), Handbook of on sport psychology (3rd ed., pp. 774-798). New York: Wiley.
41. Marsh, H. W. (2007b). Do university teachers become more effective with experience? A multilevel growth model of students' evaluations of teaching over 13 years. Journal of Educational Psychology, 99, 775-790.
42. Marsh, H. W. (2007c). Students' evaluations of university teaching: A multidimensional perspective. In R. P. Perry & J. C. Smart (Ed.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319-384). New York: Springer.
43. Marsh, H. W., & Bailey, M. (1993). Multidimensionality of students' evaluations of teaching effectiveness: A profile analysis. Journal of Higher Education, 64, 1-18.
44. Marsh, H. W., Balla, J. R., & Hau, K.-T. (1996). An evaluation of incremental fit indices: A clarification of mathematical and empirical processes. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling techniques (pp. 315-353). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
45. Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391-410.
46. Marsh, H. W., & Dunkin, M. J. (1992). Students' evaluations of university teaching: A multidimensional perspective. In J. Smart (Ed.), Higher education: Handbook on theory and research (Vol. 8, pp. 143-234). New York: Agathon.
47. Marsh, H. W., & Dunkin, M. J. (1997). Students' evaluations of university teaching: A multidimensional perspective. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 241-320). New York: Agathon.
48. Marsh, H. W., Ellis, L., Parada, L., Richards, G., & Heubeck, B. G. (2005). A short version of the Self Description Questionnaire II: Operationalizing criteria for short-form evaluation with new applications of confirmatory factor analyses. Psychological Assessment, 17, 81-102.
49. Marsh, H. W., & Grayson, D. (1994). Longitudinal stability of latent means and individual differences: A unified approach. Structural Equation Modeling, 1, 317-359.
50. Marsh, H. W., & Hau, K.-T. (2007). Applications of latent-variable models in educational psychology: The need for methodological-substantive synergies. Contemporary Educational Psychology, 32, 151-171.
51. Marsh, H. W., Hau, K.-T., Balla, J. R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181-220.
52. Marsh, H. W., Hau, K.-T., & Grayson, D. (2005). Goodness of fit evaluation in structural equation modeling. In A. Maydeu-Olivares & J. McCardle (Eds.), Psychometrics: A festschrift to Roderick P. McDonald (pp. 275-340). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
53. Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralising Hu & Bentler's (1999) findings. Structural Equation Modeling, 11, 320-341.
54. Marsh, H. W., & Hocevar, D. (1991a). The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level. Teaching and Teacher Education, 7, 9-18.
55. Marsh, H. W., & Hocevar, D. (1991b). Students' evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period. Teaching and Teacher Education, 7, 303-314.
56. Marsh, H. W., & Overall, J. U. (1979). Long-term stability of students' evaluations. Research in Higher Education, 10, 139-147.
57. Marsh, H. W., Overall, J. U., & Kesler, S. P. (1979). Validity of student evaluations of instructional effectiveness: A comparison of faculty self-evaluations and evaluations by their students. Journal of Educational Psychology, 71, 149-160.
58. Marsh, H. W., & Roche, L. A. (1993). The use of students' evaluations and an individually structured intervention to enhance university teaching effectiveness. American Educational Research Journal, 30, 217-251.
59. Marsh, H. W., & Roche, L. A. (1994). The use of students' evaluations of university teaching to improve teaching effectiveness. Canberra, Australia: Australian Department of Employment, Education, and Training.
60. Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective. American Psychologist, 52, 1187-1197.
61. Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workloads on students' evaluations of teaching: Popular myth, bias, validity or innocent bystanders? Journal of Educational Psychology, 92, 202-228.
62. Marsh, H. W., Tracey, D. K., & Craven, R. G. (2005). Multidimensional self-concept structure for preadolescents with mild intellectual disabilities: A hybrid multigroup-MIMIC approach to factorial invariance and latent mean differences. Sydney, Australia: SELF Research Centre, University of Western Sydney.
63. Marsh, H. W., Wen, Z., & Hau, K.-T. (2004). Structural equation models of latent interactions: Evaluation of alternative estimation strategies and indicator construction. Psychological Methods, 9, 275-300.
64. Marsh, H. W., Wen, Z., & Hau, K.-T. (2006). Structural equation models of latent interaction and quadratic effects. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (pp. 225-265). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
65. McDonald, R. P. (1985). Factor analysis and related methods. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
66. McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist, 52, 1218-1225.
67. Meredith, W. (1964). Rotation to achieve factorial invariance. Psychometrika, 29, 187-206.
68. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance, Psychometrika, 58, 525-543.
69. Meredith, W., & Teresi, J. (2006). An essay on measurement and factorial invariance. Medical Care, 44(Suppl. 3), S69-S77.
70. Muthén, B. (1989). Latent variable modeling in heterogeneous populations. Psychometrika, 54, 557-585.
71. Muthén, L. K., & Muthén, B. (2008). Mplus user's guide. Los Angeles: Muthén & Muthén.
72. Remmers, H. H. (1963). Rating methods in research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 329-378). Chicago: Rand McNally.
73. Renaud, R. D., & Murray, H. G. (2005). Factorial validity of student ratings of instruction. Research in Higher Education, 46, 929-953.
74. Richardson, J. T. E. (2005). Instruments for obtaining student feedback: A review of the literature. Assessment and Evaluation in Higher Education, 30, 387-415.
75. Rindermann, H. (1996). On the quality of students' evaluations of university teaching: An answer to evaluation critique. Zeitschrift Für Padagogische Psychologie, 10(3-4), 129-145.
76. Thurstone, L. L. (1947). Multiple factor analysis. Chicago: University of Chicago.
77. Toland, M. D., & De Ayala, R. J. (2005). A multilevel factor analysis of students' evaluations of teaching. Educational and Psychological Measurement, 65, 272-296.
78. Watkins, D. (1994). Student evaluations of teaching effectiveness: A cross-cultural perspective. Research in Higher Education, 35, 251-266.