Multiple evaluations of grant proposals by independent assessors: Confirmatory factor analysis evaluations of reliability, validity, and structure

Multivariate Behavioral Research

Volumn 34, Issue 1, 1999, Pages 1-30

  Marsh, Herbert W ^a   Bazeley, Patricia ^b  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0033240040     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327906mbr3401_1     Document Type: Article

References (32)

1. Bagozzi, R. P. (1993). An examination of the psychometric properties of measures of negative affect in the PANAS-X Scales. Journal of Personality and Social Psychology, 65, 836-851.
2. Bazeley, P., Kemp, L., Stevens, K., Asmar, C., Grbich, C., Marsh, H. W., & Bhatal, R. (1996). Waiting in the wings: A study of early career academic researchers in Australia (commissioned Report No. 50). Canberra, ACT: National Board of Employment, Education and Training
3. Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin. 107, 238-246.
4. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
5. Carmines, E. G. & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.
6. Cicchetti, D. V. (1991a). The reliability of peer review for manuscript and grant submissions: A cross-disciplinary investigation. Behavioral and Brain Sciences, 14, 119-135.
7. Cicchetti, D. V. (1991b). Reflections from the peer review mirror. Behavioral and Brain Sciences, 14, 167-186.
8. Gottfredson, S. D. (1978). Evaluating psychological research reports: Dimensions, reliability, and correlates of quality judgments. American Psychologist, 33, 920-934.
9. Gustafsson, J-E., & Stahl, P. A. (1996). Structural equation modeling made simple (STREAMS 1.62). Goteborg University & Multivariate Ware HB.
10. Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 409-426.
11. Jöreskog, K. G. (1974). Analyzing psychological data by structural analysis of covariance matrices. In R. C. Atkinson, D. H. Krantz, R.D. Luce, & Suppes (Eds.), Contemporary developments in mathematical psychology (Vol. 2, pp. 1-56). San Fransisco: W. H. Freeman.
12. Jöreskog, K. G., & Sörbom, D. (1989). LISREL 7: A guide to the program and applications. Chicago: SPSS.
13. Kaplan, D. & Elliott, P. R. ( 1997). A didactic example of multilevel structural equation modeling applicable to the study of organizations. Structural Equation Modeling, 4, 1-24.
14. Marsh, H. W. (1985). The structure of masculinity/femininity: An application of confirmatory factor analysis to higher-order factor structures and factorial invariance. Multivariate Behavioral Research, 20, 427-449.
15. Marsh, H. W. (1986). The bias of negatively worded items in rating scales for young children: A cognitive-developmental phenomena. Developmental Psychology, 22, 37-49.
16. Marsh, H. W. (1989). Confirmatory factor analyses of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13, 335-361.
17. Marsh, H. W. (1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors. Journal of Personality and Social Psychology, 70, 810-819.
18. Marsh, H. W. & Ball, S. (1981). Interjudgmental reliability of for the Journal of Educational Psychology. Journal of Educational Psychology, 73, 872-880.
19. Marsh, H. W. & Ball, S. (1989). The peer review process use to evaluate manuscripts submitted to academic journals. Journal of Experimental Educational, 57, 151-169.
20. Marsh, H. W. & Ball, S. (1991). Reflections on the peer review process. Behavioral and Brain Sciences, 14, 157-158.
21. Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391-410.
22. Marsh, H. W. & Grayson, D. (1995). Latent-variable models of multitrait-multimethod data. In R. H. Hoyle (Ed.), Structural equation modeling: Issues and applications (pp. 177-198). Newbury, CA,. Sage.
23. McDonald, R. P. (1985). Factor analysis and related methods. Hillsdale, NJ: Erlbaum.
24. McDonald, R. P. & Marsh, H. W. (1990). Choosing a multivariate model: Noncentrality and goodness-of-fit. Psychological Bulletin, 107, 247-255.
25. Miller, M. B. (1995). Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling. Structural Equation Modeling, 2, 255-273.
26. Muthén, B. (1994). Multilevel covariance structure analysis. Sociological Methods and Research, 22, 376-398.
27. Raykov, T. (1997a). Composite reliability, Cronbach's coefficient alpha, and violations of essential tau-equivalence with fixed congeneric components. Multivariate Behavioral Research, 32, 329-353.
28. Raykov, T. (1997b). Estimating composite reliability for congeneric measures. Applied Psychological Measurement, 21, 173-184.
29. Rosenthal, R. (1991). Some indices of the reliability of peer review. Behavioral and Brain Sciences, 14, 160-161.
30. Thorndike, R. L. & Thorndike, R. M. (1997). Reliability. In J. P. Keeves (Ed.), Educational research, methodology, and measurement (2nd ed.)(pp. 775-790). Cambridge, UK: Cambridge University Press.
31. Watson, D. & Clark, L. (1992). Affects separable and inseparable: On the hierarchical arrangement of negative affects. Journal of Personality and Social Psychology, 62, 489-505.
32. Winer, B. J., Brown, D. R., & Michels, K. M. (1991). Statistical principles in experimental design (3rd ed). McGraw-Hill, New York.