A cross-cultural examination of the psychometric properties of responses to the achievement goal questionnaire

Educational and Psychological Measurement

Volumn 69, Issue 2, 2009, Pages 266-286

  Murayama, Kou ^a   Zhou, Mingming ^b   Nesbit, John C ^b  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Achievement goals; Multigroup confirmatory factor analysis; Validity

Indexed keywords

EID: 62849115474     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164408322017     Document Type: Article

References (79)

1. Ames, C. (1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84, 261-271.
2. Ames, C., & Archer, J. (1988). Achievement goals in the classroom: Students' learning strategies and motivation processes. Journal of Educational Psychology, 80, 260-267.
3. Attenweiler, W.J., & Moore, D. (2006). Goal orientations: Two, three, or more factors? Educational and Psychological Measurement, 66, 342-352.
4. Brett, J.F., & VandeWalle, D. (1999). Goal orientation and goal content as predictors of performance in a training program. Journal of Applied Psychology, 84, 863-873.
5. Brislin, R.W. (1980). Translation and content analysis of oral and written materials. In H. Triandis & J. W. Berry (Eds.), Handbook of cross-cultural psychology (Vol. 2., pp. 389-444). Boston: Allyn & Bacon.
6. Brown, T.A. (2006). Confirmatory factor analysis for applied research. New York: Guilford.
7. Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Beverley Hills, CA: Sage.
8. Button, S.B., Mathieu, J.E., & Zajac, D.M. (1996). Goal orientation in organizational research: A conceptual and empirical foundation. Organizational Behavior and Human Decision Processes, 67, 26-48.
9. Byrne, B.M. (1998). Structural equation modeling with LISREL, PRELIS and SIMPLIS: Basic concepts, applications and programming. Mahwah, NJ: Lawrence Erlbaum.
10. Byrne, B.M. (2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural Equation Modeling, 11, 272-300.
11. Byrne, B.M., & Campbell, T.L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology, 30, 555-574.
12. Byrne, B.M., Shavelson, R.J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
13. Cheung, G.W., & Rensvold, R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
14. Cheung, M.W.L., & Chan, W. (2002). Reducing uniform response bias with ipsative measurement in multiple group confirmatory factor analysis. Structural Equation Modeling, 9, 55-77.
15. Clark, L.A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319.
16. Cronbach, L.J., & Meehl, P.E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
17. Cury, F., Elliot, A.J., Da Fonseca, D., & Moller, A. (2006). The social-cognitive model of achievement motivation and the 2 -2 achievement goal framework. Journal of Personality and Social Psychology, 90, 666-679.
18. Day, E.A., Radosevich, D.J., & Chasteen, C.S. (2003). Construct- and criterion-related validity of four commonly used goal orientation instruments. Contemporary Educational Psychology, 28, 434-464.
19. DeCarlo, L.T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2, 292-307.
20. Dweck, C.S. (1986). Motivational processes affecting learning. American Psychologist, 41, 1040-1048.
21. Dweck, C.S., & Leggett, E. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256-273.
22. Dwyer, M. (2007). Our 17th annual rankings. Maclean's, 120 (45). 100-116.
23. Elliot, A.J., Chirkov, V.I., Kim, Y., & Sheldon, K.M. (2001). A cross-cultural analysis of avoidance (relative to approach) personal goals. Psychological Science, 12, 505-510.
24. Elliot, A.J., & Church, M.A. (1997). A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology, 72, 218-232.
25. Elliot, A.J., & Harackiewicz, J.M. (1996). Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology, 70, 461-475.
26. Elliot, A.J., & McGregor, H.A. (2001). A 2 - 2 achievement goal framework. Journal of Personality and Social Psychology, 80, 501-519.
27. Elliot, A.J., & Murayama, K. (in press). On the measurement of achievement goals: Critique, illustration, and application. Journal of Educational Psychology.
28. Fan, X., & Thompson, B. (2001). Confidence intervals about score reliability coefficients, please: An EPM guidelines editorial. Educational and Psychological Measurement, 61, 517-531.
29. Finney, S.J., Pieper, S.L., & Barron, K. (2004). Examining the psychometric properties of the Achievement Goal Questionnaire in a general academic context. Educational and Psychological Measurement, 64, 365-382.
30. Graham, J.M., Guthrie, A.C., & Thompson, B. (2003). Consequences of not interpreting structure coefficients in published CFA research: A reminder. Structural Equation Modeling, 10, 142-153.
31. Grouzet, F.M., Kasser, T., Ahuvia, A., Dols, J.M., Kim, Y. Lau, S., et al. (2005). The structure of goals across 15 cultures. Journal of Personality and Social Psychology, 89, 800-816.
32. Hancock, G.R. (1997). Structural equation modeling methods of hypothesis testing of latent variable means. Measurement and Evaluation in Counseling and Development, 30, 91-105.
33. Harackiewicz, J.M., Barron, K.E., Carter, S.M., Lehot, A.T., & Elliot, A.J. (1997). Predictors and consequences of achievement goals in the college classroom: Maintaining interest and making the grade. Journal of Personality and Social Psychology, 73, 1284-1295.
34. Heine, S.J., Lehman, D.R., Markus, H.R., & Kitayama, S. (1999). Is there a universal need for positive self-regard ? Psychological Review, 106, 766-794.
35. Heine, S.J., Lehman, D.R., Peng, K., & Greenholtz, J. (2002). What's wrong with cross-cultural comparisons of subjective Likert scales: The reference-group problem. Journal of Personality and Social Psychology, 82, 903-918.
36. Henson, R.K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
37. Henson, R.K. (2006). Effect-size measures and meta-analytic thinking in counseling psychology research. Counseling Psychologist, 34, 601-629.
38. Hong, S., Malik, M.L., & Lee, M. (2003). Testing configural, metric, scalar, and latent mean invariance across genders in sociotropy and autonomy using a non-Western sample. Educational and Psychological Measurement, 63, 636-654.
39. Horn, J.L. (1991). Comments on ''Issues in factorial invariance''. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 114-125). Washington, DC: American Psychological Association.
40. Horn, J.L., & McArdle, J.J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117-144.
41. Horn, J.L., McArdle, J., & Mason, R. (1983). When is invariance not invariant: A practical scientist's look at the ethereal concept of factor invariance. Southern Psychologist, 1, 179-188.
42. Horvath, M., Scheu, C.R., & DeShon, R.P. (2001, April). Goal orientation: Integrating theory and measurement. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
43. Hoyle, R.H. (2005). Applications of structural equation modeling in clinical and health psychology research. In J. Miles & P. Gilbert (Eds.), A handbook of research methods for clinical and health psychology (pp. 261-278). New York: Oxford University Press.
44. Hu, L., & Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
45. Hu, L., & Bentler, P.M. (1999). Cutoff criterion for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
46. Hui, C.H., & Triandis, H.C. (1985). Measurement in cross-cultural psychology. Journal of Cross-Cultural Psychology, 16, 131-152.
47. Hurley, A.E., Scandura, T.A., Schriesheim, C.A., Brannick, M.T., Seers, A., Vandenberg, R.J., et al. (1997). Exploratory and confirmatory factor analysis: Guidelines, issues, alternatives. Journal of Organizational Behavior, 18, 667-683.
48. Jöreskog, K.G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409-426.
49. Linnenbrink, E.A., & Pintrich, P.R. (2000). Multiple pathways to learning and achievement: The role of goal orientation in fostering adaptive motivation, affect, and cognition. In C. Sansone & J. M. Harackiewicz (Eds.), Intrinsic and extrinsic motivation: The search for optimal motivation and performance (pp. 195-227). San Diego, CA: Academic Press.
50. Little, T.D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
51. Maehr, M.L. (1989). Thoughts about motivation. In C. Ames & R. Ames (Eds.), Research on motivation in education (Vol. 3). New York: Academic Press.
52. Maehr, M.L., & Nicholls, J.G. (1980). Culture and achievement motivation: A second look. In N. Warren (Ed.), Studies in cross-cultural psychology (Vol. 2, pp. 221-267). New York: Academic Press.
53. Mardia, K.V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57, 519-530.
54. Markus, H.R., & Kitayama, S. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224-253.
55. Marsh, H.W. (1993). The multidimensional structure of academic self-concept: Invariance over gender and age. American Educational Research Journal, 30, 841-860.
56. Matsumoto, D., & Yoo, S.H. (2006). Toward a new generation of cross-cultural research. Perspectives on Psychological Science, 1, 234-250.
57. Meece, J.L., Blumenfeld, P.C., & Hoyle, R.H. (1988). Students' goal orientations and cognitive engagement in classroom activities. Journal of Educational Psychology, 80, 514-523.
58. Middleton, M., & Midgley, C. (1997). Avoiding the demonstration of lack of ability: An underexplored aspect of goal theory. Journal of Educational Psychology, 89, 710-718.
59. Midgley, C., Kaplan, A., Middleton, M., Maehr, M.L., Urdan, T., Anderman, L.H., et al. (1998). The development and validation of scales assessing students' achievement goal orientations. Contemporary Educational Psychology, 23, 113-131.
60. Murayama, K. (2003). Testing of undifferentiated performance-goal hypothesis. Developmental Studies in Social Motivation, 2, 3-11.
61. Muthén, L.K., & Muthén, B.O. (2004). Mplus statistical analysis with latent variables: User's guide. Los Angeles: Statmodel.
62. Nesbit, J.C., Winne, P.H., Jamieson-Noel, D., Code, J., Zhou, M., MacAllister, K., et al. (2007). Using cognitive tools in gStudy to investigate how study activities covary with achievement goals. Journal of Educational Computing Research, 35, 339-358.
63. Nicholls, J.G. (1989). The competitive ethos and democratic education. Cambridge, MA: Harvard University Press.
64. Nunnally, J.C. (1978). Introduction to psychological measurement. New York: McGraw-Hill.
65. Pekrun, R., Elliot, A.J., & Maier, M.A. (2006). Achievement goals and discrete achievement emotions: A theoretical model and prospective test. Journal of Educational Psychology, 98, 583-597.
66. Peng, K., Nisbett, R., & Wong, N. (1997). Validity problems comparing value across cultures and possible solutions. Psychological Methods, 2, 329-344.
67. Satorra, A., & Bentler, P.M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514.
68. Schwartz, S., & Blisky, W. (1990). Toward a theory of the universal content and structure of values: Extensions and cross-cultural replications. Journal of Personality and Social Psychology, 58, 878-891.
69. Steenkamp, J.E.M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78-90.
70. Tanaka, A., Okuno, T., & Yamauchi, H. (2002). Achievement motives, cognitive and social competence, and achievement goals in the classroom. Perceptual and Motor Skills, 95, 445-458.
71. Tanaka, A., & Yamauchi, H. (2001). A model for achievement motives, goal orientations, intrinsic interest, and academic achievement. Psychological Reports, 88, 123-135.
72. Urdan, T. (1997). Achievement goal theory: Past results, future directions. In M. L. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (Vol. 10, pp. 99-141). Greenwich, CT: JAI Press.
73. Urdan, T. (2004). Predictors of academic self-handicapping and achievement: Examining achievement goals, classroom goal structures, and culture. Journal of Educational Psychology, 96, 251-264.
74. Urdan, T., & Mestas, M. (2006). The goals behind performance goals. Journal of Educational Psychology, 98, 354-365.
75. Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70.
76. VandeWalle, D. (1997). Development and validation of a work domain goal orientation instrument. Educational and Psychological Measurement, 57, 995-1015.
77. VandeWalle, D., Cron, W.L., & Slocum, J.W. (2001). The role of goal orientation following feedback. Journal of Applied Psychology, 86, 629-640.
78. Van Yperen, N.W. (2006). A novel approach to assessing achievement goals in the context of the 2 - 2 framework: Identifying distinct profiles of individuals with different dominant achievement goals. Personality and Social Psychology Bulletin, 32, 1432-1445.
79. Weiner, B. (1990). History of motivational research in education. Journal of Educational Psychology, 82, 616-622.