Student perceptions of classroom achievement goal structure: Is it appropriate to aggregate?

Journal of Educational Psychology

Volumn 107, Issue 4, 2015, Pages 1102-1115

  Lam, Arena C ^a   Ruzek, Erik A ^b   Schenke, Katerina ^a   Conley, Anne Marie M ^a   Karabenick, Stuart A ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Achievement goal theory; Classroom climate; Classroom goal structure; Factor analysis; Multilevel modeling

Indexed keywords

EID: 84924189479     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/edu0000028     Document Type: Article

References (71)

1. Ames, C. (1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84, 261-271. http://dx.doi.org/10.1037/0022-0663.84.3.261
2. Ames, C., & Archer, J. (1988). Achievement goals in the classroom: Students' learning strategies and motivation processes. Journal of Educational Psychology, 80, 260-267. http://dx.doi.org/10.1037/0022-0663.80.3.260
3. Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13, 186-203. http://dx.doi.org/10.1207/s15328007sem1302_2
4. WG and rWG(J) in leadership research and some best practice guidelines. The Leadership Quarterly, 23, 66-80. http://dx.doi.org/10.1016/j.leaqua.2011.11.006
5. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco, CA: Jossey-Bass.
6. Bong, M., Woo, Y., & Shin, J. (2013). Do students distinguish between different types of performance goals? Journal of Experimental Education, 81, 464-489. http://dx.doi.org/10.1080/00220973.2012.745464
7. Brophy, J. E. (1985). Teacher-student interaction. In J. B. Dusek (Ed.), Teacher expectancies (pp. 303-328). Hillsdale, NJ: Erlbaum.
8. California Department of Education. (2006). Public school summary statistics 2005-2006. Retrieved from http://www.cde.ca.gov/ds/sd/cb/sums05.asp
9. Church, M. A., Elliot, A. J., & Gable, S. L. (2001). Perceptions of classroom environment, achievement goals, and achievement outcomes. Journal of Educational Psychology, 93, 43-54. http://dx.doi.org/10.1037/0022-0663.93.1.43
10. Ciani, K. D., Middleton, M. J., Summers, J. J., & Sheldon, K. M. (2010). Buffering against performance classroom goal structures: The importance of autonomy support and classroom community. Contemporary Educational Psychology, 35, 88-99. http://dx.doi.org/10.1016/j.cedpsych.2009.11.001
11. Conley, A. M. (2012). Patterns of motivation beliefs: Combining achievement goal and expectancy-value perspectives. Journal of Educational Psychology, 104, 32-47. http://dx.doi.org/10.1037/a0026042
12. den Brok, P., Brekelmans, M., & Wubbels, T. (2006). Multilevel issues in research using students' perceptions of learning environments: The case of the Questionnaire on Teacher Interaction. Learning Environments Research, 9, 199-213. http://dx.doi.org/10.1007/s10984-0069013-9
13. Dorman, J. P. (2008). The effect of clustering on statistical tests: An illustration using classroom environment data. Educational Psychology, 28, 583-595. http://dx.doi.org/10.1080/01443410801954201
14. Dweck, C. S., & Leggett, E. L. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256-273. http://dx.doi.org/10.1037/0033-295X.95.2.256
15. Dyer, N. G., Hanges, P. J., & Hall, R. J. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16, 149-167. http://dx.doi.org/10.1016/j.leaqua.2004.09.009
16. Harackiewicz, J. M., Barron, K. E., Pintrich, P. R., Elliot, A. J., & Thrash, T. M. (2002). Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology, 94, 638-645. http://dx.doi.org/10.1037/0022-0663.94.3.638
17. Harter, S., Whitesell, N., & Kowalski, P. (1992). Individual differences in the effects of educational transitions on young adolescents' perceptions of competence and motivational orientation. American Educational Research Journal, 29, 777-807. http://dx.doi.org/10.3102/00028312029004777
18. Howes, C. (2000). Social-emotional classroom climate in child care, child-teacher relationships and children's second grade peer relations. Social Development, 9, 191-204. http://dx.doi.org/10.1111/1467-9507.00119
19. Hox, J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.
20. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118
21. James, D. L., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98. http://dx.doi.org/10.1037/0021-9010.69.1.85
22. Kane, T. J., & Cantrell, S. (2010). Learning about teaching: Initial findings from the Measures of Effective Teaching Project. Seattle, WA: Bill & Melinda Gates Foundation.
23. Kaplan, A., Gheen, M., & Midgley, C. (2002). Classroom goal structure and student disruptive behaviour. British Journal of Educational Psychology, 72, 191-211. http://dx.doi.org/10.1348/000709902158847
24. Kaplan, A., & Maehr, M. L. (2007). The contributions and prospects of goal orientation theory. Educational Psychology Review, 19, 141-184. http://dx.doi.org/10.1007/s10648-006-9012-5
25. Karabenick, S. A. (2003). Seeking help in large college classes: A person-centered approach. Contemporary Educational Psychology, 28, 37-58.
26. Karabenick, S. A. (2004). Perceived achievement goal structure and college student help seeking. Journal of Educational Psychology, 96, 569-581. http://dx.doi.org/10.1037/0022-0663.96.3.569
27. Karabenick, S. A., Wooley, M. E., Friedel, J. M., Ammon, B. V., Blazevski, J., Bonney, C. R., ... Kelly, K. L. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42, 139-151. http://dx.doi.org/10.1080/00461520701416231
28. Koskey, K. L. K., Karabenick, S. A., Woolley, M. E., Bonney, C. R., & Dever, B. V. (2010). Cognitive validity of students' self-reports of classroom mastery goal structure: What students are thinking and why it matters. Contemporary Educational Psychology, 35, 254-263. http://dx.doi.org/10.1016/j.cedpsych.2010.05.004
29. Lau, S., & Nie, Y. (2008). Interplay between personal goals and classroom goal structures in predicting student outcomes: A multilevel analysis of person-context interactions. Journal of Educational Psychology, 100, 15-29. http://dx.doi.org/10.1037/0022-0663.100.1.15
30. LeBreton, J. M., & Senter, J. L. (2008). Answers to 20 questions about interrater reliability and interrater agreement. Organizational Research Methods, 11, 815-852. http://dx.doi.org/10.1177/1094428106296642
31. Linnenbrink, E. A. (2005). The dilemma of performance-approach goals: The use of multiple contexts to promote students' motivation and learning. Journal of Educational Psychology, 97, 197-213. http://dx.doi.org/10.1037/0022-0663.97.2.197
32. Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203-229. http://dx.doi.org/10.1037/a0012869
33. Maehr, M. L., & Midgley, C. (1991). Enhancing student motivation: A school-wide approach. Educational Psychologist, 26, 399-427. http://dx.doi.org/10.1080/00461520.1991.9653140
34. Marsh, H. W., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Köller, O. (2012). Classroom Climate and Contextual Effects: Conceptual and Methodological Issues in the Evaluation of Group-Level Effects. Educational Psychologist, 47, 106-124. http://dx.doi.org/10.1080/00461520.2012.670488
35. Marshall, H. H., & Weinstein, R. S. (1986). Classroom context of student-perceived differential teacher treatment. Journal of Educational Psychology, 78, 441-453. http://dx.doi.org/10.1037/0022-0663.78.6.441
36. McHugh, R. M., Horner, C. G., Colditz, J. B., & Wallace, T. L. (2013). Bridges and barriers: Adolescent perceptions of student-teacher relationships. Urban Education, 48, 9-43. http://dx.doi.org/10.1177/0042085912451585
37. Meece, J. L. (1991). The classroom context and children's motivational goals. In M. L. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (Vol. 7, pp. 261-285). Greenwich, CT: JAI Press.
38. Meece, J. L., Anderman, E. M., & Anderman, L. H. (2006). Classroom goal structure, student motivation, and academic achievement. Annual Review of Psychology, 57, 487-503. http://dx.doi.org/10.1146/annurev.psych.56.091103.070258
39. Midgley, C., Maehr, M. L., Hicks, L., Roeser, R., Urdan, T., Anderman, E. M., & Kaplan, A. (1996). Patterns of Adaptive Learning Survey (PALS) manual. Ann Arbor, MI: University of Michigan.
40. Midgley, C., Maehr, M. L., Hruda, L. Z., Anderman, E., Anderman, L., Freeman, K. E., ... Urdan, T. (2000). Manual for the Patterns of Adaptive Learning Scales (PALS). Ann Arbor, MI: University of Michigan.
41. Miller, A. D., & Murdock, T. B. (2007). Modeling latent true scores to determine the utility of aggregate student perceptions as classroom indicators in HLM: The case of classroom goal structures. Contemporary Educational Psychology, 32, 83-104. http://dx.doi.org/10.1016/j.cedpsych.2006.10.006
42. Moos, R. H., & Moos, B. S. (1978). Classroom social climate and student absences and grades. Journal of Educational Psychology, 70, 263-269. http://dx.doi.org/10.1037/0022-0663.70.2.263
43. Morin, A. J. S., Marsh, H. W., Nagengast, B., & Scalas, L. F. (2014). Doubly latent multilevel analyses of classroom climate: An illustration. Journal of Experimental Education, 82, 143-167. http://dx.doi.org/10.1080/00220973.2013.769412
44. Murayama, K., & Elliot, A. J. (2009). The joint influence of personal achievement goals and classroom goal structures on achievement-related outcomes. Journal of Educational Psychology, 101, 432-447. http://dx.doi.org/10.1037/a0014221
45. Murayama, K., & Elliot, A. J. (2012). The competition-performance relation: A meta-analytic review and test of the opposing processes model of competition and performance. Psychological Bulletin, 138, 1035-1070. http://dx.doi.org/10.1037/a0028324
46. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338-354. http://dx.doi.org/10.1111/j.1745-3984.1991.tb00363.x
47. Muthén, L. K., & Muthén, B. O. (1998-2012). Mplus user's guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
48. Patrick, H., Anderman, L. H., Ryan, A. M., Edelin, K. C., & Midgley, C. (2001). Teachers' communication of goal orientations in four fifth-grade classrooms. The Elementary School Journal, 102, 35-58. http://dx.doi.org/10.1086/499692
49. Patrick, H., Kaplan, A., & Ryan, A. M. (2011). Positive classroom motivational environments: Convergence between mastery goal structure and classroom social climate. Journal of Educational Psychology, 103, 367-382. http://dx.doi.org/10.1037/a0023311
50. Patrick, H., Turner, J. C., Meyer, D. K., & Midgley, C. (2003). How teachers establish psychological environments during the first days of school: Associations with avoidance in mathematics. Teachers College Record, 105, 1521-1558. http://dx.doi.org/10.1111/1467-9620.00299
51. Pianta, R. C., Hamre, B. K., & Mintz, S. (2012). Classroom Assessment Scoring System secondary manual. Unpublished manuscript. Charlotsville, VA.
52. Pintrich, P. R. (2000). Multiple goals, multiple pathways: The role of goal orientation in learning and achievement. Journal of Educational Psychology, 92, 544-555. http://dx.doi.org/10.1037/0022-0663.92.3.544
53. Pulkka, A.-T., & Niemivirta, M. (2013). In the eye of the beholder: Do adult students' achievement goal orientation profiles predict their perceptions of instruction and studying? Studies in Educational Evaluation, 39, 133-143.
54. Ryan, A. M., Gheen, M. H., & Midgley, C. (1998). Why do some students avoid asking for help? An examination of the interplay among students' academic efficacy, teachers' social emotional role, and the classroom goal structure. Journal of Educational Psychology, 90, 528-535.
55. Ryan, A. M., & Patrick, H. (2001). The classroom social environment and changes in adolescents' motivation and engagement during middle school. American Educational Research Journal, 38, 437-460. http://dx.doi.org/10.3102/00028312038002437
56. Schweig, J. (2014). Cross-level measurement invariance in school and classroom environment surveys: Implications for policy and practice. Educational Evaluation and Policy Analysis, 36, 259-280. http://dx.doi.org/10.3102/0162373713509880
57. Schwinger, M., & Stiensmeier-Pelster, J. (2011). Performance-approach and performance-avoidance classroom goals and the adoption of personal achievement goals. British Journal of Educational Psychology, 81, 680-699. http://dx.doi.org/10.1111/j.2044-8279.2010.02012.x
58. Shim, S. S., Kiefer, S. M., & Wang, C. (2013). Help seeking among peers: The role of goal structure and peer climate. The Journal of Educational Research, 106, 290-300. http://dx.doi.org/10.1080/00220671.2012.692733
59. Shin, Y., & Raudenbush, S. W. (2010). A latent cluster-mean approach to the contextual effects model with missing data. Journal of Educational and Behavioral Statistics, 35, 26-53. http://dx.doi.org/10.3102/1076998609345252
60. Stuhlman, M., Downer, J., Schweig, J., & Martínez, J. F. (2013). Measuring effective teacher student interactions from a student perspective: A multi-level analysis. Paper presented at the annual meeting of the American Education Research Association, San Francisco, CA.
61. Turner, J. C., Gray, D. L., Anderman, L. H., Dawson, H. S., & Anderman, E. M. (2013). Getting to know my teacher: Does the relation between perceived mastery goal structures and teacher support change across the school year? Contemporary Educational Psychology, 38, 316-327. http://dx.doi.org/10.1016/j.cedpsych.2013.06.003
62. Turner, J. C., & Meyer, D. K. (2000). Studying and understanding the instructional contexts of classrooms: Using our past to forge our future. Educational Psychologist, 35, 69-85. http://dx.doi.org/10.1207/S15326985EP3502_2
63. Turner, J. C., Midgley, C., Meyer, D. K., Gheen, M., Anderman, E. M., Kang, Y., & Patrick, H. (2002). The classroom environment and students' reports of avoidance strategies in mathematics: A multimethod study. Journal of Educational Psychology, 94, 88-106. http://dx.doi.org/10.1037/0022-0663.94.1.88
64. Urdan, T. (2004). Using multiple methods to assess students' perceptions of classroom goal structures. European Psychologist, 9, 222-231. http://dx.doi.org/10.1027/1016-9040.9.4.222
65. Urdan, T. (2010). The challenges and promise of research on classroom goal structure. In J. L. Meece & J. S. Eccles (Eds.), Handbook of research on schools, schooling and human development (1st ed., pp. 92-108). New York, NY: Routledge.
66. Urdan, T., Kneisel, L., & Mason, V. (1999). Interpreting messages about motivation in the classroom: Examining the effects of achievement goal structures. In T. Urdan (Ed.), Advances in motivation and achievement (Vol. 11, pp. 123-158). Stanford, CT: JAI Press.
67. Urdan, T., Midgley, C., & Anderman, E. M. (1998). The role of classroom goal structure in students' use of self-handicapping strategies. American Educational Research Journal, 35, 101-122.
68. Urdan, T., & Schoenfelder, E. (2006). Classroom effects on student motivation: Goal structures, social relationships, and competence beliefs. Journal of School Psychology, 44, 331-349. http://dx.doi.org/10.1016/j.jsp.2006.04.003
69. U.S. Census Bureau. (2009). U.S. 2009 national population projections. Retrieved from http://www.census.gov/population/projections/data/national/2009.html
70. Wagner, W., Göllner, R., Helmke, A., Trautwein, U., & Lüdtke, O. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1-11. http://dx.doi.org/10.1016/j.learninstruc.2013.03.003
71. Wolters, C. A. (2004). Advancing achievement goal theory: Using goal structures and goal orientations to predict students' motivation, cognition, and achievement. Journal of Educational Psychology, 96, 236-250. http://dx.doi.org/10.1037/0022-0663.96.2.236