The longitudinal interplay of students' academic self-concepts and achievements within and across domains: Replicating and extending the reciprocal internal/external frame of reference model

Journal of Educational Psychology

Volumn 106, Issue 4, 2014, Pages 1170-1191

  Niepel, Christoph ^a   Brunner, Martin ^b   Preckel, Franzis ^a  

^a UNIVERSITY OF TRIER   (Germany)

^b FREIE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Achievement; Longitudinal data; Mathematics self concept; Reciprocal internal external frame of reference model; Verbal self concept

Indexed keywords

EID: 84925660610     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/a0036307     Document Type: Article

References (73)

1. Becker, M., Lüdtke, O., Trautwein, U., Köller, O., & Baumert, J. (2012). The differential effects of school tracking on psychometric intelligence: Do academic-track schools make students smarter? Journal of Educational Psychology, 104, 682-699. doi:10.1037/a0027608
2. Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: Wiley.
3. Bonett, D. G. (2012). Replication-extension studies. Current Directions in Psychological Science, 21, 409-412. doi:10.1177/0963721412459512
4. Brunner, M., Keller, U., Dierendonck, C., Reichert, M., Ugen, S., Fischbach, A., & Martin, R. (2010). The structure of academic self-concepts revisited: The nested Marsh/Shavelson model. Journal of Educational Psychology, 102, 964-981. doi:10.1037/a0019644
5. Byrne, B. M. (1996). Academic self-concept: Its structure, measurement, and relation to academic achievement. In B. A. Bracken (Ed.), Handbook of self-concept: Developmental, social, and clinical considerations (pp. 287-316). Oxford, England: Wiley.
6. Byrne, B. M. (2002). Validating the measurement and structure of selfconcept: Snapshots of past, present, and future research. American Psychologist, 57, 897-909. doi:10.1037/0003-066X.57.11.897
7. Calsyn, R. J., & Kenny, D. A. (1977). Self-concept of ability and perceived evaluation of others: Cause or effect of academic achievement? Journal of Educational Psychology, 69, 136-145. doi:10.1037/0022-0663.69.2 .136
8. Caspi, A., Roberts, B. W., & Shiner, R. L. (2005). Personality development: Stability and change. Annual Review of Psychology, 56, 453-484. doi:10.1146/annurev.psych.55.090902.141913
9. Chiu, M.-S. (2012). The internal/external frame of reference model, bigfish-little-pond effect, and combined model for mathematics and science. Journal of Educational Psychology, 104, 87-107. doi:10.1037/ a0025734
10. Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330-351. doi:10.1037/1082-989X.6.4.330
11. Cronbach, L. J. (1976). Research on classrooms and schools: Formulation of questions, designs, and analysis. Stanford, CA: Stanford Evaluation Consortium, Stanford University.
12. Dickhäuser, O., & Plenter, I. (2005). "Letztes Halbjahr stand ich zwei". Zur Akkuratheit selbst berichteter Noten ["Last term I had a B": On the accuracy of self-reported school grades]. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology, 19, 219-224. doi:10.1024/1010-0652.19.4.219
13. Eccles, J. S. (1994). Understanding women's educational and occupational choices. Psychology of Women Quarterly, 18, 585-609. doi:10.1111/j .1471-6402.1994.tb01049.x
14. Goetz, T., Preckel, F., Zeidner, M., & Schleyer, E. (2008). Big fish in big ponds: A multilevel analysis of test anxiety and achievement in special gifted classes. Anxiety, Stress & Coping, 21, 185-198. doi:10.1080/ 10615800701628827
15. Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576. doi:10.1146/annurev .psych.58.110405.085530
16. Guay, F., Marsh, H. W., & Boivin, M. (2003). Academic self-concept and academic achievement: Developmental perspectives on their causal ordering. Journal of Educational Psychology, 95, 124-136. doi:10.1037/ 0022-0663.95.1.124
17. Helmke, A. (1992). Selbstvertrauen und schulische Leistungen [Selfconfidence and academic attainment]. Göttingen, Germany: Hogrefe.
18. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
19. Huang, C. (2011). Self-concept and academic achievement: A metaanalysis of longitudinal relations. Journal of School Psychology, 49, 505-528. doi:10.1016/j.jsp.2011.07.001
20. Ireson, J., & Hallam, S. (2009). Academic self-concepts in adolescence: Relations with achievement and ability grouping in schools. Learning and Instruction, 19, 201-213. doi:10.1016/j.learninstruc.2008.04.001
21. Kaplan, D. (2009). Structural equation modeling: Foundations and extensions (2nd ed.). Los Angeles, CA: Sage.
22. Kenny, D. A. (1975). Cross-lagged panel correlation: A test for spuriousness. Psychological Bulletin, 82, 887-903. doi:10.1037/0033-2909.82.6 .887
23. Köller, O., Klemmert, H., Möller, J., & Baumert, J. (1999). Eine längsschnittliche Überprüfung des Modells des Internal/External Frame of Reference [Achievement feedback and academic self-concepts: A longitudinal test of the internal/external frame of reference model]. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology, 13, 128-134. doi:10.1024//1010-0652.13.3.128
24. Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A metaanalysis and review of the literature. Review of Educational Research, 75, 63-82. doi:10.3102/00346543075001063
25. Kunter, M., Schümer, G., Artelt, C., Baumert, J., Klieme, E., Neubrand, M., . . . Weiß, M. (2002). PISA 2000: Dokumentation der Erhebungsinstrumente [PISA 2000: Documentation of assessment tools]. Berlin, Germany: Max-Planck-Institut für Bildungsforschung.
26. Legewie, J. (2012). Die Schätzung von kausalen Effekten: Überlegungen zu Methoden der Kausalanalyse anhand von Kontexteffekten in der Schule [The estimation of causal effects: An introduction to methods of causal inference based on peer effects in education]. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 64, 123-153. doi:10.1007/s11577-012-0158-5
27. Little, R. J. A. (1995). Modeling the drop-out mechanism in repeatedmeasures studies. Journal of the American Statistical Association, 90, 1112-1121. doi:10.1080/01621459.1995.10476615
28. Little, T. D., Preacher, K. J., Selig, J. P., & Card, N. A. (2007). New developments in latent variable panel analyses of longitudinal data. International Journal of Behavioral Development, 31, 357-365. doi: 10.1177/0165025407077757
29. Lubinski, D., & Benbow, C. P. (2000). States of excellence. American Psychologist, 55, 137-150. doi:10.1037/0003-066X.55.1.137
30. Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7, 537-542. doi:10.1177/1745691612460688
31. Marsh, H. W. (1990). Self-Description Questionnaire (SDQ) II: A theoretical and empirical basis for the measurement of multiple dimensions of adolescent self-concept-An interim test manual and a research monograph. San Antonio, TX: Psychological Corporation.
32. Marsh, H. W. (1991). Failure of high-ability high schools to deliver academic benefits commensurate with their students' ability levels. American Educational Research Journal, 28, 445-480. doi:10.3102/ 00028312028002445
33. Marsh, H. W. (2006). Self-concept theory, measurement and research into practice: The role of self-concept in educational psychology. Leicester, England: British Psychological Society.
34. Marsh, H. W., & Craven, R. G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1, 133-163. doi:10.1111/j.1745-6916.2006.00010.x
35. Marsh, H. W., & Hau, K.-T. (2004). Explaining paradoxical relations between academic self-concepts and achievements: Cross-cultural generalizability of the internal/external frame of reference predictions across 26 countries. Journal of Educational Psychology, 96, 56-67. doi: 10.1037/0022-0663.96.1.56
36. Marsh, H. W., & Köller, O. (2004). Unification of theoretical models of academic self-concept/achievement relations: Reunification of East and West German school systems after the fall of the Berlin Wall. Contemporary Educational Psychology, 29, 264 -282. doi:10.1016/S0361-476X(03)00034-1
37. Marsh, H. W., & Martin, A. J. (2011). Academic self-concept and academic achievement: Relations and causal ordering. British Journal of Educational Psychology, 81, 59-77. doi:10.1348/000709910X503501
38. Marsh, H. W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K.-T., O'Mara, A. J., & Craven, R. G. (2008). The big-fish-little-pond-effect stands up to critical scrutiny: Implications for theory, methodology, and future research. Educational Psychology Review, 20, 319-350. doi:10.1007/ s10648-008-9075-6
39. Marsh, H. W., Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2005). Academic self-concept, interest, grades, and standardized test scores: Reciprocal effects models of causal ordering. Child Development, 76, 397-416. doi:10.1111/j.1467-8624.2005.00853.x
40. Marsh, H. W., Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006). Integration of multidimensional self-concept and core personality constructs: Construct validation and relations to well-being and achievement. Journal of Personality, 74, 403-456. doi:10.1111/j.1467-6494 .2005.00380.x
41. Marsh, H. W., & Yeung, A. S. (1997). Coursework selection: Relations to academic self-concept and achievement. American Educational Research Journal, 34, 691-720. doi:10.3102/00028312034004691
42. Marsh, H. W., & Yeung, A. S. (1998). Longitudinal structural equation models of academic self-concept and achievement: Gender differences in the development of math and English constructs. American Educational Research Journal, 35, 705-738. doi:10.3102/ 00028312035004705
43. McArdle, J. J. (1994). Structural factor analysis experiments with incomplete data. Multivariate Behavioral Research, 29, 409 - 454. doi: 10.1207/s15327906mbr2904_5
44. McArdle, J. J., & Grimm, K. J. (2010). Five steps in latent curve and latent change score modeling with longitudinal data. In K. van Montfort, A. Satorra, & J. H. L. Oud (Eds.), Longitudinal research with latent variables (pp. 245-273). doi:10.1007/978-3-642-11760-2_8
45. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543. doi:10.1007/BF02294825
46. Meredith, W., & Horn, J. (2001). The role of factorial invariance in modeling growth and change. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change (pp. 203-240). doi:10.1037/ 10409-007
47. Möller, J., & Köller, O. (2001a). Dimensional comparisons: An experimental approach to the internal/external frame of reference model. Journal of Educational Psychology, 93, 826-835. doi:10.1037/0022-0663.93.4.826
48. Möller, J., & Köller, O. (2001b). Frame of reference effects following the announcement of exam results. Contemporary Educational Psychology, 26, 277-287. doi:10.1006/ceps.2000.1055
49. Möller, J., & Marsh, H. W. (2013). Dimensional comparison theory. Psychological Review, 120, 544-560. doi:10.1037/a0032459
50. Möller, J., Pohlmann, B., Köller, O., & Marsh, H. W. (2009). A metaanalytic path analysis of the internal/external frame of reference model of academic achievement and academic self-concept. Review of Educational Research, 79, 1129-1167. doi:10.3102/0034654309337522
51. Möller, J., Retelsdorf, J., Köller, O., & Marsh, H. W. (2011). The reciprocal internal/external frame of reference model: An integration of models of relations between academic achievement and self-concept. American Educational Research Journal, 48, 1315-1346. doi:10.3102/ 0002831211419649
52. Möller, J., Streblow, L., Pohlmann, B., & Köller, O. (2006). An extension to the internal/external frame of reference model to two verbal and numerical domains. European Journal of Psychology of Education, 21, 467-487. doi:10.1007/BF03173515
53. Muthén, L. K., & Muthén, B. O. (1998 -2012a). Mplus user's guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
54. Muthén, L. K., & Muthén, B. O. (1998 -2012b). Mplus Version 7 [statistical software]. Los Angeles, CA: Muthén & Muthén.
55. Muthén, L. K., & Muthén, B. O. (2006). Mplus: Statistical analysis with latent variables. Los Angeles, CA: Muthén & Muthén.
56. O'Mara, A. J., Marsh, H. W., Craven, R. G., & Debus, R. L. (2006). Do self-concept interventions make a difference? A synergistic blend of construct validation and meta-analysis. Educational Psychologist, 41, 181-206. doi:10.1207/s15326985ep4103_4
57. Organisation for Economic Cooperation and Development. (2001). Knowledge and skills for life: First results from the OECD Programme for International Student Assessment (PISA) 2000. Paris, France: Author.
58. Oud, J. H. L., & Delsing, M. J. M. H. (2010). Continuous time modeling of panel data by means of SEM. In K. van Montfort, A. Satorra, & J. H. L. Oud (Eds.), Longitudinal research with latent variables (pp. 201-244). doi:10.1007/978-3-642-11760-2_7
59. Pashler, H., & Harris, C. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science, 7, 531-536. doi:10.1177/1745691612463401
60. Pohlmann, B., & Möller, J. (2009). On the benefit of dimensional comparisons. Journal of Educational Psychology, 101, 248 -258. doi: 10.1037/a0013151
61. Preckel, F., Götz, T., & Frenzel, A. (2010). Ability grouping of gifted students: Effects on academic self-concept and boredom. British Journal of Educational Psychology, 80, 451- 472. doi:10.1348/ 000709909X480716
62. Proctor, C. P., August, D., Carlo, M. S., & Snow, C. (2006). The intriguing role of Spanish language vocabulary knowledge in predicting English reading comprehension. Journal of Educational Psychology, 98, 159- 169. doi:10.1037/0022-0663.98.1.159
63. Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514. doi:10.1007/BF02296192
64. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
65. Snyder, K. E., & Linnenbrink-Garcia, L. (2013). A developmental, personcentered approach to exploring multiple motivational pathways in gifted underachievement. Educational Psychologist, 48, 209 -228. doi: 10.1080/00461520.2013.835597
66. Trautwein, U., & Lüdtke, O. (2007). Students' self-reported effort and time on homework in six school subjects: Between-students differences and within-student variation. Journal of Educational Psychology, 99, 432- 444. doi:10.1037/0022-0663.99.2.432
67. Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006). Self-esteem, academic self-concept, and achievement: How the learning environment moderates the dynamics of self-concept. Journal of Personality and Social Psychology, 90, 334-349. doi:10.1037/0022-3514.90.2.334
68. Trautwein, U., Lüdtke, O., Marsh, H. W., Köller, O., & Baumert, J. (2006). Tracking, grading, and student motivation: Using group composition and status to predict self-concept and interest in ninth-grade mathematics. Journal of Educational Psychology, 98, 788-806. doi:10.1037/0022-0663.98.4.788
69. Trautwein, U., Lüdtke, O., Roberts, B. W., Schnyder, I., & Niggli, A. (2009). Different forces, same consequence: Conscientiousness and competence beliefs are independent predictors of academic effort and achievement. Journal of Personality and Social Psychology, 97, 1115- 1128. doi:10.1037/a0017048
70. Valentine, J. C., DuBois, D. L., & Cooper, H. (2004). The relation between self-beliefs and academic achievement: A meta-analytic review. Educational Psychologist, 39, 111-133. doi:10.1207/s15326985ep3902_3
71. Wagner, J. W. L. (2001). Leistungsvergleiche in der Schule. Bezugsgruppeneffekte und Fähigkeitskonzepte [Comparisons of achievement in school: Reference-group effects and academic self-concepts]. Landau, Germany: Verlag Empirische Pädagogik.
72. Widaman, K. F., & Reise, S. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In K. J. Bryant, M. Windle, & S. G. West (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). doi:10.1037/10222-009
73. Xu, M. K., Marsh, H. W., Hau, K.-T., Ho, I. T., Morin, A. J. S., & Abduljabbar, A. S. (2013). The internal/external frame of reference of academic self-concept: Extension to a foreign language and the role of language of instruction. Journal of Educational Psychology, 105, 489- 503. doi:10.1037/a0031333