Validating test score interpretations by cross-national comparison: Comparing the results of students from Japan and Germany on an American test of economic knowledge in higher education

Zeitschrift fur Psychologie / Journal of Psychology

Volumn 223, Issue 1, 2015, Pages 14-23

  Förster, Manuel ^a   Zlatkin Troitschanskaia, Olga ^a   Brückner, Sebastian ^a   Happ, Roland ^a   Hambleton, Ronald K ^b   Walstad, William B ^c   Asano, Tadayoshi ^d   Yamaoka, Michio ^e  

^a JOHANNES GUTENBERG UNIVERSITY MAINZ   (Germany)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^d Yamamura Gakuen College   (Japan)

^e WASEDA UNIVERSITY   (Japan)

Author keywords

Cross national assessment; Economic competence; Germany; Higher education; Japan

Indexed keywords

EID: 84922537263     PISSN: 21908370     EISSN: 21512604     Source Type: Journal    
DOI: 10.1027/2151-2604/a000195     Document Type: Article

References (31)

1. AERA, APA, & NCME. (2004). Standards for educational and psychological testing (2nd ed.). Washington, DC: American Psychological Association.
2. Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. New York, NY: Longman.
3. Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13, 186-203.
4. Behling, O., & Law, K. S. (2000). Translating Questionnaires and other research instruments: Problems and solutions. Thousand Oaks, CA: Sage.
5. Bereday, G. (1964). Comparative method in education. New York, NY: Holt, Rinehart, & Winston.
6. Blömeke, S., Gustafsson, J.-E., & Shavelson, R. (2015). Beyond dichotomies: Competence viewed as a continuum. Zeitschrift für Psychologie, 223, doi: 10.1027/2151-2604/a000194
7. Bloom, B. S., Englehart, M. B., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of Educational Objectives, the classification of educational goals - Handbook I: Cognitive domain. New York, NY: McKay.
8. Bray, M., Adamson, B., & Mason, M. (2007). Comparative education research - approaches and methods. Hong Kong, China: Springer.
9. Brown, T. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford.
10. Browne, M. W., & Cudeck, R. (1998). Alternative ways of assessing model fit. In K. A. Bollen (Ed.), Testing structural equation models (Sage focus editions, vol. 154, pp. 136-162). Newbury Park, CA: Sage.
11. Brückner, S., Förster, M., Zlatkin-Troitschanskaia, O., & Walstad, W. B. (in press). Effects of prior economic education, native language, and gender on economic knowledge of first-year students in higher education. A comparative study between Germany and the Unites States. In O. Zlatkin-Troitschanskaia & R. Shavelson (Eds.), Assessment of competence in higher education [Special issue]. Studies in Higher Education.
12. Dehon, C., McCathie, A., & Verardi, V. (2010). Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics, 83, 515-524.
13. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum- likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39, 1-38.
14. Finch, H. (2005). The MIMIC model as a method for detecting DIF: Comparison with Mantel-Haenszel, SIBTEST, and the IRT Likelihood Ratio. Applied Psychological Measurement, 29, 278-295. doi: 10.1177/0146621605275728
15. Frey, A., Hartig, J., & Rupp, A. A. (2009). Booklet designs in large-scale assessments of student achievement: Theory and practice. Educational Measurement: Issues and Practice, 28, 39-53.
16. Graham, J. W., Cumsille, P. E., & Elek-Fisk, E. (2003). Methods for handling missing data. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology. Research methods in psychology (Vol. 2, pp. 87-114). Hoboken, NJ: Wiley.
17. Hambleton, R. K. (2001). The next generation of the ITC test translation and adaption guidelines. European Journal of Psychological Assessment, 17, 164-172. doi: 10.1027/1015-5759.17.3.164
18. Hambleton, R. K., Merenda, P., & Spielberger, C. (2005). Adapting educational and psychological tests for crosscultural assessment (pp. 3-38). Mahwah, NJ: Erlbaum.
19. Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1-73.
20. Koeppen, K., Hartig, J., Klieme, E., & Leutner, D. (2008). Current issues in competence modeling and assessment. Zeitschrift für Psychologie, 216, 61-73. doi: 10.1027/0044-3409.216.2.61
21. Lin, Y.-H., Wilson, M., & Cheng, C.-L. (2013). An investigation of the nature of the influences of item stem and option representation on student responses to a mathematics test. European Journal of Psychological Education, 28, 1141-1161.
22. OECD. (2012). Assessment of Higher Education Learning Outcomes. Feasibility Study Report. Volume 1-Design and Implementation. Retrieved from http://www.oecd.org/edu/skills-beyond-school/AHELOFSReportVolume1.pdf
23. Owen, A. L. (2012). Student characteristics, behavior, and performance in economics classes. In G. M. Hoyt & K. McGoldrich (Eds.), International handbook on teaching and learning economics (pp. 341-350). Northampton, MA: Edward Elgar.
24. Rebeck, K., Walstad, W. B., Yamaoka, M., & Asano, T. (2009). An international comparison of university students' knowledge of economics: Japan and the United States. Bulletin of Yamamura Gakuen College, 20, 13-43.
25. Steinmetz, H. (2013). Analyzing observed composite differences across groups: Is partial measurement invariance enough? Methodology, 9, 1-12. doi: 10.1027/1614-2241/a000049
26. Walstad, W. B., Watts, M., & Rebeck, K. (2007). Test of understanding in college economics: Examiner's manual (4th ed.). New York, NY: National Council on Economic Education.
27. Weinert, F. E. (2001). Competencies and key competencies: Educational perspective. In N. J. Smelser & P. B. Baltes (Eds.), International Encyclopedia of the social and behavioral sciences (Vol. 4, pp. 2433-2436). Amsterdam, The Netherlands: Elsevier.
28. Woods, C. M. (2009). Evaluation of MIMIC-model methods for DIF testing with comparison to two-group analysis. Multivariate Behavioral Research, 44, 1-27.
29. Yamaoka, M., Walstad, W. B., Watts, M. W., Asano, T., & Abe, S. (Eds.). (2010). Comparative studies on economic education in Asia-Pacific region. Tokio, Japan: Shumpusha.
30. Zlatkin-Troitschanskaia, O., Förster, M., Brückner, S., & Happ, R. (2014). Insights from a German assessment of business and economics competence. In H. Coates (Ed.), Higher education learning outcomes assessment - international perspectives (pp. 175-197). Frankfurt am Main, Germany: Lang.
31. Zlatkin-Troitschanskaia, O., Förster, M., & Kuhn, C. (2013). Modeling and measurement of university students' subjectspecific competencies in the domain of business & economics - The ILLEV project. In S. Blömeke, O. Zlatkin-Troitschanskaia, C. Kuhn, & J. Fege (Eds.), Modeling and measuring competencies in higher education (pp. 159-170). Rotterdam, The Netherlands: Sense.