Measuring socioeconomic background in PISA: One size might not fit all

Research in Comparative and International Education

Volumn 8, Issue 3, 2013, Pages 259-278

  Rutkowski, David ^a   Rutkowski, Leslie ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84886937570     PISSN: None     EISSN: 17454999     Source Type: Journal    
DOI: 10.2304/rcie.2013.8.3.259     Document Type: Article

References (66)

1. Adams, R. & Wu, M. (Eds) (2002) PISA 2000 Technical Report. Paris: OECD Publications.
2. American Psychological Association (2012) Socioeconomic Status Office. http://www.apa.org/pi/ses/index.aspx
3. Bollen, K. (1989) Structural Equations with Latent Variables. New York: Wiley & Sons.
4. Buchmann, C. (2002) Measuring Family Background in International Studies of Education: conceptual issues and methodological challenges, in A.C. Porter & A. Gamoran (Eds) Methodological Advances in Crossnational Surveys of Educational Achievement. Washington, DC: National Academy Press.
5. Byrne, B. & van de Vijver, F. (2010) Testing for Measurement and Structural Equivalence in Large-scale Cross-cultural Studies: addressing the issue of non-equivalence, International Journal of Testing, 10(2), 107-132. http://dx.doi.org/10.1080/15305051003637306
6. Chen, F. (2007) Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance, Structural Equation Modeling, 14(3), 464-504. http://dx.doi.org/10.1080/10705510701301834
7. Cheung, G.W. & Rensvold, R.B. (2002) Evaluating Goodness-of-fit Indexes for Testing Measurement Invariance, Structural Equation Modeling, 9, 233-255. http://dx.doi.org/10.1207/S15328007SEM0902_5
8. Cirino, P.T., Chin, C.E., Sevcik, R.A.,Wolf, M., Lovett, M. & Morris, R.D. (2002) Measuring Socioeconomic Status: reliability and preliminary validity for different approaches, Assessment, 9(2), 145-155. http://dx.doi.org/10.1177/10791102009002005
9. Coleman, J.S. (1968) The Concept of Equality of Educational Opportunity, Harvard Educational Review, 38, 7-22.
10. Cronbach, L.J. (1951) Coefficient Alpha and the Internal Structure of Tests, Psychometrika, 16(3), 297-334. http://dx.doi.org/10.1007/BF02310555
11. De Jong, M., Steenkamp, J. & Veldkamp, B. (2009) A Model for the Construction of Country-specific Yet Internationally Comparable Short-form Marketing Scales, Marketing Science, 28(4), 674-689. http://dx.doi.org/10.1287/mksc.1080.0439
12. Duncan, O.D., Featherman, D.L. & Duncan, B. (1972) Socioeconomic Background and Achievement. New York: Seminar Press.
13. Embretson, S. & Reise, S. (2000) Item Response Theory for Psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
14. Entwistle, D.R. & Astone, N.M. (1994) Some Practical Guidelines for Measuring Youth's Race/Ethnicity and Socioeconomic Status, Child Development, 65, 1521-1540.
15. Evans, G. & Rosenbaum, J. (2008) Self-regulation and the Income-achievement Gap, Early Childhood Research Quarterly, 23, 504-514. http://dx.doi.org/10.1016/j.ecresq.2008.07.002
16. Frey, A., Hartig, J. & Rupp, A. (2009) An NCME Instructional Module on Booklet Designs in Large-scale Assessments of Student Achievement: theory and practice, Educational Measurement Issues and Practice, 28(3), 39-53. http://dx.doi.org/10.1111/j.1745-3992.2009.00154.x
17. Gonzalez, E. & Rutkowski, L. (2010) Practical Approaches for Choosing Multiple-matrix Sample Designs, IEA-ETS Research Institute Monograph, 3, 125-156.
18. Grundy, E. & Holt, G. (2001) The Socioeconomic Status of Older Adults: how should we measure it in studies of health inequalities?, Journal of Epidemiology and Community Health, 55, 895-904. http://dx.doi.org/10.1136/jech.55.12.895
19. Hattie, J. (2009) Visible Learning. London: Routledge.
20. Hopmann, S. & Brinek, G. (2007) Introduction. PISA According to PISA-Does PISA Keep What it Promises?, In S. Hopmann, G. Brinek & M. Retzl (Eds) PISA Zufolge PISA-PISA According to PISA. Vienna: Lit- Verlag.
21. Hu, L. & Bentler, P. (1999) Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: conventional criteria versus new alternatives, Structural Equation Modeling, 6(1), 1-55. http://dx.doi.org/10.1080/10705519909540118
22. Knowles, E. & Evans, H. (2012) PISA 2009: how does the social attainment gap in England compare with countries internationally? Department of Education Research Report DFE- RR206. https://www.education.gov.uk/publications/RSG/Childrenandfamilies/Page1/DFE-RR206
23. Lord, F. & Novick, M. (1968) Statistical Theories of Mental Test Scores. Charlotte, NC: Information Age Publishing.
24. Ma, X. (2008) A Global Perspective on Socioeconomic Differences in Learning Outcomes, 2009/ED/EFA/MRT/PI/19. Paris: UNESCO Publishing. http://unesdoc.unesco.org/images/0017/001780/178025e.pdf
25. May, H. (2006) A Multilevel Bayesian Item Response Theory Method for Scaling Socioeconomic Status in International Studies of Education, Journal of Educational and Behavioral Statistics, 31(1), 63-79. http://dx.doi.org/10.3102/10769986031001063
26. Mazzeo, J. & von Davier, M. (2009) Review of the Programme for International Student Assessment (PISA) Test Design: recommendations for fostering stability in assessment results. http://edsurveys.rti.org/PISA
27. McDonald, R.P. (1982) A Note on the Investigation of Local and Global Identifiability, Psychometrika, 47(1), 101-103. http://dx.doi.org/10.1007/BF02293855
28. McGaw, B. (2008) The Role of the OECD in International Comparative Studies of Achievement, Assessment in Education: Principles, Policy & Practice, 15(3), 223-243.
29. Meredith, W. (1993) Measurement Invariance, Factor Analysis and Factorial Invariance, Psychometrika, 58, 525-543. http://dx.doi.org/10.1007/BF02294825
30. Mislevy, R.J. (1991) Randomization-based Inference about Latent Variables from Complex Samples, Psychometrika, 56(2), 177-196. http://dx.doi.org/10.1007/BF02294457
31. Mislevy, R.J., Beaton, A.E., Kaplan, B. & Sheehan, K.M. (1992) Estimating Population Characteristics from Sparse Matrix Samples of Item Responses, Journal of Educational Measurement, 29(2), 133-161. http://dx.doi.org/10.1111/j.1745-3984.1992.tb00371.x
32. Mislevy, R.J., Johnson, E.G. & Muraki, E. (1992) Scaling Procedures in NAEP, Journal of Educational Statistics, 17(2), 131-154. http://dx.doi.org/10.2307/1165166
33. Mueller, C.W. & Parcel, T.L. (1981) Measures of Socioeconomic Status: alternatives and recommendations, Child Development, 52, 13-30. http://dx.doi.org/10.2307/1129211
34. Mullen, M. (1995) Diagnosing Measurement Equivalence in Cross-national Research, Journal of International Business Studies, 26(3), 573-596. http://dx.doi.org/10.1057/palgrave.jibs.8490187
35. Mullis, I., Martin, M., Ruddock, G., O'Sullivan, C. & Preuschoff, C. (2009) TIMSS 2011 Assessment Frameworks. Boston: TIMSS & PIRLS International Study Center, Lynch School of Education, Boston College, Chestnut Hill, MA.
36. Organisation for Economic Co-operation and Development (OECD) (2001) Knowledge and Skills for Life: first results from PISA 2000. Paris: OECD Publishing.
37. Organisation for Economic Co-operation and Development OECD (2004) Learning for Tomorrow's World: first results from PISA 2003. Paris: OECD Publishing.
38. Organisation for Economic Co-operation and Development OECD (2007) Understanding the Social Outcomes of Learning. Paris: OECD Publishing.
39. Organisation for Economic Co-operation and Development OECD (2009a) PISA 2006 Technical Report. Paris: OECD Publishing.
40. Organisation for Economic Co-operation and Development OECD (2009b) Top of the Class: high performers in science in PISA. Paris: OECD Publishing.
41. Organisation for Economic Co-operation and Development OECD (2010a) PISA 2009 Results, vol. II: overcoming social background-equity in learning opportunities and outcomes. Paris: OECD Publishing.
42. Organisation for Economic Co-operation and Development OECD (2010b) TALIS 2008 Technical Report. Paris: OECD Publishing.
43. Organisation for Economic Co-operation and Development OECD (2012a) PISA 2009 Technical Report. Paris: OECD Publishing.
44. Organisation for Economic Co-operation and Development OECD (2012b) Public and Private Schools: how management and funding relate to the socio-economic profile. Paris: OECD Publishing.
45. Papanastasiou, E.C., Zembylas, M. & Vrasidas, C. (2003) Can Computer Use Hurt Science Achievement? The USA Results from PISA, Journal of Science Education and Technology, 12(3), 325-332. http://dx.doi.org/10.1023/A:1025093225753
46. Rutkowski, L. (2011) The Impact of Missing Background Data on Subpopulation Estimation, Journal of Educational Measurement, 48(3), 293-312. http://dx.doi.org/10.1111/j.1745-3984.2011.00144.x
47. Rutkowski, L. (in press) Sensitivity of Achievement Estimation to Conditioning Model Misclassification, Applied Measurement in Education.
48. Rutkowski, L. & Rutkowski, D. (2010) Getting It 'Better': the importance of improving background questionnaires in international assessment, Journal of Curriculum Studies, 42(3), 411-430. http://dx.doi.org/10.1080/00220272.2010.487546
49. Schulz, W. (2006) Measuring the Socio-economic Background of Students and its Effect on Achievement in PISA 2000 and PISA 2003. Annual Meetings of the American Educational Research Association (AERA), San Francisco.
50. Shoemaker, D.M. (1973) Principles and Procedures of Multiple Matrix Sampling. Cambridge, MA: Ballinger.
51. Singh, J. (1995) Measurement Issues in Cross-national Research, Journal of International Business Studies, 26(3), 597-619. http://dx.doi.org/10.1057/palgrave.jibs.8490188
52. Sirin, S.R. (2005) Socioeconomic Status and Student Achievement: a meta-analytic review of research, Review of Educational Research, 75(3), 417-453. http://dx.doi.org/10.3102/00346543075003417
53. Sörbom, D. (1974) A General Method for Studying Differences in Factor Means and Factor Structure between Groups, British Journal of Mathematical and Statistical Psychology, 27, 229-239. http://dx.doi.org/10.1111/j.2044-8317.1974.tb00543.x
54. Takane, Y. & de Leeuw, J. (1987) On the Relationship between Item Response Theory and Factor Analysis of Discretized Variables, Psychometrika, 52(3), 393-408. http://dx.doi.org/10.1007/BF02294363
55. Thomson, S., De Bortoli, L., Nicholas, M., Hilman, K. & Buckley, S. (2011) Challenges for Australian Education: results from PISA 2009. Victoria: ACER Press.
56. Traub, R. (1994) Reliability for the Social Sciences. Thousand Oaks, CA: Sage.
57. United Nations Education, Scientific and Cultural Organization (UNESCO) (2007) EFA Global Monitoring Report 2007: strong foundations. Paris: UNESCO.
58. United Nations Education, Scientific and Cultural Organization UNESCO (2010) EFA Global Monitoring Report 2010: reaching the marginalized. Paris: UNESCO.
59. von Davier, M. Gonzalez, E. & Mislevy, R. (2009) What Are Plausible Values and Why Are They Useful? IERI Monograph Series: issues and methodologies in large scale assessments, 2, 9-36.
60. Wagemaker, H. (2008) Choices and Trade-offs: reply to McGaw, Assessment in Education: principles, policy & practice, 15(3), 267-278.
61. West, M.R. & Woessmann, L. (2010) Every Catholic Child in a Catholic School: historical resistance to state schooling, contemporary school competition, and student achievement, Economic Journal, 120(546), 229-255. http://dx.doi.org/10.1111/j.1468-0297.2010.02375.x
62. White, K.R. (1982) The Relation between Socioeconomic Status and Educational Achievement, Psychological Bulletin, 91(3), 461-481. http://dx.doi.org/10.1037/0033-2909.91.3.461
63. Willms, D.J. (2006) Variation in Socioeconomic Gradients among Cantons in French- and Italian-speaking Switzerland: findings from OECD PISA, Educational Research and Evaluation, 12(2), 129-154. http://dx.doi.org/10.1080/13803610600587008
64. Wu, M. (2008) A Comparison of PISA and TIMSS 2003 Achievement Results in Mathematics and Science. Paper presented at the IEA Research Conference, Taipei, Taiwan.
65. Wu, M. (2010) Measurement, Sampling, and Equating Errors in Large Scale Assessments, Educational measurement: issues and practice, 29(4), 15-27. http://dx.doi.org/10.1111/j.1745-3992.2010.00190.x
66. Wuttke, J. (2007) Uncertainties and Bias in PISA, in S.T. Hopmann, G. Brinek & M. Retzl (Eds) PISA According to PISA. Vienna: University of Vienna.