Getting it 'better': The importance of improving background questionnaires in international large-scale assessment

Journal of Curriculum Studies

Volumn 42, Issue 3, 2010, Pages 411-430

  Rutkowski, Leslie ^a   Rutkowski, David ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Background questionnaires; International organizations; Large scale assessment; PIRLS; PISA; TIMSS

Indexed keywords

EID: 77953691799     PISSN: 00220272     EISSN: 13665839     Source Type: Journal    
DOI: 10.1080/00220272.2010.487546     Document Type: Article

References (34)

1. Beaton, A. E. and Zwick, R. (1992) Overview of the National Assessment of Educational Progress. Journal of Educational Statistics, 17(2), 95-109.
2. Bechger, T. M., van den Wittenboer, G., Hox, J. J. and de Glopper, C. (1999) The validity of comparative educational studies. Educational Measurement: Issues and Practice, 18(3), 18-26.
3. Davis-Kean, P. (2005) The influence of parent education and family income on child achievement: the indirect role of parental expectations and the home environment. Journal of Family Psychology, 19(2), 294-304.
4. Dolin, J. (2007) PISA-an example of the use and misuse of large-scale comparative tests. PISA Zufolge PISA-PISA According to PISA: Hält PISA was es verspricht-Does PISA Keep What It Promises (Vienna: Lit-Verlag), 93-126. Available online at: http://www.univie.ac.at/pisaaccordingtopisa/, accessed April 15, 2010.
5. Federal Ministry of Education and Research (n.d.) The New PISA Benchmark Study of the OECD. Available online at: http://www.bmbf.de/en/3292.php, accessed April 15, 2010.
6. Grek, S. (2009) Governing by the numbers: the PISA 'effect' in Europe. Journal of Education Policy, 24(1), 23-27.
7. Hodges, S. D. and Moore, P. G. (1972) Data uncertainties and least squares regression. Journal of the Royal Statistical Society: Series C (Applied Statistics), 21(2), 185-195.
8. Hopmann, S. T. and Brinek, G. (2007) Introduction: PISA according to PISA-Does PISA keep what it promises? In S. T. Hopmann, G. Brinek and M. Retzl (eds), PISA Zufolge PISA-PISA According to PISA: Hält PISA was es verspricht-Does PISA Keep What It Promises (Vienna: Lit-Verlag), 9-20. Available online at: http://www.univie.ac.at/pisaaccordingtopisa/, accessed April 15, 2010.
9. Husén, T. (1987) Policy impact of IEA research. Comparative Education Review, 31(1), 129-136.
10. Johnson, E. G. (1992) The design of the national assessment of educational progress. Journal of Educational Measurement, 29(2), 95-110.
11. Lie, S. (2005) How can large international comparative studies contribute to the quality of science education. In K. Boersma, M. Goedhart, O. de Jong and H. Eijkelhof (eds), Research and the Quality of Science Education (Dordrecht, The Netherlands: Springer), 27-40.
12. Lord, F. (1962) Estimating norms by item sampling. Educational and Psychological Measurement, 22(2), 259-267.
13. Magnuson, K. (2007) Maternal education and children's academic achievement during middle childhood. Developmental Psychology, 43(6), 1497-1512.
14. Martin, M. O., Mullis, I. V. S. and Kennedy, A. M. (eds) (2007) PIRLS 2006 Technical Report (Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College). Available online at: http://timss.bc.edu/pirls2006/tech_rpt.html, accessed April 10, 2010.
15. Mislevy, R. J. (1991) Randomization-based inference about latent variables from complex samples. Psychometrika, 56(2), 177-196.
16. Mislevy, R. J., Beaton, A. E., Kaplan, B. and Sheehan, K. M. (1992b) Estimating population characteristics from sparse matrix samples of item responses. Journal of Educational Measurement, 29(2), 133-161.
17. Mislevy, R. J., Johnson, E. G. and Muraki, E. (1992a) Scaling procedures in NAEP. Journal of Educational Statistics, 17(2), 131-154.
18. Mullis, I. V. S. (2002) Background Questions in TIMSS and PIRLS: An Overview. Available online at: http://www.nagb.org/publications/Mullis.doc, accessed May 21, 2009.
19. Mullis, I. V. S., Kennedy, A. M., Martin, M. O. and Sainsbury, M. (2006) PIRLS Assessment Framework and Specifications (Chestnut Hill, MA: TIMSS and PIRLS International Study Center, Boston College). Available online at: http://timss.bc.edu/pirls2006/framework.html, accessed April 10, 2010.
20. Mullis, I. V. S., Martin, M. O., Ruddock, G., O'Sullivan, C., Arora, A. and Erberber, E. (2005) TIMSS 2007 Assessment Frameworks (Chestnut Hill, MA: TIMSS and PIRLS International Study Center, Boston College). Available online at: http://timss.bc.edu/TIMSS2007/frameworks.html, accessed April 10, 2010.
21. National Commission on Excellence in Education (1983) A Nation at Risk: The Imperative for Educational Reform (Washington, DC: U.S. Department of Education). Available online at: http://www2.ed.gov/pubs/NatAtRisk/index.html, accessed April 10, 2010.
22. Olson, J. F., Martin, M. O. and Mullis, I. V. S. (eds) (2008) TIMSS 2007 Technical Report (Chestnut Hill, MA: Boston College, TIMSS and PIRLS International Study Center). Available online at: http:timess.bc.edu/timss2007/techreport.html, accessed April 13, 2010.
23. Organisation for Economic Co-operation and Development (OECD) (2006) Assessing Scientific, Reading and Mathematical Literacy: A Framework for PISA 2006 (Paris: OECD). Available online at: http://www.oecd.org/document/33/0,3343,en_32252351_32236191_37462369_1_1_1_1,00.html, accessed April 10, 2010.
24. Organisation for Economic Co-operation and Development (OECD) (2009) PISA 2006 Technical Report (OECD:Paris). Available online at: http://www.oecd.org/document/41/0,3343,en_32252351_32236191_42025897_1_1_1_1,00.html#PISA_2006_Technical_Report, accessed April 10, 2010.
25. Pongratz, L. A. (2006) Voluntary self-control: education reform as a governmental strategy. Education Philosophy and Theory, 38(4), 471-482.
26. Porter, A. C. and Gamoran, A. (2000) Progress and challenges for large-scale assessment. In A. C. Porter and A. Gamoran (eds), Methodological Advances in Cross-National Surveys of Educational Achievement (Washington DC: National Academy Press), 3-26.
27. Postlethwaite, T. N. (2008) Memories of IEA. Paper presented at 50th anniversary celebration of the meeting of the IEA General Assembly, Berlin.
28. Reddy, V. (2005) Cross-national achievement studies: learning from South Africa's participation in the trends in international mathematics and science study (TIMSS). Compare, 35(1), 63-77.
29. Robitaille, D. F. and Beaton, A. E. (eds) (2002) Secondary Analysis of the TIMSS Data (Dordrecht, The Netherlands: Kluwer).
30. Robitaille, D. F., Beaton, A. E. and Plomp, T. (2000) The Impact of TIMSS on the Teaching and Learning of Mathematics & Science (Vancouver, BC: Pacific Educational Press).
31. Rubin, D. (1987) Multiple Imputation for Nonresponse in Sample Surveys (New York: Wiley).
32. Schwippert, K. (ed.) (2007) Progress in Reading Literacy: The Impact of PIRLS 2001 in 13 Countries (Münster, Germany: Waxmann).
33. Shoemaker, D. M. (1971) Principles and Procedures of Multiple Matrix Sampling. Report No. SWRL-TR-34, Southwest Regional Educational Lab, Inglewood, CA. ERIC ED 057 100.
34. von Davier, M., Gonzalez, E. and Mislevey, R. J. (2009) Plausible values: what are they and why do we need them? Issues and Methodologies in Large-Scale Assessments: IERI Monograph Series, 2, 9-36. Available online at: http://www.ierinstitute.org/IERI_Monograph_Volume_02.pdf, accessed April 12, 2010.