How is formative assessment related to students’ reading achievement? Findings from PISA 2009

Assessment in Education: Principles, Policy and Practice

Volumn 23, Issue 4, 2016, Pages 473-494

  Li, Hongli ^a  

^a GEORGIA STATE UNIVERSITY   (United States)

Author keywords

Formative assessment; PISA 2009; reading achievement

Indexed keywords

EID: 84975217546     PISSN: 0969594X     EISSN: 1465329X     Source Type: Journal    
DOI: 10.1080/0969594X.2016.1139543     Document Type: Article

References (96)

1. ACT. (2012). Do race/ethnicity-based student achievement gaps grow over time? Retrieved from http://www.act.org/research/policymakers/pdf/RaceEthnicityReport.pdf
2. R.J.Adams, M.Wilson, & W.Wang, (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23.10.1177/0146621697211001
3. American Educational Research Association, American Psychological Association, National Council on Measurement in Education (AERA/APA/NCME). (2014). Standards for educational and psychological testing. Washington, DC:American Psychological Association.
4. V.A.Bali, & R.M.Alvarez, (2004). The race gap in student achievement scores:Longitudinal evidence from a racially diverse school district. Policy Studies Journal, 32, 393–415.10.1111/psj.2004.32.issue-3
5. V.Battistich, E.Schaps, & N.Wilson, (2004). Effects of an elementary school intervention on students’ ‘connectedness’ to school and social adjustment during middle school. The Journal of Primary Prevention, 24, 243–262.
6. G.L.Bauman, L.T.Bustillos, E.M.Bensimon, M.C.Brown, & R.D.Bartee, (2005). Achieving equitable educational outcomes with all students:The institution’s roles and responsibilities. Washington, DC:Association of American Colleges and Universities.
7. R.Beecham, (2009). Teaching quality and student satisfaction:Nexus or simulacrum? London Review of Education, 7, 135–146.10.1080/14748460902990336
8. B.Bell, & B.Cowie, (2000). The characteristics of formative assessment in science education. Science Education, 85, 536–553.
9. R.E.Bennett, (2011). Formative assessment:A critical review. Assessment in Education:Principles, Policy, & Practice, 18, 5–25.
10. A.Bennett, B.L.Bridglall, A.M.Cauce, H.T.Everson, E.W.Gordon, C.D.Lee, … J.K.Stewart, (2004). All students reaching the top:Strategies for closing academic achievement gaps. Naperville, IL:Learning Point Associates. Retrieved from http://www.ode.state.or.us/teachlearn/real/documents/ach-gap-strategies.pdf
11. Bill and Melinda Gates Foundation. (2012). Asking student about teaching:Student perception surveys and their implementation. Retrieved from http://www.metproject.org/downloads/Asking_Students_Practitioner_Brief.pdf
12. S.H.Birch, & G.W.Ladd, (1998). Children’s interpersonal behaviors and the teacher–child relationship. Developmental Psychology, 34, 934–946.10.1037/0012-1649.34.5.934
13. C.Black, H.Paz, & R.DeBlassie, (1991). Counseling the Hispanic male adolescent. Adolescence, 26, 223–232.
14. P.Black, & D.Wiliam, (1998). Assessment and classroom learning. Assessment in Education:Principles, Policy & Practice, 5, 7–74.10.1080/0969595980050102
15. P.Black, & D.Wiliam, (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21, 5–31.10.1007/s11092-008-9068-5
16. B.Blunsdon, K.Reed, & S.Mceachern, Steven (2003). Teaching organisational theory in undergraduate management programmes:An exercise in facilitated theory testing for active experimentation. Journal of Further and Higher Education, 27, 3–14.10.1080/03098770305632
17. D.Boyd, Donald, H.Lankford, S.Loeb, J.Rockoff, & J.Wyckoff, (2008). The narrowing gap in New York City teacher qualifications and its implications for student achievement in high-poverty schools. Journal of Policy Analysis and Management, 27, 793–818.10.1002/pam.v27:4
18. M.T.Brannick, (1995). Critical comments on applying covariance structure modeling. Journal of Organizational Behavior, 16, 201–213.10.1002/(ISSN)1099-1379
19. D.C.Briggs, M.A.Ruiz-Primo, E.Furtak, L.Shepard, & Y.Yin, (2012). Meta-analytic methodology and inferences about the efficacy of formative assessment. Educational Measurement:Issues and Practice, 31, 13–17.10.1111/emip.2012.31.issue-4
20. S.M.Brookhart, (1997). A theoretical framework for the role of classroom assessment in motivating student effort and achievement. Applied Measurement in Education, 10, 161–180.10.1207/s15324818ame1002_4
21. S.M.Brookhart, (2003). Developing measurement theory for classroom assessment purposes and uses. Educational Measurement:Issues and Practices, 22, 5–12.
22. S.Brookhart, & D.Durkin, (2003). Classroom assessment, student motivation, and achievement in high school social studies classes. Applied Measurement in Education, 19, 151–184.
23. M.R.Burchinal, E.Peisner-Feinberg, R.Pianta, & C.Howes, (2002). Development of academic skills from preschool through second grade:Family and classroom predictors of developmental trajectories. Journal of School Psychology, 40, 415–436.10.1016/S0022-4405(02)00107-3
24. B.M.Byrne, (2008). Testing for multi-group equivalence of a measuring instrument:A walk through the process. Psicothema, 20, 872–882.
25. Centre for Educational Research and Innovation. (2005). Assessment for learning formative assessment. Retrieved from http://www.oecd.org/site/educeri21st/40600533.pdf
26. G.W.Cheung, & R.B.Rensvold, (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 235–255.
27. C.Clotfelter, H.F.Ladd, & J.Vigdor, (2004). Teacher quality and minority achievement gaps. Durham, NC:Duke University Sanford Institute of Public Policy. Retrieved from http://research.sanford.duke.edu/papers/SAN04-04.pdf
28. J.G.Delaney, A.N.Johnson, T.D.Johnson, & D.L.Treslan, (2010). Students’ perceptions of effective teaching in higher education. St. John’s, NL:Distance Education and Learning Technologies.
29. R.DeVellis, (1991). Scale development:Theory and applications. Newbury Park, CA:Sage.
30. K.E.Dunn, & S.W.Mulvenon, (2009). A critical review of research on formative assessments:The limited scientific evidence of the impact of formative assessments in education. Practical Assessment, Research, and Evaluation, 14. Retrieved from http://pareonline.net/getvn.asp?v=14&n=7
31. R.Ferguson, & C.Danielson, (2014). How framework for teaching and Tripod 7Cs evidence distinguish key components of effective teaching. In T.J.Kane, K.A.Kerr, & R.C.Pianta (Eds.). Designing teacher evaluation systems:New guidance from the measures of Effective Teaching Project (pp. 98–143). San Francisco, CA:Jossey-Bass.
32. H.L.Fleischman, P.J.Hopstock, M.P.Pelczar, & B.E.Shelley, (2010). Highlights from PISA 2009:Performance of U.S. 15-year-old students in reading, mathematics, and science literacy in an international context (NCES 2011–004). U.S. Department of Education, National Center for Education Statistics. Washington, DC:U.S. Government Printing Office.
33. A.Flores, (2007). Examining disparities in mathematics education:Achievement gap or opportunity gap? The High School Journal, 91, 29–42.10.1353/hsj.2007.0022
34. B.J.Fraser, & H.J.Walberg, (2005). Research on teacher–student relationships and learning environments:Context, retrospect and prospect. International Journal of Educational Research, 43, 103–109.10.1016/j.ijer.2006.03.001
35. B.Fuller, & C.G.García Coll, (2010). Learning from Latinos:Contexts, families, and child development in motion. Developmental Psychology, 46, 559–565.10.1037/a0019412
36. C.Galindo, & B.Fuller, (2010). The social competence of Latino kindergartners and growth in mathematical understanding. Developmental Psychology, 46, 579–592.10.1037/a0017821
37. C.Gipps, (1999). Socio-cultural aspects of assessment. Review of Research in Education, 24, 355–392.
38. B.K.Hamre, & R.C.Pianta, (2005). Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure? Child Development, 76, 949–967.10.1111/cdev.2005.76.issue-5
39. K.Haycock, (1998). Good teaching matters:How well-qualified teachers can close the gap. Thinking K-16, 3, 1–16.
40. M.Heritage, (2010). Formative assessment:Making it happen in the classroom. Thousand Oaks, CA:Corwin Press.
41. J.L.Herman, E.Osmundson, C.Ayala, S.Schneider, & M.Timms, (2006). The nature and impact of teachers’ formative assessment practices (CSE Tech Rep. No. 703). Los Angeles, CA:National Center for Research on Evaluation, Standards, and Student Testing (CRESST), University of California.
42. D.T.Hickey, & S.J.Zuiker, (2005). Engaged participation:A sociocultural model of motivation with implications for educational assessment. Educational Assessment, 10, 277–305.10.1207/s15326977ea1003_7
43. K.Hoffman, & C.Llagas, (2003). Status and trends in the education of blacks (NCES 2003–034). Washington, DC:U.S. Department of Education, National Center for Education Statistics.
44. C.Howes, C.E.Hamilton, & C.C.Matheson, (1994). Children's relationships with peers:Differential associations with aspects of the teacher-child relationship. Child Development, 65, 253–263.10.2307/1131379
45. L.Hu, & P.M.Bentler, (1999). Cutoff criteria for fit indexes in covariance structure analysis:Conventional criteria versus new alternatives. Structural Equation Modeling:A Multidisciplinary Journal, 6(1), 1–55.10.1080/10705519909540118
46. P.Huber, (1967). The behavior of the maximum likelihood estimates under nonstandard conditions. In L.M.Le Cam & J.Neyman (Eds.), Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1, pp. 221–233). Berkeley:University of California Press.
47. M.Kane, (1992). An argument-based approach to validity. Psychological Bulletin, 112, 527–535.10.1037/0033-2909.112.3.527
48. M.Kane, (2006). Validation. In R.Brennan (Ed.). Educational measurement (4th ed., pp. 17–64). Westport, CT:American Council on Education and Praeger.
49. E.K.Kelloway, (1995). Structural equation modelling in perspective. Journal of Organizational Behavior, 16, 215–224.10.1002/(ISSN)1099-1379
50. N.Kingston, & B.Nash, (2011). Formative assessment:A meta-analysis and a call for research. Educational Measurement:Issues and Practice, 30, 28–37.10.1111/emip.2011.30.issue-4
51. R.B.Kline, (2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY:Guilford Press.
52. J.A.Kulik, (2001). Student ratings:Validity, utility, and controversy. New Directions for Institutional Research, 109, 9–25.10.1002/(ISSN)1536-075X
53. J.Lee, (2002). Racial and ethnic achievement gap trends:Reversing the progress toward equity? Educational Researcher, 31, 3–12.10.3102/0013189X031001003
54. R.B.Lindsey, S.M.Graham, R.C.Westphal, & C.L.Jew, (2008). Culturally proficient inquiry:A lens for identifying and analyzing educational gaps. Thousand Oaks, CA:Corwin Press.
55. D.Markland, (2007). The golden rule is that there are no golden rules:A commentary on Paul Barrett’s recommendations for reporting model fit in structural equation modelling. Personality and Individual Differences, 42, 851–858.10.1016/j.paid.2006.09.023
56. R.S.Martínez, O.T.Aricak, & J.Jewell, (2008). Influence of reading attitude on reading achievement:A test of the temporal-interaction model. Psychology in the Schools, 45, 1010–1023.10.1002/pits.v45:10
57. J.H.McMillan, J.C.Venable, & D.Varier, (2013). Studies of the effect of formative assessment on student achievement:So much more is needed. Practical Assessment, Research & Evaluation, 18. Retrieved from http://pareonline.net/getvn.asp?v=18&n=2
58. R.Melmer, E.Burmaster, & T.K.James, (2008). Attributes of effective formative assessment. Washington, DC:Council of Chief State School Officers (CCSSO). Retrieved from http://www.ccsso.org/publications/details.cfm?PublicationID=362
59. W.Meredith, (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543.10.1007/BF02294825
60. R.J.Mislevy, (1991). Randomization-based inference about latent variables from complex samples. Psychometrika, 56, 177–196.10.1007/BF02294457
61. G.Molenberghs, & G.Verbeke, (2007). Likelihood ratio, score, and wald tests in a constrained parameter space. The American Statistician, 61, 22–27.10.1198/000313007X171322
62. L.K.Muthén, & B.O.Muthén, (1998–2012). Mplus User’s Guide (7th ed.). Los Angeles, CA:Muthén & Muthén.
63. Organisation for Economic Co-operation and Development. (2005). Formative assessment:Improving learning in secondary classrooms. Retrieved from http://www.oecd.org/edu/ceri/35661078.pdf
64. Organisation for Economic Co-operation and Development. (2010a). Performance of U.S. 15-year-old students in reading, mathematics, and science literacy in an international context. Retrieved from http://nces.ed.gov/pubs2011/2011004.pdf
65. Organisation for Economic Co-operation and Development. (2010b). TALIS technical report. Retrieved from http://www.keepeek.com/Digital-Asset-Management/oecd/education/talis-2008-technical-report_9789264079861-en
66. Organisation for Economic Co-operation and Development. (2010c). PISA 2009 results:Overcoming social background – equity in learning opportunities and outcomes (Volume II). Retrieved from 10.1787/9789264091504-en
67. Organisation for Economic Co-operation and Development. (2012). PISA 2009 technical report. Retrieved from http://www.oecd.org/pisa/pisaproducts/pisa2009/50036771.pdf
68. L.L.Pallock, & S.D.Lamborn, (2006). Beyond parenting practices:Extended kinship support and the academic adjustment of African-American and European-American teens. Journal of Adolescence, 29, 813–828.10.1016/j.adolescence.2005.12.003
69. J.Parkes, (2007). Reliability as argument. Educational Measurement:Issues and Practice, 26, 2–10.10.1111/j.1745-3992.2007.00103.x
70. R.C.Pianta, M.S.Steinberg, & K.Rollins, (1995). The first two years of school:Teacher-child relationships and deflections in children’s classroom adjustment. Development and Psychopathology, 7, 297–312.
71. W.J.Popham, (2008). Transformative assessment. Alexandria, VA:Association for Supervision and Curriculum Development.
72. B.Randel, A.D.Beesley, H.Apthorp, T.F.Clark, X.Wang, L.F.Cicchinelli, & J.M.Williams, (2011). Classroom assessment for student learning:The impact on elementary school mathematics in the central region. (NCEE 2011-4005). Washington, DC:U.S. Department of Education, National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences.
73. S.Rimm-Kaufman, (2010). Improving students’ relationships with teachers to provide essential supports for learning:Teacher’s modules. American Psychological Association (APA). Retrieved from http://www.apa.org/education/k12/relationships.aspx
74. M.C.Rodriguez, (2004). The role of classroom assessment in student performance on TIMSS. Applied Measurement in Education, 17(1), 1–24.10.1207/s15324818ame1701_1
75. D.L.Roorda, H.M.Y.Koomen, J.L.Spilt, & F.J.Oort, (2011). The influence of affective teacher–student relationships on students’ school engagement and achievement:A meta-analytic approach. Review of Educational Research, 81, 493–529.
76. D.R.Sadler, (1998). Formative assessment:Revisiting the territory. Assessment in Education:Principles, Policy & Practice, 5, 77–84.10.1080/0969595980050104
77. L.A.Shepard, (2005). Linking formative assessment to scaffolding. Educational Leadership, 63, 66–71.
78. S.R.Sirin, (2005). Socioeconomic status and academic achievement:A meta-analytic review of research. Review of Educational Research, 75(3), 417–453.10.3102/00346543075003417
79. P.Spooren, B.Brockx, & D.Mortelmans, (2013). On the validity of student evaluation of teaching:The state of the art. Review of Educational Research, 83, 598–642.10.3102/0034654313496870
80. M.Steadman, (1998). Using classroom assessment to change both teaching and learning. New Directions for Teaching and Learning, 75, 23–35.10.1002/(ISSN)1536-0768
81. R.Stiggins, & J.Chappuis, (2005). Using student-involved classroom assessment to close achievement gaps. Theory Into Practice, 44, 11–18.10.1207/s15430421tip4401_3
82. R.Stiggins, & J.Chappuis, (2006). What a difference a word makes:Assessment FOR learning rather than assessment of learning helps students succeed. Journal of Staff Development, 27, 10–14.
83. R.Stiggins, & N.F.Conklin, (1992). In teachers’ hands:Investigating the practices of classroom assessment. Albany, NY:SUNY Press.
84. Z.Stone, K.Barron, & N.Finch, (2012). Effective and promising practices for closing achievement gaps. Nashville, TN:Appalachia Regional Comprehensive Center (ARCC) at Edvantia. Retrieved from http://sites.edvantia.org/pdta/pdf/tdoe_effective_practices_achievement_gaps080812.pdf
85. S.Strand, (2014). School effects and ethnic, gender and socio-economic gaps in educational achievement at age 11. Oxford Review of Education, 40, 223–245.10.1080/03054985.2014.891980
86. W.H.Teale, & R.Lewis, (1981). The nature and measurement of secondary school students’ attitudes toward reading. Reading Horizons, 21, 94–102.
87. C.Teddlie, S.Stringfield, & D.Reynolds, (2000). Context issues within school effectiveness research. In C.Teddlie & D.Reynolds (Eds.), The international handbook of school effectiveness research (pp. 160–185). London:Falmer Press.
88. A.Vanneman, L.Hamilton, J.B.Anderson, &, T.Rahman, (2009). Achievement gaps:How black and white students in public schools perform in mathematics and reading on the National Assessment of Educational Progress, (NCES 2009–455). Washington, DC:U.S. Department of Education, National Center for Education Statistics, Institute of Education Sciences.
89. M.von Davier, E.Gonzalez, & R.Mislevy, (2009). What are plausible values and why are they useful? In M.von Davier & D.Hastedt (Eds.). IERI monograph series:Issues and methodologies in large scale assessments (Vol. 2). IEA-ETS Research Institute.
90. L.Vygotsky, (1978). Mind in society:The development of higher psychological processes. Cambridge, MA:Harvard University Press.
91. H.White, (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50(1), 1–26.
92. D.Wiliam, (2005). Keeping learning on track:Formative assessment and the regulation of learning. In M.Coupland, J.Anderson, & T.Spencer (Eds.). Making mathematics vital:Proceedings of the Twentieth Biennial Conference of the Australian Association of Mathematics Teachers (pp. 26–40). Adelaide, Australia:Australian Association of Mathematics Teachers.
93. S.Yeh, (2010). Understanding and addressing the achievement gap through individualized instruction and formative assessment. Assessment in Education:Principles, Policy, & Practice, 17, 169–182.
94. Y.Yin, R.J.Shavelson, C.C.Ayala, M.A.Ruiz-Primo, P.R.Brandon, Paul R., E.M.Furtak, … D.B.Young, (2008). On the impact of formative assessment on student motivation, achievement, and conceptual Change. Applied Measurement in Education, 21, 335–359.10.1080/08957340802347845
95. F.Yong, & N.Ewing, (1992). A comparative study of the learning-style preferences among gifted African-American, Mexican-American and American born Chinese middle-grade students. Roeper Review, 14, 120–123.
96. S.Zaccarin, & C.Donati, (2008). The effects of sampling weights in multilevel analysis of PISA data (working paper No. 119). Trieste:University of Trieste.