Value-added measures for schools in England: Looking inside the 'black box' of complex metrics

Educational Assessment, Evaluation and Accountability

Volumn 22, Issue 3, 2010, Pages 181-198

  Kelly, Anthony ^a   Downey, Christopher ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Accountability in education; Complex models in school effectiveness; Pupil attainment data; Value added measures

Indexed keywords

EID: 77954953104     PISSN: 18748597     EISSN: 18748600     Source Type: Journal    
DOI: 10.1007/s11092-010-9100-4     Document Type: Article

References (42)

1. Aitkin, M., & Longford, N. (1986). Statistical issues in school effectiveness research. Journal of the Royal Statistical Society, Series a, 149, 1-42.
2. BBC (2008). News. Delays hit pupils' test results. Available online at: http://news. bbc. co. uk/1/hi/education/7489510. stm. Accessed on 15/02/2009.
3. Critchlow, J., & Coe, R. (2003). Serious flaws arising from the use of the median in calculating value added measures for School Performance Tables in England, Paper presented to the 29th International Association for Educational Assessment Annual Conference, October 2003.
4. DCSF (2008a). Technical guide to CVA-2007/08 model. Available online at: www. dcsf. gov. uk/performancetables/schools_08/documents. shtml. Accessed on 3/6/2009].
5. DCSF. (2008b). A school report card: Consultation document. Nottingham: Department for Childern, Schools and Families.
6. DfEE. (1998a). 1998 value added pilot: Supplement to the secondary school performance tables. London: Department for Education and Employment.
7. DfEE. (1998b). The autumn package. London: Department for Education and Employment.
8. DfES/Ofsted. (2004). A new relationship with schools: Improving performance through school self-evaluation. Nottingham: DfES.
9. DfES (2005). 2005 key stage 4 Contextual Value Added (CVA) pilot. Available online at: http://www. dcsf. gov. uk/performancetables/pilotks4_05. shtml. Accessed on 12/11/2006.
10. DfES. (2006). Families of schools: May 2006 secondary schools. London: Department for Education and Skills.
11. Downes, D., & Vindurampulle, O. (2007). Value-added measures for school improvement. Melbourne: Department of Education and Early Childhood Development.
12. Eason, G. (2007). How the new CVA scoring works, BBC News. Available online at: http://news. bbc. co. uk/1/hi/education/6251587. stm. Accessed on 24/08/2007.
13. Fitz-Gibbon, C. T. (1985). A-level results in comprehensive schools: the COMBSE project. Oxford Review of Education, 11(1), 43-58.
14. Fitz-Gibbon, C. T. (1991). Multilevel modelling in an indicator system. In S. W. Raudenbush & J. D. Willms (Eds.), School, classrooms and pupils: International studies of schooling from a multilevel perspective. San Diego: Academic.
15. Fitz-Gibbon, C. T. (1997). The value added national project final report: Feasibility studies for a national system of value-added indicators. London: School Curriculum and Assessment Authority.
16. GNN (Government News Network) (2003). Value added results show more rounded picture of primary schools' progress-Miliband. Available online at: http://www. gnn. gov. uk/content/detail. asp?NavigatedFromSearch=True& NewsAreaID=2& ReleaseID=101891. Accessed 06/09/2007.
17. Goldstein, H. (2007). Evidence and education policy-some reflections and allegations, Paper presented to the RSS conference in York, July 2007. Available online at: www. cmm. bristol. ac. uk/team/HG_Personal/Evidence%20and%20education%20policy. pdf. Accessed 24/08/2007.
18. Gorard, S. (2006). Value-added is of little value. Journal of Education Policy, 21(2), 235-243.
19. Gorard, S. (2007). The dubious benefits of multi-level modelling. International Journal of Research & Method in Education, 30(2), 221-236.
20. Gray, J., Jesson, D., & Jones, B. (1986). The search for a fairer way of comparing schools' examination results. Research Papers in Education, 1(2), 91-122.
21. Hutchison, D., & Schagen, I. (2008). Concorde and discord: the art of multilevel modelling. International Journal of Research & Method in Education, 31(1), 11-18.
22. Jakubowski, M. (2008). Implementing value-added models of school assessment. Florence: European University Institute.
23. James, M. (2006). University of London Institute of Education, reported on the BBC, 9 August 2006. Available online at: http://news. bbc. co. uk/1/hi/education/4777737. stm. Accessed 13/09/2007.
24. Kirkup, C., Sizmur, J., Sturman, L., & Lewis, K. (2005). Schools' use of data in teaching and learning, DfES research report 671. London: Department for Education and Skills.
25. Kreft, I. G. (1996). Are multilevel techniques necessary? An overview including simulation studies, cited in: C. T. Fitz-Gibbon (1997) The value added national project final report: Feasibility studies for a national system of value-added indicators. London: School Curriculum and Assessment Authority.
26. Leckie, G. (2007). Missing data and school assessment measures, presentation to the PLASC/National Pupil Database Users Group (PLUG), University of Bristol, 17 January 2007. Available online at www. bris. ac. uk/cmpo/plug/workshops/index. html.
27. Luyten, H. (2003). The size of school effects compared to teacher effects: an overview of the research literature. School Effectiveness and School Improvement, 14(1), 31-35.
28. Massey, A., Green, S., Dexter, T., & Hammet, L. (2003). Comparability of national tests over time: KS1, KS2 and KS3 standards between 1996 and 2001. Final Report to the QCA of the Comparability Over Time Project. London: QCA.
29. Miliband, D. (2004). Personalised learning: Building a new relationship with schools, Speech by David Miliband, Minister Of State For School Standards, North of England Education Conference, Belfast, 8th January 2004.
30. Ofsted (2007). Inspection matters, Issue 14, May 2007.
31. Ray, A. (2006). School value added measures in England: A paper for the OECD project on the development of value-added models in education systems. London: Department for Education and Skills.
32. Rosina, H., & Downs, M. (2007). Collecting data for a school, presentation to the PLASC/National Pupil Database Users Group (PLUG), University of Bristol, 17 January 2007. Available online at www. bris. ac. uk/cmpo/plug/workshops/index. html.
33. Sammons, P. (2007). School effectiveness and equity: Making connections. Reading: CfBT Education Trust.
34. Schagen, I. (2006). The use of standardized residuals to derive value-added measures of school performance. Educational Studies, 32(2), 119-132.
35. Sharp, S. (2006). Assessing value-added in the first year of schooling: some results and methodological considerations. School Effectiveness and School Improvement, 17(3), 329-346.
36. Sharp, S., & Croxford, L. (2003). Literacy in the first year of schooling: a multilevel analysis. School Effectiveness and School Improvement, 14(2), 213-231.
37. Teddlie, C., Stringfield, S., & Reynolds, D. (2000). Context issues within school effectiveness research. In C. Teddlie & D. Reynolds (Eds.), The international handbook of school effectiveness research. London: Falmer.
38. Thomson, D. (2007). Using RAISEonline in self-evaluation. Understanding what the inspectors will see. (Secondary). Available online at: www. egfl. org. uk/export/sites/egfl/categories/admin/data/_docs/raise_online/raiseSec. pdf. Accessed 30/08/2007.
39. Tymms, P., & Dean, C. (2004). Value added in the primary school league tables, a report for the National Association of Head Teachers. Durham: CEM Centre, University of Durham.
40. Volante, L. (2004). Teaching to the test: what every educator and policy-maker should know, Canadian Journal of Educational Administration and Policy, Issue 35. Available online atWhttp://www. umanitoba. ca/publications/cjeap/articles/volante. html. Accessed 17/11/07.
41. Webber, R., & Butler, T. (2005). Classifying pupils by where they live: How well does this predict variations in their GCSE results? CASA Working Paper Number 99. London: Centre for Advanced Spatial Studies, University College London.
42. Willms, J. D. (1992). Monitoring school performance: A guide for educators. Washington, DC: Falmer.