Public perceptions of reliability in examination results in England

Evaluation and Research in Education

Volumn 24, Issue 4, 2012, Pages 255-283

  He, Qingping ^a   Boyle, Andrew ^b   Opposs, Dennis ^a  

^a Office of Qualifications and Examinations Regulation   (United Kingdom)

^b City and Guilds of London Institute   (United Kingdom)

Author keywords

Human error; Measurement error; Public perceptions of reliability; Reliability of results

Indexed keywords

EID: 84866947515     PISSN: 09500790     EISSN: 17477514     Source Type: Journal    
DOI: 10.1080/09500790.2011.629722     Document Type: Article

References (53)

1. Baird, J., Cresswell, M., & Newton, P. (2000). Would the real gold standard please step forward? Research Papers in Education Policy and Practice, 15(2), 213-229.
2. Blanchard, L.A., Hinnant, C.C., & Wong, W. (1998). Market-based reforms in government: Toward a social subcontract? Administration & Society, 30(5), 483-512.
3. Boyle, A. (2008). The regulation of examinations and qualifications: An international study. Retrieved from http://www.ofqual.gov.uk/international-regulation
4. Boyle, A., Opposs, D., & Kinsella, A. (2009, September). No news is good news? Talking to the public about the reliability of assessment. Paper presented at the 35th International Association for Educational Assessment (IAEA) annual conference in Brisbane, Australia. Retrieved from http://www.ofqual.gov.uk/files/2009-09-iaea-no-news-is-good-news.pdf
5. Bradberry, T. (2007). The personality code. New York, NY: Putnam.
6. British Broadcasting Corporation (BBC). (2009). Vatican and Muslims condemn Swiss minaret ban vote. Retrieved from http://news.bbc.co.uk/1/hi/world/europe/8385893.stm
7. Burkard, T., & Talbot Rice, S. (2009). School quangos: A blueprint for abolition and reform. Retrieved from http://www.cps.org.uk/cps-catalog/school%20quangos.pdf
8. Burslem, S. (2011). The reliability programme: Final report of the Policy Advisory Group. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/reliability/11-03-16-PAG-The-Reliability-Programme.pdf
9. Chamberlain, S. (2010). Public perceptions of reliability. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/Ofqual-10-4708-public-perceptions-reliability-report-08-03-10.pdf Charlton, J. (2009, September). No room for error in exams. The Sun. Retrieved from http://www.thesun.co.uk/sol/homepage/news/2644581/An-exam-watchdog-has-paid-consultantsto-find-a-positive-alternative-to-the-word-error.html#mySunComments
10. Clark, L. (2010, July). One in five SATs results is incorrect, say exam watchdogs. The Daily Mail. Retrieved from http://www.dailymail.co.uk/news/article-1297924/One-SATs-resultsincorrect-say-exam-watchdogs.html
11. Coren, S., Ward, L., & Enns, J. (1999). Sensation and perception. New York, NY: Harcourt Brace.
12. Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.
13. Duffy, B., Wake, R., Burrows, T., & Bremner, P. (2008). Closing the gaps-crime and public perceptions. International Review of Law, Computers & Technology, 22(1/2), 17-44.
14. Feldt, L., & Brennan, R. (1989). Reliability. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). New York, NY: American Council on Education/Macmillan.
15. Fukuyama, F. (1995). Trust: Social virtues and the creation of prosperity. New York, NY: Free Press.
16. Groves, R.M., Fowler, F.J., Couper, M.P., Lepkowski, J.M., Singer, E., & Tourangeau, R. (2004). Questionnaire methodology. Hoboken, NJ: John Wiley & Sons.
17. Hardin, R. (2002). Trust and trustworthiness. New York, NY: Russell Sage Foundation.
18. He, Q., Hayes, M., & Wiliam, D. (2011). Classification accuracy in results from KS2 national curriculum tests. Ofqual. Retrieved from http://www.ofqual.gov.uk/files/reliability/11-03-16-Ofqual-Classification-Accuracy-in-Results-from-Key-Stage-2-National-Curriculum-Tests.pdf
19. House of Commons Children, School and Families Committee (HCCSFC). (2008). Testing and assessment, third report. Retrieved from http://www.publications.parliament.uk/pa/cm200708/cmselect/cmchilsch/169/169.pdf
20. Ipsos MORI. (2009). Public perceptions of reliability in examinations. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/2009-05-14-public-perceptions-of-reliability. pdf
21. Ipsos MORI. (2010). Perceptions of A levels and GCSEs-Wave 8. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/2009-02-26-ofqual-perceptions-of-alevelsgcses. pdf
22. Johnson, B. (2004). GM debate: No trust, no go! Heredity, 92(3), 137-138.
23. Kane, M. (2006). Validation. In R.L. Brennan (Ed.), Educational measurement (4th ed., pp. 17-64). Westport, CT: American Council on Education/Praeger.
24. Lycan, W. (Ed.). (1999). Mind and cognition: An anthology (2nd ed.). Malden, MA: Blackwell.
25. Malhotra, S., & Subodh, B.N. (2009). Informed consent & ethical issues in paediatric psychopharmacology. Indian Journal of Medical Research, 129(1), 19-32.
26. Mansell, W. (2007). Education by numbers: The tyranny of testing. London: Politico's Publishing.
27. Mansell, W., & James, M. (2009). Assessment in schools: Fit for purpose? A commentary by the teaching and learning research programme. Assessment Reform Group. Retrieved from http://www.assessment-reform-group.org/assessment-in-schools-fit-for-purpose.pdf
28. McAllister, D. (1995). Affect and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal, 38(1), 24-59.
29. McLeod, C. (2002). Self-trust and reproductive autonomy. Cambridge, MA: MIT Press.
30. National Union of Teachers (NUT). (2010). Common grounds on assessment and accountability in primary schools. National Union of Teachers. Retrieved from http://81.19.55.12/files/Common-Ground-8pp-7103.pdf
31. Newton, P. (2005). The public understanding of measurement error. British Educational Research Journal, 31(4), 419-442.
32. Newton, P. (2007). Comparability monitoring: Progress report. In P. Newton, J.-A. Baird, H. Goldstein, H. Patrick, & P. Tymms (Eds.), Techniques for monitoring the comparability of examination standards (pp. 452-476). London: QCA. Oates, T. (2007, September). The constraints on delivering public goods-a response to Randy Bennett's 'What does it mean to be a non-profit educational measurement organization in the 21st century?' A paper presented at the International Association for Educational Assessment annual conference, Baku, Azerbaijan.
33. Office for National Statistics (ONS). (n.d.). Retrieved from http://www.statistics.gov.uk/default.asp
34. Office of Public Sector Information (OPSI). (2009). Apprenticeships, skills, children and learning (ASCL) Act 2009. Retrieved from http://www.opsi.gov.uk/acts/acts2009/ukpga-20090022-en-1
35. Office of Qualifications and Examinations Regulation (Ofqual). (2009). The reliability programme-technical seminar report. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/Reliability-Programme-Technical-Seminar-Report.pdf
36. O'Neill, O. (2002). A question of trust: The BBC Reith lectures 2002. Cambridge: Cambridge University Press.
37. Opposs, D., & He, Q. (2011). The Reliability Programme: Final report. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/reliability/11-03-16-Ofqual-The-Final-Report. pdf
38. Pearson, S., & Raeke, L. (2000). Patients' trust in physicians: Many theories, few measures, and little data. Journal of General Internal Medicine, 15(7), 509-513.
39. Phelps, R., Zenisky, A., Hambleton, R., & Sireci, S. (2010). On the reporting of measurement uncertainty and reliability for U.S. Educational and Licensure Tests. Ofqual, Coventry, UK. Retrieved from http://www.ofqual.gov.uk/files/10-4759-measurement-of-reliabilty.pdf
40. Putnam, R. (1995). Bowling alone: America's declining social capital. Journal of Democracy, 6(1), 65-78.
41. Rattray, J., & Jones, M. (2007). Essential elements of questionnaire design and development. Journal of Clinical Nursing, 16(2), 234-243.
42. Reiss, S. (2000). Who am I? The 16 basic desires that motivate our actions and define our personalities. New York, NY: Tarcher/Putnam.
43. Richardson, W. (2007). Public policy failure and fiasco in education: Perspectives on the British examinations crises of 2000-2002 and other episodes since 1975. Oxford Review of Education, 33(2), 143-160.
44. Tattersall, K. (2007). A brief history of policies, practices and issues relating to comparability. In P. Newton, J.-A. Baird, H. Goldstein, H. Patrick, & P. Tymms (Eds.), Techniques for monitoring the comparability of examination standards (pp. 43-91). London: QCA.
45. Thrupp, M., & Tomlinson, S. (2005). Introduction: Education policy, social justice and 'complex hope'. British Educational Research Journal, 31(5), 549-556.
46. Tschannen-Moran, M., & Hoy, W. (2000). A multidisciplinary analysis of the nature, meaning, and measurement of trust. Review of Educational Research, 70(4), 547-593.
47. Tymms, P., Coe, R., & Merrell, C. (2005). Standards in English schools: Changes since 1997 and the impact of government policies and initiatives. A report for the Sunday Times. Retrieved from http://www.civitas.org.uk/pdf/Tymms-SundayTimes-v03.pdf
48. Warmington, P., & Murphy, R. (2004). Could do better? Media depictions of UK educational assessment results. Journal of Education Policy, 19(3), 285-299.
49. Wiliam, D. (2001). Reliability, validity, and all that jazz. Education 3-13, 29(3), 17-21.
50. Wilkinson, R., & Pickett, K. (2009). The spirit level. London: Allen Lane.
51. Wilmot, A., Jones, J., Dewar, A., Betts, P., Harper, R., & Simmons, E. (2005). Public confidence in official statistics. A qualitative study on behalf of the Office for National Statistics and the Statistics Commission. Office for National Statistics, UK. Retrieved from http://www.ons.gov.uk/about/who-we-are/our-services/data-collection-methodology/reportsand-publications
52. Wolf, A. (2002). Does education matter? Myths about education and economic growth. London: Penguin. Wools, S. (2009, November). Evaluation of validity and validation by means of the argumentbased approach. Paper presented at the AEA-Europe Conference, Attard, Malta. Retrieved from http://www.aea-europe.net/userfiles/14-Saskia%20Wools-Evaluation%20of%20Validity% 20and%20Validation.pdf
53. World Values Survey (WVS). (n.d.). World values survey: The world's most comprehensive investigation of political and sociocultural change. Retrieved from http://www.world valuessurvey.org/