Erratum to The method of Adaptive Comparative Judgement (STM Guidelines on Preservation of the Objective Record of Science, (2012), 10.1080/0969594X.2012.665354);The method of Adaptive Comparative Judgement

Assessment in Education: Principles, Policy and Practice

Volumn 19, Issue 3, 2012, Pages 281-300

  Pollitt, Alastair ^a  

^a Cambridge Exam Research   (United Kingdom)

Author keywords

assessment methods; judgement; marking; reliability

Indexed keywords

EID: 84863613200     PISSN: 0969594X     EISSN: 1465329X     Source Type: Journal    
DOI: 10.1080/0969594X.2012.694697     Document Type: Erratum

References (40)

1. Andrich, D. 1978. Relationships between the Thurstone and Rasch approaches to item scaling. Applied Psychological Measurement, 2(3): 449-460.
2. Baird, J., P. Black, A. Béguin, A. Pollitt, and G. Stanley. 2011. The Reliability Programme: Final report of the Technical Advisory Group. Coventry, UK: Ofqual. http://www.ofqual.gov.uk/research-and-statistics/research-reports/92-articles/20-reliability.
3. Baker, E.L., Ayers, P., O'Neill, H.F., Choi, K., Sawyer, W., Sylvester, R.M. and Carroll, B. 2008. KS3 English test marker study in Australia. Final report to the National Assessment Agency of England, London: QCA.
4. Bew, P. 2011. Independent review of Key Stage 2 testing, assessment and accountability. London: Department for Education. https://media.education.gov.uk/MediaFiles/C/C/0/{CC021195-3870-40B7-AC0B-66004C329F1F}Independent%20review%20of%20KS2%20testing,%20final%20report.pdf.
5. Biggs, J. and Tang, C. 2007. Teaching for quality learning at university, 3rd ed Buckingham: SRHE and Open University Press.
6. Bradley, R. A. and Terry, M.E. 1952. Rank analysis of incomplete block designs, 1 The method of paired comparisons. Biometrika, 39(3/4): 324-345.
7. Bramley, T. 2007. Paired comparison methods. In Techniques for monitoring the comparability of examination standards, ed. P. Newton, J. Baird, H. Goldstein, H. Patrick, and P. Tymms, 246-94. London: QCA. http://www.ofqual.gov.uk/files/2007-comparability-exam-standards-i-chapter7.pdf.
8. Brennan, R.L. 2001. Generalizability theory, New York: Springer-Verlag.
9. Cronbach, L.J., Gleser, G.C., Nanda, H. and Rajaratnam, N. 1972. The dependability of behavioral measurements: Theory of generalizability for scores and profiles, New York: Wiley.
10. D'Arcy, J., ed. 1997. Comparability studies between modular and non-modular syllabuses in GCE Advanced level biology, English literature and mathematics in the 1996 summer examinations. Standing Committee on Research. Belfast: Joint Forum for the GCSE and GCE.
11. Davies, D. 2008. e-scape phase 3 science final report-December 2008. Bath Spa University. http://www.bathspa.ac.uk/schools/education/research/docs/08-09/09-e-scape-final-report.pdf.
12. Fearnley, A. 2000. A comparability study in GCSE mathematics. A study based on the summer 1998 examination. Assessment and Qualifications Alliance (Northern Examinations and Assessment Board). Manchester: Joint Forum for the GCSE and GCE.
13. Good, E.F. and Cresswell, M.J. 1988. Grade awarding judgements in differential examinations. British Educational Research Journal, 14(3): 263-281.
14. Gray, E. 2000. A comparability study in GCSE science 1998. A study based on the summer 1998 examination. Oxford Cambridge and RSA Examinations (Midland Examining Group). Cambridge: Joint Forum for the GCSE and GCE.
15. Greatorex, J., G. Elliott, and J. Bell. 2002. A comparability study in GCE AS chemistry: A review of the examination requirements and a report on the cross-moderation exercise. A study based on the summer 2001 examination. Research and Evaluation Division, University of Cambridge Local Examinations Syndicate for Oxford Cambridge and RSA Examinations. Cambridge: Joint Council for General Qualifications.
16. Heldsinger, S. and Humphry, S. 2010. Using the method of pairwise comparison to obtain reliable teacher assessments. The Australian Educational Researcher, 37(2): 1-19.
17. Jones, I., A. Pollitt, and M. Swan. In review. Adaptive Comparative Judgement for assessing problem solving and sustained reasoning. Submitted to Journal of the Learning Sciences.
18. Kelly, G. 1955. The psychology of personal constructs, Vols. I and II New York: Norton.
19. Kimbell, R., T. Wheeler, S. Miller, and A. Pollitt. 2007. e-scape portfolio assessment: Phase 2 report. London: Technology Education Research Unit, Goldsmiths, UL. http://www.gold.ac.uk/media/e-scape2.pdf.
20. Kimbell, R., T. Wheeler, K. Stables, T. Sheppard, F. Martin, D. Davies, A. Pollitt, and G. Whitehouse. 2009. e-scape portfolio assessment: Phase 3 report. London: Technology Education Research Unit, Goldsmiths, UL. http://www.gold.ac.uk/teru/projectinfo/projecttitle,5882,en.php.
21. Laming, D. 2004. Human judgment: The eye of the beholder, London: Thomson Learning.
22. Luce, R.D. 1959. Individual choice behaviours: A theoretical analysis, New York: J. Wiley.
23. Martin, F., and D. Lambert. 2008. Report for geography 'e-scape'. Initial trial; June 2007-December 2008. Sheffield: Geographical Association. http://www.geography.org.uk/projects/e-scape/trialsandreport/.
24. Newton, P. 2009. The reliability of results from national curriculum testing in England. Educational Research, 51(2): 181-212.
25. Pollitt, A. 2004. Let's stop marking exams. Paper presented at the annual conference of the International Association of Educational Assessment, June 13-18, in Philadelphia, USA.
26. Pollitt, A., A. Ahmed, and V. Crisp. 2007. The demands of examination syllabuses and question papers. In Techniques for monitoring the comparability of examination standards, ed. P. Newton, J. Baird, H. Goldstein, H. Patrick, and P. Tymms, 166-206. London: QCA. http://www.ofqual.gov.uk/files/2007-comparability-exam-standards-g-chapter5.pdf.
27. Pollitt, A., and G. Elliott. 2003. Monitoring and investigating comparability: A proper role for human judgement. Paper given at the QCA 'Comparability and Standards' seminar, April 4, in Newport Pagnell, UK.
28. Pollitt, A., and N.J. Murray. 1993. What raters really pay attention to. Paper presented at Language Testing Research Colloquium, August 2-4, in Cambridge. Republished in Studies in language testing 3: Performance testing, cognition and assessment, ed. M. Milanovic and N. Saville (1995), 74-91. Cambridge: Cambridge University Press.
29. QCDA (Qualifications and Curriculum Development Agency). 1999-2011. English. The National Curriculum for England. London: QCDA. http://curriculum.qcda.gov.uk/uploads/English%201999%20programme%20of%20study_tcm8-12054.pdf.
30. Rasch, G. 1960. Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research. Reprinted 1980, Chicago, IL: University of Chicago Press.
31. Reckase, M. 2011. Computerized Adaptive Assessment (CAA): The way forward. In The road ahead for state assessments, 1-11. Policy analysis for California Education and Rennie Center for Education Research & Policy. Cambridge, MA: Rennie Center for Education Research & Policy.
32. Royal-Dawson, L. 2005. Is teaching experience a necessary condition for markers of Key Stage 3 English?, London: Qualifications and Curriculum Authority.
33. Royal-Dawson, L. and Baird, J. 2009. Is teaching experience necessary for reliable scoring of extended English questions?. Educational Measurement: Issues and Practice, 28(2): 2-8.
34. Straetmans, G.J.M. and Eggen, T.J.H.M. 1998. Computerized adaptive testing: What it is and how it works. Educational Technology, 38(1): 45-52.
35. Thurstone, L.L. 1927a. A law of comparative judgment. Psychological Review, 34, no. 4: 273-86. Reprinted in L.L. Thurstone. 1959. The measurement of values, Chapter 3. Chicago, IL: University of Chicago Press.
36. Thurstone, L.L. 1927b. Psychophysical analysis. The American Journal of Psychology, 38(3): 368-389.
37. Thurstone, L.L. 1931. Measurement of change in social attitude. Journal of Social Psychology, 2(2): 230-235.
38. Van der Linden, W.J. and Glas, C.A.W. 2000. Computerized adaptive testing: Theory and practice, Boston, MA: Kluwer.
39. Wainer, H., ed. 2000. Computerized adaptive testing: A primer. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum.
40. Wright, B.D. and Masters, G.N. 1982. Rating Scale Analysis: Rasch measurement, Chicago, IL: MESA Press.