What goes through an examiner's mind? Using verbal protocols to gain insights into the GCSE marking process

British Educational Research Journal

Volumn 34, Issue 2, 2008, Pages 213-233

  Suto, W M Irenka ^a   Greatorex, Jackie ^a  

^a University of Cambridge Local Examinations Syndicate   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41549143693     PISSN: 01411926     EISSN: 14693518     Source Type: Journal    
DOI: 10.1080/01411920701492050     Document Type: Article

References (39)

1. Baddeley, A. (1999) Essentials of human memory (Hove, Psychology Press).
2. Baird, J., Greatorex, J. & Bell, J. F. (2004) What makes marking reliable? Experiments with UK examinations, Assessment in Education, 11, 331-348.
3. Best, W., Bryan, K. & Maxim, J. (2000) Semantic processing: theory and practice (London, Whurr).
4. Cumming, A. (1990) Expertise in evaluating second language compositions, Language Testing, 7, 31-51.
5. Department for Education and Skills (2005) 14-19 Education and skills (London, HMSO).
6. Ericsson, K. & Simon, H. (1993) Protocol analysis: verbal reports as data (London, MIT Press).
7. Garner, W. (1954) Context effects and the validity of loudness scales, Journal of Experimental Psychology, 48, 218-224.
8. Garner, W. (1959) The development of context effects in half-loudness judgments, Journal of Experimental Psychology, 58, 212-219.
9. Gilovich, T., Griffin, D. & Kahneman, D. (2002) Heuristics and biases: the psychology of intuitive judgment (Cambridge, Cambridge University Press).
10. Green, A. (1998) Studies in language testing 5: Verbal protocol analysis in language testing research - a handbook (Cambridge, Cambridge University Press/University of Cambridge Local Examinations Syndicate).
11. Hall, K. & Harding, A. (2002) Level descriptors and teacher assessment in England: towards a community of assessment practice, Educational Research, 44, 1-16.
12. Kahneman, D. (1991) Judgment and decision making: a personal view, Psychological Science, 2, 142-145.
13. Kahneman, D. & Frederick, S. (2002) Representativeness revisited: attribute substitution in intuitive judgment, in: T. Gilovich, D. Griffin & D. Kahneman (Eds) Heuristics and biases: the psychology of intuitive judgment (Cambridge, Cambridge University Press).
14. Kahneman, D. & Tversky, A. (1982) On the study of statistical intuitions, Cognition, 11, 123-141.
15. Kahneman, D. & Tversky, A. (1996) On the reality of cognitive illusions, Psychological Review, 103, 582-591.
16. Kahneman, D. & Tversky, A. (2000) Choices, values, and frames (Cambridge, Cambridge University Press).
17. Kahneman, D., Slovic, P. & Tversky, A. (1982) Judgment under uncertainty: heuristics and biases (Cambridge, Cambridge University Press).
18. Kramer, A., Coles, M. & Logan, G. (1996) Converging operations in the study of visual selective attention (Washington DC, American Psychological Association).
19. Laming, D. (1990) The reliability of a certain university examination compared with the precision of absolute judgments, Quarterly Journal of Experimental Psychology, 42A, 239-254.
20. Laming, D. (2004) Human judgment. The eye of the beholder (London, Thomson).
21. Lave, J. (1997) Cognition in practice: mind, mathematics and culture in everyday life (Cambridge, Cambridge University Press).
22. Leighton, J. (2004) Avoiding misconception, misuse, and missed opportunities: the collection of verbal reports in educational achievement testing, Educational Measurement, Winter, 6-15.
23. Milanovic, M., Saville, N. & Shuhong, S. (1996) A study of the decision-making behaviour of composition markers, in: M. Milanovic & N. Saville (Eds) Studies in language testing 3: Performance testing, cognition and assessment - selected papers from the 15th Language Testing Research Colloquium, Cambridge and Arnhem (Cambridge, Cambridge University Press/ University of Cambridge Local Examinations Syndicate).
24. Nobel Foundation (2002) The Bank of Sweden Prize in Economic Sciences in memory of Alfred Nobel 2002, Available online at: http://nobelprize.org/ economics/laureates/2002/ (accessed 7 February 2006).
25. O'Donnell, S. (2004) International review of curriculum and assessment frameworks: comparative tables and factural summaries - 2004 (London, Qualifications and Curriculum Authority & National Foundation for Educational Research).
26. Oxford, , Cambridge, RSA Examinations (2006) Qualification finder Available online at: http://www.ocr.org.uk (accessed 7 February 2006).
27. Pollack, I. (1952) The information from elementary auditory displays, Journal of the Acoustical Society of America, 24, 745-749.
28. Pollack, I. (1953) The information from elementary auditory displays II, Journal of the Acoustical Society of America, 24, 745-749.
29. Qualifications, Curriculum Authority (2005) GCSE, GCE, VCE, GNVQ, and AEA code of practice 2005/6 (London, Qualifications and Curriculum Authority).
30. Rabbitt, R. & Dornic, S. (1975) Attention and performance V (London, Academic Press).
31. Shaw, S. (2004) On-screen marking: investigating the examiners' experience through verbal protocol analysis Unpublished report (Cambridge, University of Cambridge Local Examinations Syndicate).
32. Sherif, M. (1937) An experimental approach to the study of attitudes, Sociometry, 1, 90-98.
33. Stanovich, K. & West, R. (2002) Individual differences in reasoning, in: T. Gilovich, D. Griffin & D. Kahneman (Eds) Heuristics and biases: the psychology of intuitive judgment (Cambridge, Cambridge University Press).
34. Stevens, (1956) The direct estimation of sensory magnitudes-loudness, American Journal of Psychology, 69, 1-25.
35. Van Someren, M., Barnard, Y. & Sandberg, J. (1994) The think aloud method- a practical guide to modelling cognitive processes (London, Academic Press).
36. Vaughan, C. (1992) Holistic assessment: what goes on in the rater's mind?, in: L. Hamp-Lyons (Ed.) Assessing second language writing in academic contexts (Norwood, NJ, Ablex).
37. Webster, F., Pepper, D. & Jenkins, A. (2000) Assessing the undergraduate dissertation, Assessment and Evaluation in Higher Education, 25, 71-80.
38. Wenger, E. (1998) Communities of practice: learning, meaning and identity (Cambridge, Cambridge University Press).
39. Yorke, M., Bridges, P. & Woolf, H. (2000) Mark distributions and marking practices in UK higher education, Active Learning in Higher Education, 1, 7-27.