Evaluating the rank-ordering method for standard maintaining

Research Papers in Education

Volumn 25, Issue 3, 2010, Pages 293-317

  Bramley, Tom ^a   Gill, Tim ^a  

^a University of Cambridge Local Examinations Syndicate   (United Kingdom)

Author keywords

Comparability; Equating; Latent trait; Ranking; Rasch; Standard maintaining

Indexed keywords

EID: 79958123451     PISSN: 02671522     EISSN: 14701146     Source Type: Journal    
DOI: 10.1080/02671522.2010.498147     Document Type: Article

References (25)

1. Andrich, D. 1978. Relationships between the Thurstone and Rasch approaches to item scaling. Applied Psychological Measurement 2: 449-60.
2. Baird, J.-A., and D. Dhillon. 2005. Qualitative expert judgements on examination standards: Valid, but inexact. Guildford: Assessment and Qualifications Alliance.
3. Black, B. 2008. Using an adapted rank-ordering method to investigate January versus June awarding standards. Paper presented at the EARLI/Northumbria Assessment Conference, August, in Berlin.
4. Black, B., and T. Bramley. 2008. Investigating a judgemental rank-ordering method for maintaining standards in UK examinations. Research Papers in Education 23, no. 3: 357-73.
5. Bond, T.G., and C.M. Fox. 2007. Applying the Rasch model: Fundamental measurement in the human sciences. 2nd ed. Mahwah, NJ: Lawrence Erlbaum.
6. Borsboom, D. 2005. Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge: Cambridge University Press.
7. Bramley, T. 2005. A rank-ordering method for equating tests by expert judgment. Journal of Applied Measurement 6, no. 2: 202-23.
8. Bramley, T. 2006. Equating methods used in Key Stage 3 science and English. Paper for the NAA technical seminar, March, in Oxford. http://www.cambridgeassessment.org.uk/ca/Our_Services/Research/Conference_Papers (accessed July 3, 2008).
9. Bramley, T. 2007. Paired comparison methods. In Techniques for monitoring the comparability of examination standards, ed. P.E. Newton, J. Baird, H. Goldstein, H. Patrick, and P. Tymms, 246-94. London: Qualifications and Curriculum Authority.
10. Bramley, T. 2009. The effect of manipulating features of examinees' scripts on their perceived quality. Paper presented at the annual conference of the Association for Educational Assessment Europe (AEA-Europe), November, in Malta.
11. Bramley, T., and B. Black. 2008. Maintaining performance standards: Aligning raw score scales on different tests via a latent trait created by rank-ordering examinees' work. Paper presented at the 3rd International Rasch Measurement Conference, January, in Perth, Australia.
12. Efron, B., and R.J. Tibshirani. 1993. An introduction to the bootstrap (Monographs on Statistics and Applied Probability, no. 57). New York: Chapman and Hall/CRC Press.
13. Fisher, W.P.J. 1992. Reliability statistics. Rasch Measurement Transactions 6, no. 3: 238.
14. Gill, T., T. Bramley, and B. Black. 2007. An investigation of standard maintaining in GCSE English using a rank-ordering method. Paper presented at the annual conference of the British Educational Research Association (BERA), September, in London.
15. Isobe, T., E.D. Feigelson, M.G. Akritas, and G.J. Babu. 1990. Linear regression in astronomy. Astrophysical Journal 364: 104-13.
16. Kolen, M.J., and R.L. Brennan. 2004. Test equating, scaling, and linking: Methods and practices. 2nd ed. New York: Springer.
17. Linacre, J.M. 2005. A user's guide to FACETS Rasch-model computer programs. www.winsteps.com.
18. Novakovic, N., and I. Suto. 2009. How should grade boundaries be determined in examinations? An exploration of the script features that influence expert judgements. Paper presented at the European Conference for Educational Research, September 28-30, in Vienna, Austria.
19. Ofqual (Office of the Qualifications and Examinations Regulator). 2009. GCSE, GCE, and AEA code of practice. London: QCA. http://www.ofqual.gov.uk/files/2009-04-14-codeof-practice.pdf (accessed October 29, 2009).
20. Pollitt, A. 1999. Thurstone and Rasch: Assumptions in scale construction. Awarding Bodies' seminar on comparability methods, November, held at AQA, Manchester.
21. Ricker, W.E. 1973. Linear regressions in fishery research. Journal of the Fisheries Research Board of Canada 30: 409-34.
22. Thurstone, L.L. 1927. A law of comparative judgment. Psychological Review 34: 273-86.
23. Warton, D.I., I.J. Wright, D.S. Falster, and M. Westoby. 2006. Bivariate line fitting methods for allometry. Biological Reviews 81: 259-91.
24. Wright, B.D., and G.N. Masters. 1982. Rating scale analysis. Chicago: MESA Press.
25. Wright, B.D., and M. Stone. 1979. Best test design. Chicago: MESA Press.