Using the Method of Pairwise Comparison to Obtain Reliable Teacher Assessments

Australian Educational Researcher

Volumn 37, Issue 2, 2010, Pages 1-19

  Heldsinger, Sandra ^a   Humphry, Stephen ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79958859622     PISSN: 03116999     EISSN: 22105328     Source Type: Journal    
DOI: 10.1007/BF03216919     Document Type: Article

References (36)

1. Andrich, D. (1978a). Relationships between the Thurstone and Rasch approaches to item scaling. Applied Psychological Measurement, 2(3), 449-460.
2. Andrich, D. (1978b). A rating formulation for ordered response categories. Psychometrika, 43, 561-73.
3. Andrich, D. (1988). Rasch models for measurement. Beverly Hills: Sage Publications.
4. Andrich, D. (2006). A report to the Curriculum Council regarding assessment for tertiary selection. Perth: Curriculum Council of Western Australia. [Available from: www. curriculum. wa. edu. au/internet/_Documents/Publications/Andrich+Report. pdf].
5. Andrich, D., & Luo, G. (2003). Conditional Pairwise estimation in the Rasch model for ordered response categories using principle components. Journal of Applied Measurement, 4, 205-221.
6. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74.
7. Bock, D. (1997). A brief history of item response theory. Educational Measurement: Issues and Practice, 16, 21-33.
8. Bond, T., & Caust, M. (2005, November). Silk purses from sows' ears? Making measures from teacher judgements. Paper presented at the Australian Association for Research in Education Conference, Sydney [published January 2006].
9. Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum.
10. Bradley, R. A., & Terry, M. E. (1952). Rank analysis of incomplete block designs, I. The method of paired comparisons. Biometrika, 39, 324-345.
11. Bramley, T., Bell, J. F., & Pollitt, A. (1998). Assessing changes in standards over time using Thurstone's paired comparisons. Education Research and Perspectives, 2, 1-23.
12. Brookhart, S. M. (2003). Developing measurement theory for classroom assessment purposes and uses. Educational Measurement: Issues and Practice, 22(4), 5-12.
13. Chudowsky, N., & Pellegrino, J. W. (2003). Large-scale assessments that support learning: what will it take?Theory into Practice, 42(1), 75-83.
14. Clarke, S., & Gipps, C. (2000). The role of teachers in teacher assessment in England, 1996-1998, Evaluation and Research in Education, 14(1), 38-52.
15. Department of Education and Training, Western Australia (1997). First Steps Writing Developmental Continuum. Richmond, Australia: Heinemann.
16. Gregory, K., & Clarke, M. (2003). High-stakes assessment in England and Singapore. Theory into Practice, 42(1), 66-74.
17. Groves, P. (2002). "Doesn't it feel morbid here?" High stakes testing and the widening of the equity gap. Educational Foundations, 16(2), 15-31.
18. Gunzenhauser, M. (2003). High-stakes testing and the default philosophy of education. Theory into Practice, 42(1), 51-58.
19. Holme, B., & Humphry, S. M. (2008). PairWise software. Perth: University of Western Australia.
20. Louden, B., Chapman, E., Clarke, S., Cullity, M., & House, H. (2006). Evaluation of the Curriculum Improvement Program Phase 2. Report for the Department of Education and Training prepared in the Graduate School of Education, University of Western Australia. Accessed January 10, 2009, from http://www. det. wa. edu. au/education/ accountability/docs/curriculumreport. pdf
21. Luce, R. D. (1959). Individual Choice Behaviours: A theoretical analysis. New York: J. Wiley.
22. Luke, A., & Woods, A. (2007). Learning lessons: What No Child Left Behind can teach us about literacy, testing and accountability. QTU Professional Magazine, November, 5-9.
23. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
24. Ministerial Council for Education, Employment, Training and Youth Affairs (2008). National declaration on educational goals for young Australians. Retrieved December 12, 2008, from http://www. mceetya. edu. au/mceetya/natgoals, 24767. html.
25. Performance Measurement Review Taskforce. A paper about the benefits of participating in national assessments. Retrieved December 12, 2008, from http://www. curriculum. edu. au/verve/_resources/Benefits_of_participation_in_national_assessments1. pdf.
26. Rasch, G. (1961/1980). On General Laws and the Meaning of Measurement in Psychology. In J. Neyman (Ed.), Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 4: Contributions to Biology and Problems of Medicine, pp. 321-333. Berkeley: University of Chicago Press. [Available from: http://projecteuclid. org/DPubS?service=UI& version=1. 0& verb=Display& handle=euclid. bsmsp/1200512872].
27. Shepard, L. A. (2003). The hazards of high stakes testing. Issues in Science and Technology, 19(2), 53-58.
28. Sloane, F. C., & Kelly, A. E. (2003). Issues in high-stakes testing programs. Theory into Practice, 42(1), 12.
29. Smith, A. B., Rush, R., Fallowfield, L. J., Velikova, G., & Sharpe, M. (2008). Rasch fit statistics and sample size considerations for polytomous data. Medical Research Methodology, 8, 33.
30. Stiggins, R. J. (2001). The unfulfilled promise of classroom assessment. Educational Measurement: Issues and Practice, 20(3) 5-15.
31. Thurstone, L. L. (1927). A law of comparative judgement. Psychological Review, 34, 278-286.
32. Thurstone, L. L. (1928). Attitudes can be measured. American Journal of Sociology, 33, 529-54.
33. Thurstone, L. L (1959). The measurement of values. Chicago, USA: The University of Chicago Press.
34. Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago: MESA Press.
35. Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: MESA Press.
36. Wyatt-Smith, C. (2000). Exploring the relationship between large-scale literacy testing programs and classroom-based assessment: A focus on teachers' accounts. Australian Journal of Language and Literacy, 23(2), 109-127.