Evaluating Judge Performance in Sport

Journal of Applied Measurement

Volumn 5, Issue 1, 2004, Pages 31-47

  Looney, Marilyn A ^a  

^a NORTHERN ILLINOIS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ATHLETES; RASCH ANALYSIS; SCORING SYSTEM; SPORTS;

MATHEMATICAL MODELS; PERSONNEL TRAINING; SKATING RINKS; SKI JUMPS; STATISTICAL METHODS;

MEASUREMENT THEORY;

ARTICLE; CERTIFICATION; EVALUATION; HUMAN; OBSERVER VARIATION; POLICY; REPRODUCIBILITY; SPORT; STANDARD; STATISTICAL ANALYSIS; STATISTICAL MODEL; TASK PERFORMANCE;

CERTIFICATION; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; OBSERVER VARIATION; ORGANIZATIONAL POLICY; REPRODUCIBILITY OF RESULTS; SKATING; SPORTS; TASK PERFORMANCE AND ANALYSIS;

EID: 0442326603     PISSN: 15297713     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (41)

1. Berry, S. M. (2002). Gold medals, protests, and trading ratings: The 2002 Winter Olympics figure skating. Chance, 15(2), 14-18.
2. Campbell, R., and Galbraith, J. (1996, August). Non-parametric tests of the unbiasedness of Olympic figure skating judgments. Paper presented at the 1996 Joint Statistical Meetings, Chicago.
3. Fisher, W. P., Jr. (1997). Physical disability construct convergence across instruments: Towards a universal metric. Journal of Outcome Measurement, 1, 87-113.
4. Guttery, R. S., and Sfiridis, J. (1996, August). Judging bias in Olympic and World Figure Skating Championships: 1982-1994. Paper presented at the 1996 Joint Statistical Meetings, Chicago.
5. Heineman-Pieper, J., and Lunz, M. E. (2002). Identifying problematic examiners in an oral examination. Popular Measurement, 4, 6-12.
6. IceCalc.com. (2002, February). 2002 Olympic Winter Games. Retrieved February 13, 2002, from http://wwwicecalc.com/events/owg2002/results/index.htm.
7. th Ordinary Congress. Author.
8. International Skating Union. (1998). Communication No. 997: New ISU figure skating results system. Retrieved March 23, 2002, from http://www.isu.org/news/997.html.
9. International Skating Union. (2000). Communication No. 1086: Short program deductions. Retrieved December 11, 2002, from http://www.isu.org/news/1086.pdf.
10. th Ordinal Congress. Retrieved June 27, 2002, from http://www.isu.org/news/1162.html.
11. th ISU Ordinary Congress: Day 4 News release. Retrieved June 6, 2002, from http://www.isu.org/news/49thday4.html.
12. International Skating Union. (2002c, September). Summary of new judging system for figure skating News release. Retrieved October 1, 2002, from http://www.isu.org/news/judging_summary.html.
13. International Skating Union. (2003a, April). Communication No. 1207: New judging system figure skating/ice dancing. Retrieved November 6, 2003, from http://www.isu.org/vsite/vfile/page/fileurl/0,11040, 4844-143302-160518-34133-0-file,00.pdf.
14. International Skating Union. (2003b, October). Communication No. 1238: Figure skating/ice dancing/synchronized skating judges' assessment procedure season 2003/04 for competitions conducted under the interim and new judging systems. Retrieved November 6, 2003, from http://www.isu.org/vsite/vfile/page/fileurl/0,11040, 4844-143667-160883-46096-0-file,00.pdf.
15. International Skating Union. (2003c, September 8). Frequently asked questions (FAQ) on the ISU new judging system. Retrieved November 6, 2003, from http://www.isu.org/vsite/vfile/page/fileurl/0,11040, 4844-140303-157519-42553-0-file,00.pdf.
16. Linacre, J. M. (1989). Many-facet Rasch measurement. Chicago: MESA Press.
17. Linacre, J. M. (1993). Rasch-based generalizability theory. Rasch Measurement Transactions, 7, 283-284.
18. Linacre, J. M. (1998). Rating, judges and fairness. Rasch Measurement Transactions, 12, 630-631.
19. Linacre, J. M. (2001). Standardized meansquares. Rasch Measurement Transactions, 15, 813.
20. Linacre, J. M. (2002a). Minifacets (version 3.41 [computer software]). Chicago: Winsteps.com.
21. Linacre, J. M. (2002b). A user's guide to FACETS: Rasch-model computer programs. Chicago: Winsteps.com
22. Linacre, J. M. (2002c). What do infit and outfit, mean square and standardized mean? Rasch Measurement Transactions, 16, 878.
23. Linacre, J. M., and Wright, B. D. (2002). Construction of measures from many-facet data. Journal of Applied Measurement, 3, 486-512.
24. Looney, M. A. (1997). Objective measurement of figure skating performance. Journal of Outcome Measurement, 1, 143-163.
25. McNamara, T. (1996). Measuring second language performance. New York: Longman.
26. Myford, C. M., and Wolfe, E. W. (2003). Detecting and measuring rater effects using Many-Facet Rasch measurement: Part I. Journal of Applied Measurement, 4, 386-422.
27. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests (Expanded edition, 1980. Chicago: University of Chicago Press.)
28. Seltzer, R., and Glass, W. (1991). International politics and judging in Olympic skating events: 1968-1988. Journal of Sport Behavior, 14, 189-200.
29. Smith, R. M. (1996). Polytomous mean-square fit statistics. Rasch Measurement Transactions, 10, 516-517.
30. Smith, R. M., and Suh, K. K. (2003). Rasch fit statistics as a test of the invariance of item parameter estimates. Journal of Applied Measurement, 4, 153-163.
31. Stahl, J. A., and Lunz, M. E. (1996). Judge and performance reports: Media and message. In G. Engelhard, Jr. and M. Wilson (Eds.). Objective measurement: Theory into practice Vol. 3 (pp.113-125). Norwood, NJ: Ablex.
32. USFSA Judges Educational and Training Committee. (2002a, February). Singles/pairs manual for tests and competition judge's training (revised ed.). Retrieved March 22, 2002, from http//:www.usfa..org/about/forms/judges/00S=PSchool%20manual2-02.pdf.
33. USFSA Judges Educational and Training Committee. (2002b, August ). Competition handbook for single and pairs judges: 2002-2003 season. Retrieved November 9, 2002, from http://www.usfsa.org/about/forms/judges/index.html.
34. Whissell, R., Lyons, S., Wilkinson, D., and Whissell, C. (1993). National bias in judgments of Olympic-level skating. Perceptual and Motor Skills, 77, 355-358.
35. Wright, B. D. (1991). Diagnosing misfit. Rasch Measurement Transactions, 5(2), p. 156. In J.M. Linacre (Ed.), Rasch measurement transactions part 1 (1995). Chicago: MESA Press.
36. Wright, B. D. (1991). Diagnosing misfit. Rasch Measurement Transactions, 5(2), p. 156. In J.M. Linacre (Ed.), Rasch measurement transactions part 1 (1995). Chicago: MESA Press.
37. Wright, B. D. (1992). What is the "right" test length? Rasch Measurement Transactions, 6, 205.
38. Wright, B. D. (1994). Data analysis and fit. Rasch Measurement Transactions, 7, 324.
39. Wright, B. D. (1997). Ahistory of social science measurement. (Institute of Objective Measurement Memoranda #62). Retrieved August 24, 2002 from http://www.rasch.org/memo62.htm.
40. Wright, B. D., and Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370.
41. Wright, B. D., and Masters, G. N. (1982). Rating scale analysis. Chicago: MESA Press.