A weighted Kappa coefficient for three observers as a measure for reliability of expert ratings on characteristics in handball throwing patterns

Measurement in Physical Education and Exercise Science

Volumn 11, Issue 3, 2007, Pages 177-187

  Schorer, Jörg ^a   Weiß, Christel ^b  

^a UNIVERSITY OF MÜNSTER   (Germany)

^b UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

Handball; Movement pattern; Multiple observer; Rating; Weighted Kappa

Indexed keywords

ARTICLE; BODY MOVEMENT; FEMALE; HUMAN; HUMAN EXPERIMENT; KAPPA STATISTICS; MALE; NORMAL HUMAN; OBSERVER VARIATION; RELIABILITY; SPORT; STATISTICAL ANALYSIS;

EID: 34447503934     PISSN: 1091367X     EISSN: None     Source Type: Journal    
DOI: 10.1080/10913670701326484     Document Type: Article

References (21)

1. Altman, D. G. (1998). Some common problems in medical research. Practical statistics for medical research (8th ed., pp 403-409). London, Weinheim, New York: Chapman & Hall.
2. Brilliant, L. B., Lepowski, J. M., & Musch, D. C. (1983). Reliability of ophthalmic diagnoses in an epidemiologic survey. American Journal of Epidemiology, 118, 265-279.
3. Cichetti, D. V., & Allison T. (1971). A new procedure for assessing reliability of scoring EEG sleep recordings. American Journal of EEG Technology, 11, 101-109.
4. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
5. Cohen, J. (1968). Weighted Kappa. Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213-220.
6. Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378-382.
7. Fradet, L., Botcazou, M., Durocher, C., Cretual, A., Multon, F., Prioux, J., et al (2004). Do handball throws always exhibit a proximal-to-distal segmental sequence? Journal of Sport Sciences, 22, 439-447.
8. Gail, M., & Simon,. R. (1985). Testing for qualitative interactions between treatment effects and patient subsets. Biometrics, 41, 361-372.
9. Hatzl, T. (2000). Kinematische Analyse von Sprungwürfen als Grundlage für das Wahrnehmungs-und Antizipationstraining des Handballtorwarts [Kinematic analysis of jump throws as a base for perception and anticipation training of handball goalkeepers]. Spectrum der Sportwissenschaft, 2, 66-82.
10. Hosmer, D. W., & Lemeshow, S. (1989). Applied logistic regression. New York: John Wiley and Sons, Inc.
11. Kraemer, H. C. (1992). Measurement of reliability for categorical data in medical research. Statistical Methods in Medicine Research, 1, 183-199.
12. Krummenauer, F. (2000). Evaluation von Diagnosevorschriften Mittels Interkategorieller Kappa-Maße [Evaluation of diagnostic rules by between categories Kappa-measurements]. Radiologe, 40, 313-318.
13. Little, R. E., Worthingham-Roberts, B., & Mann, S. L. (1984). Test-retest reliability of diet and drinking estimates for pregnancy and post partum. American Journal of Epidemiology, 120, 794-797.
14. Lerchen, M. L., & Samet, J. M. (1986). An assessment of the validity of questionnaire responses provided by a surviving spouse. American Journal for Epidemiology, 123, 481-489.
15. Magill, R. A. (2006). Motor learning and control: Concepts and applications (8th ed.). New York: McGraw-Hill.
16. Posner, K. L., Sampson, P. D., Caplan, R. A., Ward, R. J., & Cheney, F. W. (1990). Measuring interrater reliability among multiple raters: an example for methods of nominal data. Statistics in Medicine, 9, 1103-1115.
17. Roberts, C., & McNaemee, R. (1998). A matrix of Kappa-type coefficients to assess the reliability of nominal scales. Statistics in Medicine, 17, 471-488.
18. Roth, K. (1996). Techniktraining im Spitzensport: Alltagstheorien erfolgreicher Trainer [Technical training at high-performance sport: Everyday life's theories of successful coaches]. Köln: Sport und Buch Strauss.
19. Schorer, J. (2007). Höchstleistung im Handballtor - Eine Studie zur Identifikation, den Mechanismen und der Entwicklung senso-motorischer Expertise [High performance in handball goals - A study on the identification, mechanisms, and development of sensory-motor expertise]. http://www.ub.uni-heidelberg.de/archiv/7310.
20. Schorer, J., Baker, J., Fath, F., & Jaitner, T. (2007). Identification of inter- and intra-individual movement patterns in handball players of varying expertise levels (in press).
21. Smeeton, N. J., Williams, A. M., Hodges, N. J., & Ward, P. (2005). The relative effectiveness of various instructional approaches in developing anticipation skills. Journal of Experimental Psychology: Applied, 11, 98-110.