Interrater agreement and reliability

Measurement in Physical Education and Exercise Science

Volumn 5, Issue 1, 2001, Pages 13-34

  Goodwin, L D ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

Generalizability theory; Interrater agreement; Interrater reliability

Indexed keywords

ANALYTICAL ERROR; ARTICLE; CORRELATION FUNCTION; HYPOTHESIS; OBSERVER VARIATION; RELIABILITY;

EID: 0035104580     PISSN: 1091367X     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15327841MPEE0501_2     Document Type: Article

References (78)

1. International bias detected in judging gymnastic competition at the 1984 Olympic Games
2. Norm-referenced measurement: Reliability
3. Back to basics: Percentage agreement measures are adequate, but there are easier ways
4. A graphical judgmental aid which summarizes obtained and chance reliability data and helps assess the believability of experimental effects
5. Generalizability theory
6. Generalizability of performance assessment
7. A perspective on the history of generalizability theory
8. Generalizability of performance assessment
9. Coefficient kappa: Some uses, misuses, and alternatives
10. The case against statistical significance testing, revisited
11. Using generalizability in behavioral observation
12. A coefficient of agreement for nominal scales
13. Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit
14. Application of generalizability theory to measurement of activity in males who are not regularly active: A preliminary report
15. Methodological studies - A personal retrospective
16. Reliability
17. Measuring nominal scale agreement among many raters
18. Large sample standard errors or kappa and weighted kappa
19. Observer agreement and reliabilities of classroom observational measures
20. Estimating generalizability of matrix-sampled science performance assessments
21. Reliability of observational data: Obtaining different results with different estimation techniques
22. Using generalizability theory in early childhood special education
23. Measurement myths and misconceptions
24. Issues and approaches to estimating interrater reliability in nursing research
25. Interrater reliability of parent-infant interaction scales
26. Estimating interinterviewer reliability for interview schedules used in special education research
27. Toward the development of structured criteria for interpretation of functional analysis data
28. Considerations in the choice of interobserver reliability estimates
29. The participation and perceptions of girls within a unit of sports education
30. Test reliability, estimated by analysis of variance
31. Application of regression analysis to exercise science
32. The reliability and validity of a chair sit-and-reach test as a measure of hamstring flexibility in older adults
33. Measures of response agreement for qualitative data: Some generalizations and alternatives
34. Criterion-referenced measurement: Reliability
35. "Home" improvement: The task for measurement specialists
36. Validity and generalizability of social dance performance ratings
37. Physical activity levels and prompts of young children at recess: A two-year study of a bi-ethnic sample
38. Generalizability theory
39. How "significant" is your reliability?
40. Efficacy of skinfold training clinics: A comparison between clinic trained and experienced testers
41. Developmental sequences for hopping as assessment instruments: A generalizability analysis
42. Reliability of the trunk lift in high school boys and girls
43. The equivalence of multiple rater kappa statistics and intraclass correlation coefficients
44. Statistical models for behavioral observations
45. Reliability of content analysis: The case of nominal scale coding
46. Sampling variability of performance assessments
47. Generalizability theory: 1973-1980
48. The measurement of teaching
49. Generalizability theory
50. Generalizability of change scores on the body awareness scale
51. Effects of direct instruction and environmentally designed instruction on the process and product characteristics of a fundamental skill
52. Statistical significance, result importance, and result generalizability: Three noteworthy but somewhat different issues
53. The use of generalizability theory in examining the dependability of scores on the profile of mood States
54. MINI-LOGGER reliability and validity for estimating energy expenditure and heart rate in adolescents
55. Comparison of modified to standard bioelectric impedance errors using generalizability theory
56. Reliability generalization: Exploring variance in measurement error affecting score reliability across studies
57. Statistical significance reporting: Current trends and uses in MECD
58. Generalizability and educational measurement
59. Students' physical activity levels and teachers' active supervision during fitness instruction
60. Using generalizability theory in counseling and development
61. Observational learning and the fearful child: Influence of peer models on swimming skill performance and psychological responses