Assessing rater agreement using marginal association models

Statistics in Medicine

Volumn 21, Issue 12, 2002, Pages 1743-1760

  Perkins, Susan M ^a   Becker, Mark P ^b  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Category distinguishability; Log linear model; Marginal association model; Ordinal data; Rater agreement

Indexed keywords

ARTICLE; CONTINGENCY TABLE; CONTROLLED STUDY; FREQUENCY ANALYSIS; MEDICAL INFORMATION; METHODOLOGY; NONLINEAR SYSTEM; RATING SCALE; SCORING SYSTEM; STATISTICAL DISTRIBUTION; STATISTICAL MODEL; STATISTICAL PARAMETERS;

CARCINOMA IN SITU; DATA INTERPRETATION, STATISTICAL; HUMANS; LUNG NEOPLASMS; MODELS, STATISTICAL; OBSERVER VARIATION; SPUTUM;

EID: 0037199002     PISSN: 02776715     EISSN: None     Source Type: Journal    
DOI: 10.1002/sim.1146     Document Type: Article

References (37)

1. A coefficient of agreement for nominal scales
2. Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit
3. Estimating rater agreement in 2×2 tables: Correction for chance and intraclass correlation
4. The measurement of observer agreement for categorical data
5. General observer-agreement measures on individual subjects and groups of subjects
6. A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters
7. High agreement but low kappa: The problems of two paradoxes
8. Raking kappa: Describing potential impact of marginal distributions on measures of agreement
9. Modeling agreement among raters
10. Category distinguishability and observer agreement
11. A model for agreement between ratings on an ordinal scale
12. The analysis of ordinal agreement data: Beyond weighted kappa
13. Log-linear modelling of pairwise interobserver agreement on a categorical scale
14. Using association models to analyse agreement data: Two examples
15. Simple models for the analysis of association in cross-classifications having ordered categories
16. Quasisymmetric models for the analysis of square contingency tables
17. Simultaneously modeling joint and marginal distributions of multivariate categorical responses
18. A study of variability in the interpretation of sputum cytology slides
19. Variability in classification of carcinoma in situ of the uterine cervix
20. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers
21. Comparing marginal distributions of large, sparse contingency tables
22. Diagonal equivalence to matrices with prescribed row and column sums
23. How destination depends on origin in the occupational mobility table
24. Loglinear models and frequency tables with small expected counts
25. Tests for independence in two-way contingency tables with ordered classifications
26. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability
27. Maximum-likelihood estimation of parameters subject to restraints
28. Log-linear models for correlated marginal totals of a contingency table
29. Maximum likelihood in three-way contingency tables
30. The Fisher information matrix for log-linear models arguing conditionally on the observed explanatory variables
31. On the comparison of multinomial and poisson log-linear models
32. On model fitting for multivariate polytomous response data
33. Maximum likelihood methods for a generalized class of log-linear models
34. Simultaneous modeling of marginal distributions and log-multiplicative associations for ordered multivariate categorical data