Rating of the structures of agreement and disagreement in reliability studies;Avaliação das estruturas de concordância e discordância nos estudos de confiabilidade

Revista de Saude Publica

Volumn 32, Issue 4, 1998, Pages 383-393

  Da Silva, Eduardo Freitas ^a,b   Gomes Pereira, Maurício ^a  

^a UNIVERSITY OF BRASILIA   (Brazil)

^b Campus Universitário ^*  (Brazil)

Author keywords

Log linear models Public health

Indexed keywords

ARTICLE; EVALUATION; REPRODUCIBILITY; STATISTICAL MODEL;

EVALUATION STUDIES; LINEAR MODELS; REPRODUCIBILITY OF RESULTS;

EID: 0032130338     PISSN: 00348910     EISSN: None     Source Type: Journal    
DOI: 10.1590/s0034-89101998000400012     Document Type: Article

References (30)

1. AGRESTI, A. A model for agreement between ratings on a ordinal scale. Biometrics, 44: 539-48, 1988.
2. AGRESTI, A. Categorical data analysis.New York, John Wiley, 1990.
3. BECKER, M. P. Using association models to analyse agreement data: two examples. Stat. Med., 8:1199-207, 1989.
4. BISHOP, Y.V.V.; FIENBERG, S. E.; HOLLAND, P. W. Discrete multivariate analysis. Cambridge, MA, MIT Press, 1975.
5. CICCHETTI, D.V. & FLEISS, J.L. Comparison of the null distributions of weighted kappa and the C ordinal statistic. Appl. Psychol. Meas., 1: 195-201, 1977.
6. CICCHETTI, D.V. Testing the normal approximation and minimal sample size requirements of weighted kappa when the number of categories is large. Appl. Psychol. Meas., 5: 101-4, 1981.
7. COHEN, J. A coeficient of agreement for nominal scales. Educ. Psychol. Meas., 20: 37-46, 1960.
8. COHEN, J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol. Bull.,70: 213-20, 1968.
9. CONGER, A.J. Integration and generalization of kappa for multiple raters. Psychol. Bull., 88: 322-8, 1980.
10. COUGHLIN, S.S.; PICKLE, L. W.; GOODMAN, M. T.; WILKENS, L.R. The logistic modeling of interobserver agreement. J. Clin. Epidemiol., 45: 1237-41, 1992.
11. DARROCH, J. & MCCLOUD, P.I. Category of distinguishability and observer agreement. Aust. J. Stat., 28: 371-88, 1986.
12. ELMORE, J.G. & FEINSTEIN, A.R. Publications on observer variability. J. Clin. Epidemiol., 45: 567-80, 1992.
13. FEINSTEIN, A.R. A bibliography of publications on observer variability. J. Chronic Dis., 38: 619-32, 1985.
14. FLEISS, J.L Measuring nominal scale agreement among many raters. Psychol Bull., 76: 378-82, 1971.
15. FLEISS, J.L.; COHEN, J.; EVERlTT, B. S. Large sample standard erros of kappa and weighted kappa. Psychol. Bull.,72: 323-7, 1969.
16. nd ed. London, Oxford University Press, 1964. p.25-49.
17. GOODMAN, L.A. The multivariate analysis of qualitative data: interactions among multiple classifications. J. Am. Stat. Assoc., 65: 226-56, 1970.
18. GOODMAN, L. A. Some multiplicative models for the analysis of cross-classified data. In: Berkeley Symposium on Mathema-tical Statistics and Probability, 6., Berkeley, 1972. Proceedings. Berkeley, University of California Press, 1972. p. 649-96.
19. GOODMAN, L.A. Simple models for the analysis of association in cross-classifications having ordered categories. J. Am. Stat. Assoc., 74:537-52, 1979.
20. GRAHAM, P. & JACKSON, R. The analysis of ordinal agreement data: beyond weighted kappa J. Clin. Epidemiol., 46:1055-62, 1993.
21. KORAN, M. The reliability of clinical methods, data and judgements. N. Eng. J. Med., 293: 642-6; 695-701, 1975.
22. LANDIS, J.R. & KOCK, G. G. The measurement of observer agreement for categorical data. Biometrics, 33: 159-75, 1977.
23. LIGHT, R.J. Measures of response agreement for qualitative data: some generalizations and alternatives. Psychol. Bull., 5: 365-77, 1971.
24. MACLURE, M. & WILLET, W.C. Misinterpretation and misuse of the kappa statistc. Am. J. Epidemiol., 126: 161-9, 1987.
25. MAY, S. M. Modeling observer agreement - an alternative to kappa. J. Clin. Epidemiol., 47:1315-24, 1994.
26. SAS Institute Inc. SAS Technical report P - 243, SAS/STAT Software: The GENMOD procedure, Release 6.09. Cary, North Carolina, 1993.
27. rd ed. Chicago, IL, 1988.
28. TANNER, M.A. & YOUNG, M.A. Modelling agreement among raters. J. Am. Stat. Assoc., 80:175-80, 1985.
29. TANNER, M.A. & YOUNG, M.A. Modeling ordinal scale disagreement Psychol. Bull., 98: 408-15, 1985.
30. UEBERSAX, J. S. & GROVE, W. M. A latente trait finite mixture model for the analysis of rating agreement. Biometrics, 49: 823-35, 1993.