Some views on agreement to be used in content analysis studies

Quality and Quantity

Volumn 44, Issue 6, 2010, Pages 1067-1078

  Popping, Roel ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Content analysis; Interjudge reliability; Nominal scale agreement; Text analysis

Indexed keywords

EID: 77956670250     PISSN: 00335177     EISSN: 15737845     Source Type: Journal    
DOI: 10.1007/s11135-009-9258-3     Document Type: Article

References (26)

1. Bennett E. M., Alpert R., Goldstein A. C.: Communications through limited response questioning. Public Opin. Q. 18(3), 303-308 (1954).
2. Carley K. M.: Content analysis. In: Asher, R. E. (eds) The Encyclopedia of Language and Linguistics, pp. 725-730. Pergamon Press, Edinburgh (1994).
3. Cohen J.: A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20(1), 37-46 (1960).
4. Conger A. J.: Integration and generalization of kappas for multiple raters. Psychol. Bull. 88(2), 322-328 (1980).
5. Craig R. T.: Generalization of Scott's index of intercoder agreement. Public Opin. Q. 45(2), 260-264 (1981).
6. Crittenden K. S., Hill R. J.: Coding reliability and validity of interview data. Am. Sociol. Rev. 36(6), 1073-1080 (1971).
7. Fleiss J. L.: Measuring nominal scale agreement among many raters. Psychol. Bull. 76(5), 378-382 (1971).
8. Galtung, J.: Measurement of agreement. In: Galtung, J. (ed.) Papers on Methodology. Theory and Methods of Social Research, Vol. II, pp. 82-135. Christian Eijlers, Copenhagen (1979).
9. Holsti O. R.: Content Analysis for the Social Sciences and Humanities. Addison Wesley, London (1969).
10. Hubert L. J.: Kappa revisited. Psychol. Bull. 84(2), 289-297 (1977).
11. Krippendorff K.: Association, agreement, and equity. Qual. Quant. 21(2), 109-123 (1987).
12. Landis J. R., Koch G. G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159-174 (1977).
13. Light R. J.: Measures of response agreement for qualitative data: some generalizations and alternatives. Psychol. Bull. 76(5), 365-377 (1971).
14. Lombard M., Snyder-Duch J., Bracken C. C.: Content analysis in mass communication: assessment and reporting of intercoder reliability. Hum. Commun. Res. 28(4), 587-604 (2002).
15. Montgomery A. C., Crittenden K. S.: Improving coding reliability for openended questions. Public Opin. Q. 41(2), 235-243 (1977).
16. Popping R.: Nominal scale agreement. In: Kotz, S., Johnson, N. L. (eds) Encyclopedia of Statistical Sciences, pp. 261-264. Wiley, New York (1985).
17. Popping R.: On agreement indices for nominal data. In: Saris, W. E., Gallhofer, I. N. (eds) Sociometric Research, pp. 90-105. McMillan, London (1988).
18. Popping R.: Taxonomy on Nominal Scale Agreement. iec ProGamma, Groningen (1992).
19. Popping R.: Computer-assisted Text Analysis. Sage, London (2000).
20. Potter W. J., Levine-Donnerstein D.: Rethinking validity and reliability in content analysis. J. Appl. Commun. Res. 27(3), 258-284 (1999).
21. Riffe D., Freitag A. A.: A content analysis of content analyses: twenty-five years of journalism quarterly. Journal. Mass Commun. Q. 74(4), 873-882 (1997).
22. Rogot E., Goldberg I. D.: A proposed index for measuring agreement in test-retest studies. J. Chronic Dis. 19(9), 991-1006 (1966).
23. Ross D. C.: Testing patterned hypothesis in multiway contingency tables using weighted kappa and weighted chi square. Educ. Psychol. Meas. 37(2), 291-307 (1977).
24. Schouten H. J. A.: Measuring pairwise agreement among many observers. Biom. J. 22(6), 497-504 (1980).
25. Scott W. A.: Reliability of content analysis: the case of nominal scale coding. Public Opin. Q. 19(3), 321-325 (1955).
26. Tinsley H. E. A., Weiss D. J.: Interrater reliability and agreement. In: Tinsley, H. E. A., Brown, S. D. (eds) Handbook of Applied Multivariate Statistics and Mathematical Modelling, pp. 95-124. Academic Press, San Diego (2000).