Coding In-depth Semistructured Interviews: Problems of Unitization and Intercoder Reliability and Agreement

Sociological Methods and Research

Volumn 42, Issue 3, 2013, Pages 294-320

  Campbell, John L ^a,b   Quincy, Charles ^c   Osserman, Jordan ^d   Pedersen, Ove K ^b  

^a Dartmouth College   (United States)

^b Department of International Economics and Management   (Denmark)

^c IBM   (United States)

^d UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

coding; intercoder agreement; intercoder reliability; interviews; qualitative methods

Indexed keywords

EID: 84884574231     PISSN: 00491241     EISSN: 15528294     Source Type: Journal    
DOI: 10.1177/0049124113500475     Document Type: Article

References (42)

1. Armstrong David,Gosling Ann,Weinman Josh,Martaeu Theresa."The Place of Inter-rater Reliability in Qualitative Research: An Empirical Study.".Sociology. 1997;31:597-607.
2. Becker HowardQualitative Methodology. Filstead William, ed. Chicago, IL: Rand McNally; 1970:189-201.
3. Bernard H. RussellSocial Research Methods: Qualitative and Quantitative Approaches. Thousand Oaks, CA: Sage; 2000:.
4. Burla Laila,Knierim Birte,Barth Jürgen,Liewald Katharina,Duetz Margreet,Abel Thomas."From Text to Codings: Inter-coder Reliability Assessment in Qualitative Content Analysis.".Nursing Research. 2008;57:113-17.
5. Calarco Jessica."'I Need Help!' Social Class and Children's Help-seeking in Elementary School.".American Sociological Review. 2011;76:862-82.
6. Campbell John L.,Pedersen Ove K.The National Origins of Policy Ideas: Knowledge Regimes in the United States, France, Germany and Denmark. Princeton, NJ: Princeton University Press; 2014:.
7. DeSoucey Michaela."Gastronationalism: Food Traditions and Authenticity Politics in the European Union.".American Sociological Review. 2010;75:432-55.
8. Deutscher IrwinQualitative Methodology. Filstead William, ed. Chicago, IL: Rand McNally; 1970:202-16.
9. Dunn GrahamDesign and Analysis of Reliability Studies: The Statistical Evaluation of Measurement Errors. New York: Oxford University Press; 1989:.
10. Edin Kathryn,Kefalas MariaPromises I Can Keep: Why Poor Women Put Motherhood Before Marriage. Berkeley, CA: University of California Press; 2005:.
11. Edin Kathryn,Lein LauraMaking Ends Meet: How Single Mothers Survive Welfare and Low-wage Work. New York: Russell Sage Foundation; 1997:.
12. Engel MimiUnmarried Couples with Children. England PaulaEdin Kathryn, ed. New York: Russell Sage Foundation; 2007:255-76.
13. England Paula,Edin KathrynUnmarried Couples with Children. England PaulaEdin Kathryn, ed. New York: Russell Sage Foundation; 2007:3-21.
14. FahyPatrick. 2001. "Addressing Some Common Problems in Transcript Analysis."The International Review of Research in Open and Distance Learning1. (http://www.irrodl.org/index/php/irrodl/article/view/321).
15. Garrison D. R.,Cleveland-Innes M.,Koole Marguerite,Kappelman James."Revisiting Methodological Issues in Transcript Analysis: Negotiated Coding and Reliability.".Internet and Higher Education. 2006;9:1-8.
16. Gerson KathleenHard Choices. Berkeley: University of California Press; 1985:.
17. Glaser Barney,Strauss AnselmThe Discovery of Grounded Theory. New York: Aldine de Gruyter; 1967:.
18. Grayson Kent,Rust Roland."Interrater Reliability Assessment in Content Analysis.".Journal of Consumer Psychology. 2001;10:71-73.
19. Greene Jennifer C.,Caracelli Valeri J.,Graham Wendy R."Toward a Conceptual Framework for Mixed-method Evaluation Designs.".Educational Evaluation and Policy Analysis. 1989;11:255-74.
20. Halliday Terence C.,Carruthers Bruce G.Bankrupt: Global Lawmaking and Systemic Financial Crisis. Stanford, CA: Stanford University Press; 2009:.
21. Hodson RandyAnalyzing Documentary Accounts. Thousand Oaks, CA: Sage; 1999:.
22. Hruschka Daniel,Schwartz Deborah,John Daphne Cobb.,Picone-Decaro Erin,Jenkins Richard,Carey James."Reliability in Coding Open-ended Data: Lessons Learned from HIV Behavioral Research.".Field Methods. 2004;16:307-31.
23. Krippendorff Klaus."On the Reliability of Unitizing Continuous Data.".Sociological Methodology. 1995;25:47-76.
24. Krippendorff KlausContent Analysis: An Introduction to Its Methodology. 2004. Content Analysis: An Introduction to Its Methodology. 2nd ed. Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2004:.
25. Kurasaki Karen S."Intercoder Reliability from Validating Conclusions Drawn from Open-ended Interview Data.".Field Methods. 2000;12:179-94.
26. Lewins Ann,Silver ChristinaUsing Software in Qualitative Research. Los Angeles, CA: Sage; 2007:.
27. Lombard Matthew,Snyder-Duch Jennifer,Bracken Cheryl."Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability.".Human Communication Research. 2002;28:587-604.
28. Mason JenniferQualitative Researching. 2002. Qualitative Researching. 2nd ed. Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2002:.
29. McCabe Janice."Doing Multiculturalism: An Interactionist Analysis of the Practices of a Multicultural Sorority.".Journal of Contemporary Ethnography. 2011;40:521-59.
30. Miles Matthew B.,Michael Huberman A.Qualitative Data Analysis: A Sourcebook of New Methods. Beverly Hills, CA: Sage; 1984:.
31. Morrissey Elizabeth R."Sources of Error in the Coding of Questionnaire Data.".Sociological Methods and Research. 1974;3:209-32.
32. Popping Roel."In Search of One Set of Categories.".Quality and Quantity. 1992;26:147-55.
33. Popping Roel."Some Views on Agreement To Be Used in Content Analysis.".Quality and Quantity. 2010;44:1067-78.
34. Riffe Daniel,Freitag Alan."A Content Analysis of Content Analysis: Twenty-five Years of Journalism Quarterly.".Journalism and Mass Communications Quarterly. 1997;74:873-82.
35. Rosenthal RobertJudgment Studies: Design, Analysis, and Meta-Analysis. New York: Cambridge University Press; 1987:.
36. Rubin Herbert J.,Rubin Irene S.Qualitative Interviewing: The Art of Hearing Data. 2005. Qualitative Interviewing: The Art of Hearing Data. 2nd ed. Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2005:.
37. Strang DavidLearning by Example: Imitation and Innovation at a Global Bank. Princeton, NJ: Princeton University Press; 2010:.
38. Tashakkori Abbas,Teddlie CharlesMixed Methodology: Combining Qualitative and Quantitative Approaches. Thousand Oaks, CA: Sage; 1998:.
39. Useem MichaelThe Inner Circle: Large Corporations and the Rise of Business Political Activity in the U.S. and U.K. New York: Oxford University Press; 1984:.
40. Weber Robert PhilipBasic Content Analysis. 1990. Basic Content Analysis. 2nd ed. Newbury Park, CA: Sage.Newbury Park, CA: Sage; 1990:.
41. Wilson William JuliusWhen Work Disappears: The World of the New Urban Poor. New York: Alfred A. Knopf; 1996:.
42. Zelditch MorrisQualitative Methodology,. Filstead William, ed. Chicago, IL: Rand McNally; 1970:217-34.