Challenges and opportunities in coding the commons: Problems, procedures, and potential solutions in large-N comparative case studies

International Journal of the Commons

Volumn 10, Issue 2, 2016, Pages 440-466

  Ratajczyk, Elicia ^a   Brady, Ute ^a   Baggio, Jacopo A ^a,b   Barnett, Allain J ^c   Perez Ibara, Irene ^a   Rollins, Nathan ^a   Rubiños, Cathy ^a   Shin, Hoon C ^a   Yu, David J ^a   Aggarwal, Rimjhim ^a   Anderies, John M ^a   Janssen, Marco A ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b UTAH STATE UNIVERSITY   (United States)

^c UNIVERSITY OF NEW BRUNSWICK   (Canada)

Author keywords

Codebook development; Coding; Common pool resources; Complexity; Content analysis; Coupled infrastructure systems; Intercoder agreement; Intercoder reliability testing; Social ecological systems

Indexed keywords

EID: 84992013308     PISSN: 18750281     EISSN: None     Source Type: Journal    
DOI: 10.18352/ijc.652     Document Type: Article

References (55)

1. Anderies, J. M., M. A. Janssen, and E. Ostrom. 2004. A Framework to Analyze the Robustness of Social-Ecological Systems from an Institutional Perspective. Ecology and Society 9(1):18. [online] http://www.ecologyandsociety.org/vol9/iss1/art18/.
2. Agrawal, A. 2014. Studying the Commons, Governing Common-Pool Resource Outcomes: Some Concluding Thoughts. Environmental Science and Policy 36(2014):86–91. http://dx.doi.org/10.1016/j.envsci.2013.08.012.
3. Araral, E. 2014. Ostrom, Hardin and the Commons: A Critical Appreciation and a Revisionist View. Environmental Science and Policy 36(2014):11–23. http://dx.doi.org/10.1016/j.envsci.2013.07.011.
4. Baggio, J. A., A. J. Barnett, I. Perez-Ibara, U. Brady, E. Ratajczyk, N. Rollins, C. Rubiños, H. C. Shin, D. J. Yu, R. Aggarwal, J. M. Anderies, and M. A. Janssen. 2016. Explaining Success and Failure in the Commons: The Configural Nature of Ostrom’s Institutional Design Principles. International Journal of the Commons 10(2):417–439, http://doi.org/10.18352/ijc.634.
5. Baland, J. M. and J. P. Platteau. 1999. The Ambiguous Impact of Inequality on Local Resource Management. World Development 27(5):773–788. http://dx.doi.org/10.1016/S0305-750X(99)00026-1.
6. Bardhan, P. and D. Mookherjee. 2006. Decentralization and Local Governance in Developing Countries: A Comparative Perspective (Vol. 1). Cambridge, MA: MIT Press.
7. Barnett, A. J. and J. M. Anderies. 2014. Weak Feedbacks, Governance Mismatches, and the Robustness of Social-Ecological Systems: An Analysis of the Southwest Nova Scotia Lobster Fishery with Comparison to Maine. Ecology and Society 19(4):39. http://dx.doi.org/10.5751/ES-06714-190439.
8. Barnett, A. J., J. A. Baggio, H. C. Shin, D. J. Yu, I. Perez-Ibarra, C. Rubiños, U. Brady, E. Ratajczyk, N. Rollins, R. Aggarwal, J. M. Anderies, and M. A. Janssen. 2016. An Iterative Approach to Case Study Analysis: Insights from Qualitative Analysis of Quantitative Inconsistencies. International Journal of the Commons 10(2):467–494, http://doi.org/10.18352/ijc.632.
9. Bartholomew, K., A. J. Z. Henderson, and J. E. Marcia. 2000. Coded Semi- Structured Interviews in Social Psychological Research. In Handbook of Research Methods in Social and Personality Psychology, eds. H. T. Reis and C. M. Judd, 286–312. Cambridge, MA. Cambridge University Press.
10. Berkes, F. 1989. Common Property Resources: Ecology and Community-Based Sustainable Development. London, UK: Belhaven Press.
11. Bernard, H. R. 2011. Research Methods in Anthropology: Qualitative and Quantitative Approaches. Fifth Edition. Plymouth, UK: Altamira Press.
12. Bernard, H. R. and G. W. Ryan. 2010. Analyzing Qualitative Data: Systematic Approaches. Thousand Oaks, CA: Sage Publications, Inc.
13. Brewer, J. F. 2012. Don’t Fence Me In: Boundaries, Policy, and Deliberation in Maine’s Lobster Commons. Annals of the Association of American Geographers 102(2):383–402. http://dx.doi.org/10.1080/00045608.2011.641889.
14. Carey, J. W. and D. Gelaude. 2008. Systematic Methods for Collecting and Analyzing Multidisciplinary Team-Based Qualitative Data. In Handbook for Team-Based Qualitative Research, eds. G. Guest and K. M. MacQueen, 227–274. Lanham, MD: Altamira Press.
15. Corti, L. and P. Thompson. 2004. Secondary Analysis of Archived Data. In Qualitative Research Practice, eds. C. Seale, G. Gobo, J. F. Gubrium, and D. Silverman, 327–343. London: Sage. http://dx.doi.org/10.4135/9781848608191.d26.
16. Corti, L., A. Witzel, and L. Bishop. 2005. On the Potentials and Problems of Secondary Analysis: An Introduction to the FQS Special Issue on Secondary Analysis of Qualitative Data. Forum: Qualitative Social Research (FQS) 6(1):Art.49.
17. Cox, M. 2014. Understanding Large Social-Ecological Systems: Introducing the SESMAD Project. International Journal of the Commons 8(2):265–276. http://dx.doi.org/10.18352/ijc.406.
18. Cox, M. 2015. A Basic Guide for Empirical Environmental Social Science. Ecology and Society 20(1):63–77. http://dx.doi.org/10.5751/ES-07400-200163.
19. Cox, M., G. Arnold, and S. Villamayor-Tomas. 2010. A Review of Design Principles for Community-Based Natural Resource Management. Ecology and Society 15(4):38. [online] http://www.ecologyandsociety.org/vol15/iss4/art38/.
20. Denzin, N. K. and Y. S. Lincoln. 2000. Handbook of qualitative research. Second Edition. Thousand Oaks, CA: Sage Publications, Inc.
21. Epstein, G., M. Nenadovic, and A. Boustany. 2014. Into the Deep Blue Sea: Commons Theory and International Governance of Atlantic Bluefin Tuna. International Journal of the Commons 8(2):277–303. http://dx.doi.org/10.18352/ijc.410.
22. Feng, G. C. 2014. Intercoder Reliability Indices: Disuse, Misuse, and Abuse. Quality and Quantity 48:1803–1815. http://dx.doi.org/10.1007/s11135-013-9956-8.
23. Fleischman, F. D., B. Loken, G. A. Garcia-Lopez, and S. Villamajor-Tomas. 2014. Evaluating the Utility of Common-Pool Resource Theory for Understanding Forest Governance and Outcomes in Indonesia Between 1965 and 2012. International Journal of the Commons 8(2):304.
24. Gamer, M., J. Lemon, and P. Singh. 2012. irr: Various Coefficients of Interrater Reliability and Agreement. Retrieved from http://cran.r-project.org/web/packages/irr/index.html.
25. Guest, G. and K. M. MacQueen. 2008. Reevaluating Guidelines in Qualitative Research. In Handbook for Team-Based Qualitative Research, eds. G. Guest and K. M. MacQueen, 205–226. Lanham, MD. Altamira Press.
26. Hinds, P. S., R. J. Vogel, and L. Clarke-Steffen. 1997. The Possibilities and Pitfalls of Doing a Secondary Analysis of a Qualitative Data Set. Qualitative Health Research 7:408. http://dx.doi.org/10.1177/104973239700700306.
27. Hruschka, D. J., D. Schwartz, D. C. St. John, E. Picone-Decaro, R. Jenkins, and J. W. Carey. 2004. Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research. Field Methods 16(3):307–331. http://dx.doi.org/10.1177/1525822X04266540.
28. Kelder, J. 2005. Using Someone Else’s Data: Problems, Pragmatics and Provisions. Forum: Qualitative Social Research 6(1):Art.39.
29. Krippendorff, K. 2008. Systematic and Random Disagreement and the Reliability of Nominal Data. Communication Methods and Measure 2(4):323–338. http://dx.doi.org/10.1080/19312450802467134.
30. Krippendorff, K. 2013. Content Analysis: An Introduction to Its Methodology. Third Edition. Thousand Oaks, CA: Sage Publications, Inc.
31. MacQueen, K. M., E. McLellan, K. Kay, and B. Milstein. 1998. Codebook Development for Team-Based Qualitative Analysis. Field Methods 10(2):31–36. http://dx.doi.org/10.1177/1525822X980100020301.
32. MacQueen, K. M., E. McLellan-Lemal, K. Bartholow, B. Milstein. 2008. Team-Based Codebook Development: Structure, Process, and Agreement. In Handbook for Team-Based Qualitative Research, eds. G. Guest and K. M. MacQueen, 19–135. Lanham, MD: Altamira Press.
33. Mayring, P. 2000. Qualitative Content Analysis: Research Instrument or Mode of Interpretation. Forum: Qualitative Social Research 1(2):Art.20. Retrieved October 1, 2015 from http://www.qualitative-research.net/index.php/fqs/article/view/1089/2385.
34. McKean, M. 1992. Success on the Commons: A Comparative Examination of Institutions for Common Property Resource Management. Journal of theoretical politics 4(3):247–281. http://dx.doi.org/10.1177/0951692892004003002.
35. Medjedović, I. and A. Witzel. 2005. Secondary Analysis of Interviews: Using Codes and Theoretical Concepts from the Primary Study. Forum: Qualitative Social Research 6(1):Art.46.
36. Namey, E., G. Guest, L. Thairu, and L. Johnson. 2008. Data Reduction Techniques for Large Qualitative Data Sets. In Handbook for Team-Based Qualitative Research, eds. G. Guest and K. M. MacQueen, 137–161. Lanham, MD: Altamira Press.
37. Netting, R. McC. 1976. What Alpine Peasants have in Common: Observations on Communal Tenure in a Swiss Village. Human Ecology 4:135–146. http://dx.doi.org/10.1007/BF01531217.
38. Ostrom, E. 1990. Governing the Commons: the Evolution of Institutions for Collective Action. Cambridge, MA: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511807763.
39. Ostrom, E. 2005. Understanding Institutional Diversity. Princeton, N.J. Princeton University Press.
40. Ostrom, E. 2012. Why do We Need to Protect Institutional Diversity? [Keynote Lecture]. European Political Science 11(2012):128–147. http://dx.doi.org/10.1057/eps.2011.37.
41. Ostrom, E., A. Agrawal, W. Blomquist, E. Schlager, and S. Y. Tang. 1989. CPR Coding Manual. Bloomington, In: Indiana University, Workshop in Political Theory and Policy Analysis. https://seslibrary.asu.edu/sites/default/files/cprcodingmanual-fullwcovercopytoc.pdf.
42. Ostrom, E., P. Benjamin, and G. P. Shivakoti. 1993. Use of Case Studies and Structural Coding in a Relational Database for Storage and Analysis of Irrigation Institutions and Systems. Proceedings of an International Workshop held at the Institute of Agriculture and Animal Science (IAAS). Retrieved from http://dlc.dlib.indiana.edu/dlc/handle/10535/7996.
43. Pitt, J., J. Schaumeier, and A. Artikis. 2012. Axiomatization of Socio-Economic Principles for Self-Organizing Institutions: Concepts, Experiments and Challenges. ACM Transactions on Autonomous and Adaptive Systems 7(4):Art.39. http://dx.doi.org/10.1145/2382570.2382575.
44. Poteete, A. R., M. A. Janssen, and E. Ostrom. 2010. Working Together: Collective Action, the Commons, and Multiple Methods in Practice. Princeton, NJ: Princeton University Press. http://dx.doi.org/10.1515/9781400835157.
45. Rambaree, K. 2007. Bringing Rigour in Qualitative Social Research: The Use of CAQDAS. University of Mauritius Research Journal 13(A):1–16. Retrieved from http://www.gfmer.ch/GFMER_members/pdf/CAQDAS_Rambaree_2007.pdf.
46. Roberts, M. 2005. Definition: schema. Whatis.com. http://searchsqlserver.techtarget.com/definition/schema.
47. Rourke, L. and T. Anderson. 2004. Validity in Quantitative Content Analysis. Educational Technology Research and Development 52(1):5–18. http://dx.doi.org/10.1007/BF02504769.
48. Rudel, T. K. 2008. Meta-Analyses of Case Studies: A Method for Studying Regional and Global Environmental Change. Global Environmental Change 18(1):18–25. http://dx.doi.org/10.1016/j.gloenvcha.2007.06.001.
49. Savage, M. 2005. Revisiting Classic Qualitative Studies. Forum: Qualitative Social Research 6(1):Art.31.
50. Schlager, E. 2004. Common-Pool Resource Theory. In Environmental Governance Reconsidered: Challenges, Choices, and Opportunities, eds. R. F. Durant, D. J. Fiorino, and R. O’Leary, 145–175. Cambridge, MA: MIT Press.
51. Stemler, S. 2001. An Overview of Content Analysis. Practical Assessment, Research and Evaluation 7(17):137–146.
52. Villamayor-Tomas, S., F. D. Fleischman, I. Perez Ibarra, A. Thiel, and F. van Laerhoven. 2014. From Sandoz to Salmon: Conceptualizing Resource and Institutional Dynamics in the Rhine Watershed Through the SES Framework. International Journal of the Commons 8(2):361. http://dx.doi.org/10.18352/ijc.411.
53. Wade, R. 1984. Irrigation Reform in Conditions of Populist Anarchy: An Indian Case. Journal of Development Economics 14(3):285–303. http://dx.doi.org/10.1016/0304-3878(84)90060-9.
54. Weed, M. 2005. “Meta Interpretation”: A Method for the Interpretive Synthesis of Qualitative Research. Forum: Qualitative Social Research 6(1):Art.37.
55. Wollenberg, E., L. Merino, A. Agrawal, and E. Ostrom. 2007. Fourteen Years of Monitoring Community-Managed Forests: Learning from IFRI’s Experience. International Forestry Review 9(2):670–684. http://dx.doi.org/10.1505/ifor.9.2.670.