The MEPPP Framework: A Framework for Monitoring and Evaluating Participatory Planning Processes

Environmental Management

Volumn 57, Issue 1, 2016, Pages 79-96

  Hassenforder, Emeline ^a,b,c   Pittock, Jamie ^c   Barreteau, Olivier ^a   Daniell, Katherine Anne ^d   Ferrand, Nils ^a  

^a UMR G EAU   (France)

^b AGROPARISTECH   (France)

^c AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^d AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Complexity; Institutions; Monitoring and evaluation; Organizations; Participatory research; Planning

Indexed keywords

ENVIRONMENTAL MANAGEMENT; PLANNING; SOCIETIES AND INSTITUTIONS;

COMPLEXITY; DATA COLLECTION; MONITORING AND EVALUATIONS; PARTICIPATORY PLANNING; PARTICIPATORY PROCESS; PARTICIPATORY RESEARCH;

ECOLOGY;

COMPLEXITY; ENVIRONMENTAL MONITORING; MONITORING SYSTEM; ORGANIZATIONAL FRAMEWORK; PARTICIPATORY APPROACH; PLANNING PROCESS;

ARTICLE; CONCEPTUAL FRAMEWORK; EVALUATION STUDY; HUMAN; MONITORING AND EVALUATION OF PARTICIPATORY PLANNING PROCESSES; OUTCOME ASSESSMENT; PARTICIPATORY RESEARCH; PHYSICIAN; PRACTICE GUIDELINE; UGANDA; ENVIRONMENTAL MONITORING; INFORMATION PROCESSING; PROCEDURES; STANDARDS;

UGANDA;

DATA COLLECTION; ENVIRONMENTAL MONITORING; HUMANS; UGANDA;

EID: 84952989226     PISSN: 0364152X     EISSN: 14321009     Source Type: Journal    
DOI: 10.1007/s00267-015-0599-5     Document Type: Article

References (115)

1. Abrami G, Ferrand N, Morardet S, et al (2012). Wat-A-Game, a toolkit for building role-playing games about integrated water management. In: Seppelt R, Voinov AA, Lange S, Bankamp D (eds) International environmental modelling and software society (iEMSs) 2012 international congress on environmental modelling and software managing resources of a limited planet, sixth biennial meeting. Leipzig, Germany. http://www.iemss.org/society/index.php/iemss-2012-proceedings
2. AfroMaison (2010) AfroMaison Grant agreement Annex 1 “Description of Work” part B1. Brussels
3. Alkin M, Daillak R, White P (1979) Using evaluations: does evaluation make a difference?. Sage, Beverly Hills
4. Anderies JM, Janssen MA, Ostrom E (2004) A framework to analyze the robustness of social-ecological systems from an institutional perspective. Ecol Soc 9(1):18
5. Avenier M-J (1997) Une conception de l’action stratégique en milieu complexe. In: La stratégie chemin-faisant, Economica
6. Barreteau O, Bots PW, Daniell KA (2010) A framework for clarifying “Participation” in participatory research to prevent its rejection for the wrong reasons. Ecol Soc 15(2):1
7. Baur VE, Abma TA, Widdershoven GAM (2010) Participation of marginalized groups in evaluation: mission impossible? Eval Progr Plan 33(3):238–245
8. Beierle TC, Cayford J (2002) Democracy in practice: public participation in environmental decisions, 1st edn. Resources for the Future, Washington D.C.
9. Beierle TC, Konisky DM (2000) Values, conflict, and trust in participatory environmental planning. J Policy Anal Manag 19(4):587–602
10. Bellamy JA, Walker DH, McDonald GT, Syme GJ (2001) A systems approach to the evaluation of natural resource management initiatives. J Environ Manag 63(4):407–423
11. Better Evaluation (2014). http://betterevaluation.org/. Accessed November 2014
12. Bickerstaff K, Walker G (2001) Participatory local governance and transport planning. Environ Plan A 33(3):431–451
13. Blackstock KL, Kelly GJ, Horsey BL (2007) Developing and applying a framework to evaluate participatory research for sustainability. Ecol Econ 60(4):726–742
14. Boyd A, Geerling T, Gregory WJ, Kagan C, Midgley G, Murray P, Walsh MP (2007) Systemic evaluation: a participative, multi-method approach. J Oper Res Soc 58(10):1306–1320
15. Brunner RD (2004) Context-sensitive monitoring and evaluation for the World Bank. Policy Sci 37(2):103–136
16. Burton P, Goodlad R, Croft J (2006) How would we know what works?: context and complexity in the evaluation of community involvement. Evaluation 12:294–312
17. Byrne D (2013) Evaluating complex social interventions in a complex world. Evaluation 19(3):217–228
18. CDI (2013) Managing for impact: participatory planning, monitoring & evaluation. http://www.managingforimpact.org
19. Champion D, Wilson JM (2010) The impact of contingency factors on validation of problem structuring methods. J Oper Res Soc 61:1420–1431
20. Chess C, Purcell K (1999) Public participation and the environment: do we know what works? Environ Sci Technol 33(16):2685–2692
21. Conley A, Moote MA (2003) Evaluating collaborative natural resource management. Soc Nat Resour 16(5):371–386
22. Connick S, Innes JE (2003) Outcomes of collaborative water policy making: applying complexity thinking to evaluation. IURD Working Paper Series, Institute of Urban and Regional Development, UC Berkeley 46(2):177–197. http://escholarship.org/uc/item/03f3b4z9
23. Cooke B, Kothari U (2001) Participation: the new Tyranny?. Zed Books, London
24. Cunningham CA, Tiefenbacher JP (2008) Evaluating the effectiveness of public participation efforts by environmental agencies: repermitting a smelter in El Paso, Texas, USA. Environ Plan C 26(4):841–856
25. Daniell KA (2012) Co-engineering and participatory water management: organisational challenges for water governance. Cambridge University Press, Cambridge
26. Douglas M (1986) How institutions think. Routledge & Kegan Paul, London
27. Dovers S, Hussey K (2013) Environment & sustainability, 2nd edn. The Federation Press, Sydney
28. Ducrot R, Morardet S, Hassenforder E, et al. (2014) A process oriented approach to craft operational strategies for INRM at meso-scale: operational strategies for adaptation and vulnerability reduction to global change D7.1. Draft version, Brussels, p 137
29. Etienne M (2011) Companion modelling: a participatory approach to support sustainable development. Editions Quae, Versailles
30. Faehnle M, Tyrväinen L (2013) A framework for evaluating and designing collaborative planning. Land Use Policy 34:332–341
31. Fereday J, Muir-Cochrane E (2006) Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods 5(1):80–92
32. Ferrand N (2004). Participatory tools in the WFD: what’s for? Needs and requirements from HarmoniCop & HarmoniQua. In: Harmoni concerted action conference—2nd catchmod technical workshop “Integrating tools and toolboxes.”, Copenhagen
33. Ferrand N, Daniell KA (2006) Comment évaluer la contribution de la modélisation participative au développement durable ?. In Séminaire DDT, Lille
34. Ferrand N, Hare M, Rougier J-E (2006) iskar test site option description living with flood and drought. Methodological document to the Iskar Test Site, AquaStress IP, FP6, Europe, Brussels
35. Ferrand N, Farolfi S, Abrami G, Du Toit D (2009) WAT-A-GAME: sharing water and policies in your own basin. In: “Learn to Game, Game to Learn”, International simulation and gaming association 40th annual conference, Singapore
36. Finlay L (2002) “Outing” the researcher: the provenance, process, and practice of reflexivity. Qual Health Res 12(4):531–545
37. Fitzpatrick JL, Sanders JR, Worthen BR (2012) Program evaluation: alternative approaches and practical guidelines. Upper Saddle River, N.J., 4th edn. Pearson Education, London
38. Folke C, Hahn T, Olsson P, Norberg J (2005) Adaptive governance of social-ecological systems. Annu Rev Environ Resour 30(1):441–473. doi:10.1146/annurev.energy.30.050504.144511
39. Forester J (1999) The deliberative practitioner: encouraging participatory planning processes. MIT Press, Cambridge
40. Frewer LJ, Rowe G (2005) Evaluating public participation exercises: strategic and practical issues. In: Public E (ed) Participation in policy making. OECD, Paris, pp 85–1008
41. Fung A (2006) Varieties of participation in complex governance. Public Adm Rev 66:66–75
42. George AL, Bennett A (2005) Process-tracing and historical explanation. In: George AL, Bennett A (eds) Case studies and theory development in the social sciences. MIT Press, Cambridge, pp 205–232
43. Glicken J (2000) Getting stakeholder participation “right”: a discussion of participatory processes and possible pitfalls. Environ Sci Policy 3(6):305–310
44. Godschalk DR, Stiftel B (1981) Malking waves: public participation in state water planning. J Appl Behav Sci 17(4):597–614. doi:10.1177/002188638101700413
45. Greene JC (1997) Evaluation as advocacy. Am J Eval 18(1):25–35
46. Groot A, Maarleveld M (2000) Demystifying facilitation in participatory development. London. https://dlc.dlib.indiana.edu/dlc/bitstream/handle/10535/6163/Demystifying.pdf?sequence=1&isAllowed=y
47. Halvorsen KE (2001) Assessing public participation techniques for comfort, convenience, satisfaction, and deliberation. Environ Manag 28(2):179–186
48. Haraway DJ (1988) Situated knowledges: the science question in feminism and the privilege of partial perspective. Fem Stud 14(3):575–599
49. Hassenforder E, Barreteau O, Daniell KA, Pittock J, Ferrand N (2015a) Drivers of environmental institutional dynamics in decentralized African countries. Environ Manage. doi:10.1007/s00267-015-0581-2
50. Hassenforder E, Ferrand N, Pittock J, Daniell KA, Barreteau O (2015b) A participatory planning process as an arena for facilitating institutional bricolage: example from the Rwenzori region, Uganda. Soc Nat Resour 28(9):995–1012
51. Hassenforder E, Smajgl A, Ward J (2015c) Towards understanding participatory processes: framework, application and results. J Environ Manage 157:84–95
52. Hatchuel A (2005) Towards an epistemology of collective action: management research as a responsive and actionable discipline. Eur Manag Rev 2(1):36–47
53. Healey P (2003) Collaborative planning in perspective. Plan Theory 2(2):101–123
54. Herrfahrdt-Pähle E, Pahl-Wostl C (2012) Continuity and change in social-ecological systems: the role of institutional resilience. Ecol Soc 17(2):8
55. House E (1976) Justice in evaluation. In: Glass GV (ed) Evaluation studies annual review, vol 1. Sage, Beverly Hills
56. Innes JE, Booher DE (1999) Consensus building and complex adaptive systems: a framework for evaluating collaborative planning. J Am Plan Assoc 65(4):412
57. Jenkins NT, Bennett MIJ (1999) Toward an empowerment zone evaluation. Econ Dev Q 13(1):23–28
58. Kabaseke C (2012) Assessing the impact of Uganda’s wetland policy on the agroecosystems of the Rwenzori region during the period 1992–2011: a case study of river Mpanga catchment area, Uganda Martyrs University
59. Kaner S (2014) Facilitator’s guide to participatory decision-making, 3rd edn. Jossey-Bass, San Francisco
60. Kelly K, Van Vlaenderen H (1995) Evaluating participation processes in community development. Eval Progr Plan 18(4):371–383
61. Lankford BA (2008) Integrated, adaptive and domanial water resources management. In: Pahl-Wostl C, Kabat P, Möltgen J (eds) Adaptive and integrated water management: coping with complexity and uncertainty. Springer, Berlin Heidelberg, pp 39–59
62. Lascoumes P, Le Galès P (2007) Sociologie de l’action publique. Armand Colin, Paris
63. Laurian L, Shaw MM (2008) Evaluation of public participation: the practices of certified planners. J Plan Educ Res 28(3):293–309
64. Lefevre P, Kolsteren P, De Wael M-P, Byekwaso F, Beghin I (2000) Comprehensive participatory planning and evaluation. Antwerp. http://www.ifad.org/pub/bsf/cppe/cppe.pdf
65. Levin-Rozalis M (2004) Searching for the unknowable: a process of detection: abductive research generated by projective techniques. Int J Qual Methods 3(2):1–36
66. Love A (2004) Implementation evaluation. In: Wholey JS, Hatry HP, Newcomer KE (eds) Handbook of practical program evaluation, 2nd edn. Jossey-Bass, San Francisco
67. Margerum RD (2002) Collaborative planning: building consensus and building a distinct model for practice. J Plan Educ Res 21(3):237–253
68. Mayne J (2012) Contribution analysis: coming of age? Evaluation 18(3):270–280
69. Midgley G (1997) Dealing with coercion: critical systems heuristics and beyond. Syst Pract 10(1):37–57
70. Midgley G (2007) Systems thinking for evaluation. In: Williams B, Imam I (eds) Systems concepts in evaluation: an expert anthology. American Evaluation Association, Point Reyes, pp 11–34
71. Midgley G, Cavana RY, Brocklesby J, Foote JL, Wood DRR, Ahuriri-Driscoll A (2013) Towards a new framework for evaluating systemic problem structuring methods. Eur J Oper Res 229(1):143–154
72. Migongo-Bake C, Catactutan D (2012) AfroMaison WP2 report chapter 6 context analysis of Rwenzori mountains/Albertine Rift. Uganda, Nairobi
73. Mintzberg H (1994) The rise and fall of strategic planning. Simon and Schuster, Free Press and Prentice Hall International, New York
74. Montserrat LS, Cruz ET, Anderson A (2013) Baseline report Rwenzori region case study Afromaison project. Fort Portal, p 147
75. North DC (1990) Institutions, institutional change and economic performance. Cambridge University Press, Cambridge
76. O’Sullivan RG, O’Sullivan JM (1998) Evaluation voices: promoting evaluation from within programs through collaboration. Eval Progr Plan 21(1):21–29
77. Oels A (2006) Evaluating stakeholder dialogues. In: Stoll-Kleemann S, Welp M (eds) Stakeholder dialogues in natural resources management: theory and practice. Springer, Berlin, pp 117–152
78. Ojambo H (2012) Decentralisation in Africa: a critical review of Uganda’s experience. Potchefstroom Electron Law J/Potchefstroomse Elektroniese Regsblad 15(2): 20. http://dx.doi.org/10.4314/pelj.v15i2.4
79. Onyach-Olaa M (2003) The challenges of implementing decentralisation: recent experiences in Uganda. Public Adm Dev 23(1):105–113
80. Ostrom E (2005) Understanding institutional diversity. Princeton University Press, Princeton
81. Ostrom E (2009) A general framework for analyzing sustainability of social-ecological systems. Science 325(5939):419–422
82. Patton MQ (1999) Enhancing the quality and credibility of qualitative analysis. Health Serv Res 34(5):1189–1208
83. Patton MQ (2010) Developmental evaluation. Applying complexity concepts to enhance innovation and use. Guilford Press, New York
84. Perez P, Aubert S, Dare W et al (2011) Assessment and monitoring of the effects of the ComMod approach. In: Etienne M (ed) Companion modelling: a participatory approach to support sustainable development. Quae, Versailles, pp 141–167
85. Petts J (2001) Evaluating the effectiveness of deliberative processes: waste management case-studies. J Environ Plan Manag 44(2):207–226
86. Pini B (2004) On being a nice country girl and an academic feminist: using reflexivity in rural social research. J Rural Stud 20(2):169–179
87. Reed MS (2008) Stakeholder participation for environmental management: a literature review. Biol Conserv 141(10):2417–2431
88. Renger R, Wood S, Williamson S, Krapp S (2011) Systemic evaluation, impact evaluation and logic models. Eval J Aust 11(2):24–30
89. Renn O, Webler T, Wiedemann P (1995) Fairness and competence in citizen participation: evaluating models for environmental discourse. Kluwer Academic, Dordrecht
90. Ridder D, Mostert E, Wolters HA (2005) Learning together to manage together: improving participation in water management, harmonizing collaborative planning (HarmoniCOP). Osnabruck. http://www.harmonicop.uni-osnabrueck.de/HarmoniCOPHandbook.pdf
91. Rogers PJ (2008) Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation 14(1):29–48
92. Rosener JB (1978) Citizen participation: can we measure its effectiveness? Public Adm Rev 38(5):457–463
93. Rowe G, Frewer LJ (2000) Public participation methods: a framework for evaluation. Sci Technol Hum Values 25(1):3–29
94. Rowe G, Frewer LJ (2004) Evaluating public-participation exercises: a research agenda. Sci Technol Hum Values 29(4):512–556
95. Rowe G, Marsh R, Frewer LJ (2004) Evaluation of a deliberative conference. Sci Technol Hum Values 29(1):88–121
96. Ryan KE, Schwandt TA (2002) Exploring evaluator role and identity. Information Age Publishing, Charlotte
97. Sabatier PA (1988) An advocacy coalition framework of policy change and the role of policy-oriented learning therein. Policy Sci 21(2–3):129–168
98. Sager T (1981) Evaluation methods in local participatory planning. Town Plan Rev 52(4):417–432
99. Sager T (1994) Communicative planning theory: rationality versus power. Avebury, Aldershot, pp 161–186
100. Sanderson I (2000) Evaluation in complex policy systems. Evaluation 6(4):433–454
101. Scott WR (2001) Institutions and organizations, 2nd edn. Sage, Thousand Oaks
102. Scriven M (1991) Beyond formative and summative evaluation. In: McLaughlin MW, Phillips DC (eds) Evaluation and education: at quarter century. The University of Chicago Press, Chicago, pp 18–64
103. Senge PM (1990) The fifth discipline: the art and practice of the learning organization. Doubleday/Currency, New York
104. Simon HA (1993) Strategy and organizational evolution. Strateg Manag J 14(S2):131–142
105. Smith RW (1973) A theoretical basis for participatory planning. Policy Sci 4(3):275–295
106. Talen E (1996) Do plans get implemented? A review of evaluation in planning. J Plan Lit 10(3):248–259
107. Taut S (2008) What have we learned about stakeholder involvement in program evaluation? Stud Educ Eval 34(4):224–230
108. The World Bank (2004) Monitoring & evaluation, some tools, methods & approaches. Washington D.C. http://portals.wi.wur.nl/files/docs/ppme/ME_tools_methods_approaches.pdf
109. Ulrich W (1983) Critical heuristics of social planning: a new approach to practical philosophy. Haupt, Bern
110. UN Habitat (2001) Building bridges between citizens and local governments to work more effectively together through participatory planning Part I: concepts and strategies. http://www.unhabitat.org/pmss/getElectronicVersion.asp?nr=1371&alt=1?
111. UNDP (2009) Handbook on planning monitoring and evaluation for development results. New York. http://www.undp.org/eo/handbook
112. Webler T, Tuler S (2002) Unlocking the puzzle of public participation. Bull Sci Technol Soc 22(3):179–189
113. Williams B (2007) Systems concept in evaluation: an expert anthology. EdgePress, Point Reyes, p 222
114. Williams B (2015) Prosaic or profound? The adoption of systems ideas by impact evaluation. IDS Bull 46(1):7–16
115. Young OR (2008) Institutions and environmental change: the scientific legacy of a decade of IDGEC research. Institutions and environmental change, principal findings, applications, and research frontiers. MIT Press, Cambridge, pp 3–45