A review of approaches for monitoring and evaluation of urban climate resilience initiatives

Environment, Development and Sustainability

Volumn 20, Issue 1, 2018, Pages 23-40

  Brown, Craig ^a   Shaker, Richard R ^b   Das, Runa ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b RYERSON UNIVERSITY   (Canada)

Author keywords

Assessment; Climate change adaptation; Indicators; Monitoring and evaluation; Urban climate resilience

Indexed keywords

ACTION PLAN; ADAPTIVE MANAGEMENT; CLIMATE CHANGE; ENVIRONMENTAL ASSESSMENT; ENVIRONMENTAL INDICATOR; ENVIRONMENTAL MONITORING; LITERATURE REVIEW; URBAN AREA; URBAN CLIMATE; URBAN PLANNING;

EID: 85001085885     PISSN: 1387585X     EISSN: 15732975     Source Type: Journal    
DOI: 10.1007/s10668-016-9891-7     Document Type: Review

References (89)

1. Adger, W. N., Arnell, N. W., & Tompkins, E. L. (2005). Successful adaptation to climate change across scales. Global Environmental Change, 15(2), 77–86. doi:10.1016/j.gloenvcha.2004.12.005.
2. AECOM and Risk Sciences International. (2015). Toronto hydro-electric system limited climate change vulnerability assessment. Retrieved from https://www.pievc.ca/node/104.
3. Alexander, M., Priest, S., & Mees, H. (2016). A framework for evaluating flood risk governance. Researching Flood Risk Policies in Europe: A Framework and Methodology for Assessing Flood Risk Governance, 64, 38–47. doi:10.1016/j.envsci.2016.06.004.
4. Anguelovski, I., Shi, L., Chu, E., Gallagher, D., Goh, K., Lamb, Z., et al. (in press). Equity impacts of urban land use planning for climate adaptation: Critical perspectives from the global North and South. Journal of Planning Education and Research.
5. Armitage, D., Béné, C., Charles, A. T., Johnson, D., & Allison, E. H. (2012). The interplay of well-being and resilience in applying a social–ecological perspective. Ecology and Society. doi:10.5751/ES-04940-170415.
6. Arup and Partners. (2014). Research report volume 3: Urban measurement report. Retrieved from http://publications.arup.com/Publications/C/City_Resilience_Framework.aspx.
7. Arup and Partners. (2015a). City resilience framework. Retrieved from https://assets.rockefellerfoundation.org/app/uploads/20140410162455/City-Resilience-Framework-2015.pdf.
8. Arup and Partners. (2015b). City resilience index. Retrieved from http://publications.arup.com/Publications/C/City_Resilience_Framework.aspx.
9. Bahadur, A. V, Peters, K., Wilkinson, E., Pichon, F., Gray, K., & Tanner, T. (2015). The 3As: Tracking resilience across braced. Retrieved from http://www.odi.org/sites/odi.org.uk/files/odi-assets/publications-opinion-files/9812.pdf.
10. Bahadur, A., Tanner, T., King, D., Kirbyshire, A., & Morsi, H. (2015). Resilience scan: October–December 2015: A review of literature, debates and social media activity on resilience. Retrieved from https://www.odi.org/publications/10362-resilience-scan-october-december-2015.
11. Béné, C., Godfrey-Wood, R., Newsham, A., & Davies, M. (2012). Resilience: New utopia or new tyranny? Reflection about the potentials and limits of the concept of resilience in relation to vulnerability reduction programmes. IDS Working Paper. doi: 10.1111/j.2040-0209.2012.00405.x.
12. Bours, D., McGinn, C., & Pringle, P. (2014a). Guidance note 1: Twelve reasons why climate change adaptation M & E is challenging. Retrieved from www.ukcip.org.uk/wp-content/PDFs/MandE-Guidance-Note1.pdf.
13. Bours, D., McGinn, C., & Pringle, P. (2014b). Guidance note 2: Selecting indicators for climate change adaptation programming. Retrieved from http://www.seachangecop.org/sites/default/files/documents/2014 01 SEA Change UKCIP GN2 Selecting indicators for CCA_0.pdf.
14. Brisley, R., Welstead, J., Hindle, R., & Paavola, J. (2012). Socially just adaptation to climate change. Retrieved from http://www.jrf.org.uk/publications.
15. Brooks, N., Aure, E., & Whiteside, M. (2014). Assessing the impact of ICF programmes on household and community resilience to climate variability and climate change. Retrieved from https://assets.publishing.service.gov.uk/media/57a089b840f0b64974000222/EoD_Consultancy_June2014_Measuring_Resilience.pdf.
16. Burton, C. G. (2015). A validation of metrics for community resilience to natural hazards and disasters using the recovery from Hurricane Katrina as a case study. Annals of the Association of American Geographers, 105(1), 67–86.
17. Carpenter, A. (2015). Resilience in the social and physical realms: Lessons from the Gulf Coast. International Journal of Disaster Risk Reduction, 14, 290–301. doi:10.1016/j.ijdrr.2014.09.003.
18. Chelleri, L., Schuetze, T., & Salvati, L. (2015). Integrating resilience with urban sustainability in neglected neighborhoods: Challenges and opportunities of transitioning to decentralized water management in Mexico City. Habitat International, 48, 122–130. doi:10.1016/j.habitatint.2015.03.016.
19. City of New Orleans. (2015). Resilient new orleans. Retrieved from http://resilientnola.org/wp-content/uploads/2015/08/Resilient_New_Orleans_Strategy.pdf.
20. City of Toronto. (2016). Energy Working Group Report: Phase 1—Existing conditions & emerging priorities. Retrieved from http://www1.toronto.ca/CityOfToronto/CityPlanning/Core/File/pdf/TOcore-Phase-1-Report_Energy_accessible.pdf.
21. Clean Air Partnership (CAP) and ICLEI—Local Governments for Sustainability (Management). (n.d.). Are we there yet? Applying sustainability indicators to measure progress on adaptation. Retrieved from http://www.icleicanada.org/images/icleicanada/Applying_Sustainability_Indicators_to_Measure_Progress_on_Adaptation-FINAL.pdf.
22. Climate-Eval. (2015). Good practice study on principles for indicator development, selection, and use in climate change adaptation monitoring and evaluation. Retrieved from https://www.climate-eval.org/sites/default/files/studies/Good-Practice-Study.pdf.
23. Constas, M. (2014). Measuring resilience. In IFPRI 2020 Conference on Building Resilience for Food and Nutrition Security. Addis Ababa. Retrieved from https://www.youtube.com/watch?v=prbiz8mBY-0.
24. Constas, M. (2015). Measuring resilience: Analysis-based measurement. Retrieved from www.fao.org/fileadmin/user_upload/fsin/docs/MarkConstas.compressed.pdf.
25. Cox, R. S., & Hamlen, M. (2015). Community disaster resilience and the rural resilience index. American Behavioral Scientist, 59(2), 220–237. doi:10.1177/0002764214550297.
26. Cutter, S. L. (2016). The landscape of disaster resilience indicators in the USA. Natural Hazards, 80(2), 741–758. doi:10.1007/s11069-015-1993-2.
27. Cutter, S. L., Burton, C. G., & Emrich, C. T. (2010). Disaster resilience indicators for benchmarking baseline conditions. Journal of Homeland Security and Emergency Management, 7(1), 14. doi:10.2202/1547-7355.1732.
28. Davis, K., Drey, N., & Gould, D. (2009). What are scoping studies? A review of the nursing literature. International Journal of Nursing Studies. doi:10.1016/j.ijnurstu.2009.02.010.
29. de Franca Doria, M., Boyd, E., Tompkins, E. L., & Adger, W. N. (2009). Using expert elicitation to define successful adaptation to climate change. Environmental Science and Policy, 12(7), 810–819. doi:10.1016/j.envsci.2009.04.001.
30. Department for International Development. (2014). Methodology for reporting against KPI4—Number of people whose resilience has been improved as a result of project support. Retrieved from https://www.gov.uk/international-development-funding/building-resilience-and-adaptation-to-climate-extremes-and-disasters-programme#project-documents.
31. Eyzaguirre, J. (2015). The impact of Canada’s Regional Adaptation Collaboratives on climate adaptation. Retrieved from https://www.nrcan.gc.ca/environment/impacts-adaptation/regional-initiatives/10631.
32. Eyzaguirre, J. (2016). Making adaptation monitoring and evaluation work for you. Presented at Adaptation Canada 2016, Ottawa, ON, 12–14 April 2016.
33. Feltmate, B., & Thistlethwaite, J. (2012). Climate change adaptation: A priorities plan for Canada. Retrieved from https://uwaterloo.ca/environment/sites/ca.environment/files/uploads/files/CCAP-Report-30May-Final.pdf.
34. Folke, A. C., Carpenter, S., Elmqvist, T., Gunderson, L., Holling, C. S., & Walker, B. (2002). Resilience and sustainable development: Building adaptive capacity in a world of transformations. Ambio, 31(5), 437–440.
35. FSIN Resilience Measurement Technical Working Group. (2014). Resilience measurement principles: Toward an agenda for measurement design—FSIN Technical Series No. 1. Retrieved from http://www.fsincop.net/resource-centre/detail/en/c/213177/.
36. Fuller, R., & Lain, J. (2015). Measuring resilience: Lessons learned from measuring resilience in Oxfam’s large-N effectiveness reviews. Retrieved from http://policy-practice.oxfam.org.uk/publications/measuring-resilience-lessons-learned-from-measuring-resilience-in-oxfams-large-583601.
37. Government of Canada. (2016). Federal Budget 2016. Retrieved from http://doi.org/10.1017/CBO9781107415324.004.
38. Hicks, C. C., Levine, A., Agrawal, A., Basurto, X., Breslow, S. J., Carothers, C., et al. (2016). Engage key social concepts for sustainability. Science, 352(6281), 38–40. doi:10.1126/science.aad4977.
39. Ibarraran, M. E., Malone, E. L., & Brenkert, A. L. (2010). Climate change vulnerability and resilience: Current status and trends for Mexico. Environment, Development and Sustainability, 12(3), 365–388. doi:10.1007/s10668-009-9201-8.
40. ICLEI—Local Governments for Sustainability. (n.d.). Changing climate, changing communities. Communities. Retrieved from http://www.icleicanada.org/resources/item/3-changing-climate-changing-communities.
41. IPCC. (2014). Climate change 2014: Synthesis report. Contribution of working groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change [Core Writing Team, R.K. Pachauri and L.A. Meyer (Eds.)]. Geneva, Switzerland: IPCC. Retrieved from https://www.ipcc.ch/pdf/assessment-report/ar5/syr/SYR_AR5_FINAL_full_wcover.pdf.
42. Jones, L. (2016). Measuring subjective resilience: Outlining a complementary approach to resilience measurement. Retrieved from edepot.wur.nl/381620.
43. Judah, I., & Cousins, F. (2015). The resilient urban skyscraper as refuge. Retrieved from global.ctbuh.org/paper/2464.
44. Keeley, B. (2007). Human capital: How what you know shapes your life. Retrieved from http://doi.org/10.1787/9789264029095-en.
45. Linkov, I., Bridges, T., Creutzig, F., Decker, J., Fox-Lent, C., Kröger, W., et al. (2014). Changing the resilience paradigm. Nature Climate Change, 4(6), 407–409. doi:10.1038/nclimate2227.
46. Lonsdale, K., Pringle, P., & Turner, B. (2015). Transformative adaptation: What it is, why it matters and what is needed. Retrieved from http://climate-exchange.org/2014/03/02/conceptualizing-transformational-adaptation/.
47. Maru, Y. T., Stafford Smith, M., Sparrow, A., Pinho, P. F., & Dube, O. P. (2014). A linked vulnerability and resilience framework for adaptation pathways in remote disadvantaged communities. Global Environmental Change, 28, 337–350. doi:10.1016/j.gloenvcha.2013.12.007.
48. Maxwell, D., Constas, M. A., Frankenberger, T. R., Klaus, D., & Mock, N. (2015). Qualitative data and subjective indicators for resilience measurement: Technical series No. 4. Retrieved from http://www.fsincop.net/fileadmin/user_upload/fsin/docs/resources/FSIN_TechnicalSeries_4.pdf.
49. McCarney, P. (2014). City metrics for city building. Building, 64(4), 28–29.
50. McGregor, A., Coulthard, S., Camfield, L. (2015). Measuring what matters: The role of well-being methods in development policy and practice. Retrieved from https://www.odi.org/publications/9657-measuring-matters-role-well-being-methods-development-policy-practice.
51. Meadows, D. (1998). Indicators and information systems for sustainable development. Retrieved from www.iisd.org/pdf/s_ind_2.pdf.
52. Medellin Collaboration on Urban Resilience. (2015). Local governments’ pocket guide to resilience. Retrieved from http://www.citiesalliance.org/node/5654.
53. Meerow, S., Newell, J. P., & Stults, M. (2016). Defining urban resilience: A review. Landscape and Urban Planning, 147, 38–49. doi:10.1016/j.landurbplan.2015.11.011.
54. Mendis, S., Mills, S., & Yantz, J. (2003). Building community capacity to adapt to climate change in resource-based communities. Retrieved from http://www.pamodelforest.sk.ca/pdfs/BUILDINGCOMMUNITY.pdf
55. Michael, C. (2014). The three most resilient cities? They’re all in Canada. The Guardian. Retrieved from https://www.theguardian.com/cities/datablog/2014/apr/11/most-resilient-cities-canada-toronto.
56. Mock, N., Bene, C., Constas, M. A., & Frankenberger, T. R. (2015). Systems analysis in the context of resilience: Resilience Measurement Technical Working Group. Technical Series No. 6. Retrieved from http://www.fsincop.net/fileadmin/user_upload/fsin/docs/resources/FSIN_TechnicalSeries_6.pdf.
57. Moser, S., & Boykoff, M. (2013). Climate change and adaptation success. In S. Moser & M. Boykoff (Eds.), Successful adaptation to climate change: Linking science and policy in a changing world (pp. 1–34). New York: Routledge.
58. Mulligan, M., Steele, W., Rickards, L., & Fünfgeld, H. (n.d.). Keywords in planning: What do we mean by “community resilience”? International Planning Studies.
59. Nichol, E., & Harford, D. (2016). Low carbon resilience: Transformative climage change planning for Canada. Retrieved from http://act-adapt.org/lcr-report/.
60. OECD. (2002). Glossary of key terms in evaluation and results based management, 38. Retrieved from http://www.oecd.org/development/peer-reviews/2754804.pdf.
61. OECD. (2013). OECD Guidelines on measuring subjective well-being. Report. doi:10.1787/9789264191655-en.
62. Patwardhan, A. (2016). Approaches and indicators for measuring adaptation and resilience, including process indicators, linking across scale and applications of the Resilience, Adaptation Pathways and Transformation Assessment (RAPTA) Framework. Presented at Adaptation futures 2016, Rotterdam, 10–13 May 2016.
63. Pringle, P. (2011). AdaptME toolkit: Adaptation monitoring and evaluation, pp. 1–37. Retrieved from www.ukcip.org.uk/wp-content/PDFs/UKCIP-AdaptME.pdf.
64. Research Group of Grosvenor Group Limited. (2014). Resilient cities: A Grosvenor research report. Retrieved from http://www.grosvenor.com/news-views-research/research/2014/resilientcitiesresearchreport/.
65. Ribeiro, D., Mackres, E., Baatz, B., Cluett, R., Jarrett, M., Kelly, M., & Vaidyanathan, S. (2015). Enhancing community resilience through energy efficiency. Retrieved from http://aceee.org/research-report/u1508.
66. Rignot, E., Jacobs, S., Mouginot, J., & Scheuchl, B. (2013). Ice-shelf melting around Antarctica. Science, 341, 266–270.
67. Rockström, J., Steffen, W., Noone, K., Persson, Å., Chapin, F. S., Lambin, E. F., et al. (2009). A safe operating space for humanity. Nature, 461(24), 472–475.
68. Rumrill, P. D., Fitzgerald, S. M., & Merchant, W. R. (2010). Using scoping literature reviews as a means of understanding and interpreting existing literature. Work. doi:10.3233/WOR-2010-0998.
69. Schipper, E. L. F., & Langston, L. (2015). A comparative overview of resilience measurement frameworks analysing indicators and approaches. Overseas Development Institute—Working Paper 422. doi: 10.13140/RG.2.1.2430.0882.
70. Siemens. (2013). Toolkit for resilient cities. Siemens toolkit for resilient cities. Retrieved from https://w3.siemens.com/topics/global/en/sustainable-cities/resilience/Documents/pdf/Toolkit_for_Resilient_Cities_Summary.pdf.
71. Smit, B., & Wandel, J. (2006). Adaptation, adaptive capacity and vulnerability. Global Environmental Change, 16(3), 282–292. doi:10.1016/j.gloenvcha.2006.03.008.
72. Sovacool, B. K. (2012). The methodological challenges of creating a comprehensive energy security index. Energy Policy, 48, 835–840. doi:10.1016/j.enpol.2012.02.017.
73. Sovacool, B. K., Ryan, S. E., Stern, P. C., Janda, K., Rochlin, G., Spreng, D., et al. (2015). Integrating social science in energy research. Energy Research and Social Science, 6, 95–99. doi:10.1016/j.erss.2014.12.005.
74. Spearman, M., & McGray, H. (2011). Making adaptation count: Concepts and options for monitoring and evaluation. Retrieved from http://www.wri.org/publication/making-adaptation-count.
75. Szento, K., Brimelow, J., Gysbers, P., & Stewart, R. (2015). The 2014 extreme flood on the Canadian Praries [in “Explaining Extremes of 2014 from a Climate Perspective”]. Bulletin of the American Meteorological Society, 96(12), 20–25.
76. The Associated Press-NORC Center for Public Affairs Research. (2014). Two years after superstorm sandy: Resilience in twelve neighborhoods. Retrieved from http://www.apnorc.org/PDFs/Sandy/Sandy Phase 2 Report_Final.pdf.
77. Tyler, S., & Moench, M. (2012). A framework for urban climate resilience. Climate and Development, 4, 311–326. doi:10.1080/17565529.2012.745389.
78. Tyler, S., Nugraha, E., Nguyen, H. K., Van Nguyen, N., Sari, A. D., Thinpanga, P., et al. (2016). Indicators of urban climate resilience: A contextual approach. Environmental Science and Policy. doi:10.1016/j.envsci.2016.08.004.
79. UNISDR. (2015). Disaster resilience scorecard for cities. The United Nations Office for Disaster Reduction. Retrieved from http://www.unisdr.org/2014/campaign-cities/ResilienceScorecardV1.5.pdf.
80. USAID. (2009). Glossary of evaluation terms, 1–12. Retrieved from pdf.usaid.gov/pdf_docs/Pnado820.pdf
81. Villanueva, P. S. (2011). Learning to ADAPT: Monitoring and evaluation approaches in climate change adaptation and disaster risk reduction—challenges, gaps and ways forward. SCR Discussion Paper 9. Retrieved from http://www.ids.ac.uk/files/dmfile/SilvaVillanueva_2012_Learning-to-ADAPTDP92.pdf.
82. Villanueva, P. S., Gould, C., Gregorowski, R., Bahadur, A., & Howes, L. (2015). BRACED programme: Monitoring and evaluation guidance notes. Retrieved from http://www.braced.org/contentAsset/raw-data/761757df-7b3f-4cc0-9598-a684c40df788/attachmentFile.
83. Warren, F. J., & Eyzaguirre, J. (2014). Adaptation: Linking research and practice. In F. J. Warren & D. S. Lemmen (Eds.), Canada in a changing climate: Sector perspectives on impacts and adaptation (pp. 253–286). Ottawa: Government of Canada.
84. White, H., & Phillips, D. (2012). Addressing attribution of cause and effect in small n impact evaluations: Towards an integrated framework, 71. Retrieved from http://www.3ieimpact.org/en/evaluation/working-papers/working-paper-15/.
85. Wilson, A. (2015). LEED pilot credits on resilient design adopted. Retrieved from http://www.resilientdesign.org/leed-pilot-credits-on-resilient-design-adopted/.
86. Wilson, D., Gregorowski, R., & Standley, S. (2016). Better understanding and measuring resilience. Retrieved from http://www.itad.com/better-understanding-and-measuring-resilience/.
87. Wilson-Grau, R. (2015). Outcome harvesting. Retrieved from http://betterevaluation.org/plan/approach/outcome_harvesting.
88. Wise, R. M., Fazey, I., Stafford Smith, M., Park, S. E., Eakin, H. C., Archer Van Garderen, E. R. M., et al. (2014). Reconceptualising adaptation to climate change as part of pathways of change and response. Global Environmental Change, 28, 325–336. doi:10.1016/j.gloenvcha.2013.12.002.
89. Woodruff, S. C., & Stults, M. (2016). Numerous strategies but limited implementation guidance in US local adaptation plans. Nature Climate Change. doi:10.1038/nclimate3012.