When to use what: Methods for weighting and aggregating sustainability indicators

Ecological Indicators

Volumn 81, Issue , 2017, Pages 491-502

  Gan, Xiaoyu ^a   Fernandez, Ignacio C ^b   Guo, Jie ^c   Wilson, Maxwell ^d   Zhao, Yuanyuan ^e   Zhou, Bingbing ^b   Wu, Jianguo ^b,d,f  

^a SICHUAN UNIVERSITY   (China)

^b ARIZONA STATE UNIVERSITY   (United States)

^c NANJING AGRICULTURAL UNIVERSITY   (China)

^d ARIZONA STATE UNIVERSITY   (United States)

^e BEIJING FORESTRY UNIVERSITY   (China)

^f BEIJING NORMAL UNIVERSITY   (China)

Author keywords

Aggregation; Indicator framework; Sustainability indicators; Sustainability indices; Weighting

Indexed keywords

AGGLOMERATION; ENVIRONMENTAL PROTECTION; REVIEWS; SOCIETIES AND INSTITUTIONS; SUSTAINABLE DEVELOPMENT;

INDICATOR FRAMEWORKS; INTERNATIONAL ORGANIZATIONS; PROCESS-ORIENTED APPROACHES; SPATIAL AND TEMPORAL SCALE; SUSTAINABILITY ASSESSMENT; SUSTAINABILITY INDEX; SUSTAINABILITY INDICATORS; WEIGHTING;

SCALES (WEIGHING INSTRUMENTS);

AGGREGATION; ECOLOGICAL MODELING; ENVIRONMENTAL INDICATOR; LITERATURE REVIEW; MODEL VALIDATION; RESEARCH WORK; SUSTAINABILITY; TEMPORAL RECORD; THEORETICAL STUDY; TYPOLOGY; WEIGHT;

EID: 85021392696     PISSN: 1470160X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ecolind.2017.05.068     Document Type: Review

References (102)

1. Özdemir, E.D., Härdtlein, M., Jenssen, T., Zech, D., Eltrop, L., A confusion of tongues or the art of aggregating indicators—Reflections on four projective methodologies on sustainability measurement. Renew. Sustain. Energy Rev. 15:5 (2011), 2385–2396.
2. Ülengin, B., Ülengin, F., Güvenç, Ü., A multidimensional approach to urban quality of life: the case of Istanbul. Eur. J. Oper. Res. 130:2 (2001), 361–374.
3. Arranz-López, A., Soria-Lara, J.A., López-Escolano, C., Campos, Á.P., Retail Mobility EnvironmentsA methodological framework for integrating retail activity and non-motorised accessibility in Zaragoza, Spain. J. Transp. Geogr. 58 (2017), 92–103.
4. Böhringer, C., Jochem, P.E., Measuring the immeasurable—a survey of sustainability indices. Ecol. Econ. 63:1 (2007), 1–8.
5. Beliakov, G., Pradera, A., Calvo, T., Aggregation Functions: A Guide for Practitioners. 2007, Springer.
6. Booysen, F., An overview and evaluation of composite indices of development. Soc. Indic. Res. 59 (2002), 115–151.
7. Bullen, P.S., Handbook of Means and Their Inequalities. 2013, Springer Science & Business Media.
8. Cairns, J. Jr., McCormick, P.V., Niederlehner, B., A proposed framework for developing indicators of ecosystem health. Hydrobiologia 263:1 (1993), 1–44.
9. Calvo, T., Kolesárová, A., Komorníková, M., Mesiar, R., Aggregation operators: properties, classes and construction methods. Aggregation Operators, 2002, Springer, 3–104.
10. Chen, L., Pu, P., Survey of Preference Elicitation Methods. 2004, Ecole Politechnique Federale de Lausanne (EPFL), Lausanne, Switzerland.
11. Cherchye, L., Kuosmanen, T., Benchmarking Sustainable Development: A Synthetic Meta-index Approach, Research Paper. 2004, UNU-WIDER, United Nations University (UNU).
12. Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., An introduction to ‘benefit of the doubt’ composite indicators. Soc. Indic. Res. 82:1 (2007), 111–145.
13. Dı́az-Balteiro, L., Romero, C., In search of a natural systems sustainability index. Ecol. Econ. 49:3 (2004), 401–405.
14. Daly, H., Jacobs, M., Skolimowski, H., Discussion of beckerman's critique of sustainable developemnt. Environ. Values 4:1 (1995), 49–70.
15. DeCoster, J., Overview of Factor Analysis. 1998 (Accessed 22 December 2015) http://www.stat-help.com/factor.pdf.
16. Dunteman, G.H., Principal Components Analysis. 1989, Sage.
17. Ekins, P., Simon, S., Deutsch, L., Folke, C., De Groot, R., A framework for the practical application of the concepts of critical natural capital and strong sustainability. Ecol. Econ. 44:2 (2003), 165–185.
18. Esty, D.C., Levy, M.A., Srebotnjak, T., de Sherbinin, A., Kim, C.H., Anderson, B., Pilot 2006 Environmental Performance Index. 2006, Yale Center for Environmental Law & Policy, New Have.
19. Farrell, A., Hart, M., What does sustainability really mean?: The search for useful indicators. Environ.: Sci. Policy Sustain. Dev. 40:9 (1998), 4–31.
20. Finnveden, G., A Critical Review of Operational Valuation/weighting Methods for Life Cycle Assessment. 1999, Swedish Environmental Protection Agency, Stockholm.
21. Freeman, J., Chen, T., Green supplier selection using an AHP-Entropy-TOPSIS framework. Supply Chain Manage. 20:3 (2015), 327–340.
22. Gómez-Limón, J.A., Sanchez-Fernandez, G., Empirical evaluation of agricultural sustainability using composite indicators. Ecol. Econ. 69:5 (2010), 1062–1075.
23. Geniaux, G., Bellon, S., Deverre, C., Powell, B., Sustainable Development Indicator Frameworks and Initiatives. 2009, SEAMLESS.
24. Goedkoop, M., Spriensma, R., The Eco-indicator99: A Damage Oriented Method for Life Cycle Impact Assessment: Methodology Report., 2001.
25. Gordon, D., Census based deprivation indices: their weighting and validation. J. Epidemiol. Community Health 49:Suppl. 2 (1995), S39–S44.
26. Gordon, M., Problems and fundamentals of sustainable development indicators. Sustain. Dev. 4 (1996), 1–11.
27. Grabisch, M., Aggregation Functions. 2009, Cambridge University Press.
28. Green, P.E., DeSarbo, W.S., Additive decomposition of perceptions data via conjoint analysis. J. Consum. Res., 1978, 58–65.
29. Guitouni, A., Martel, J.-M., Tentative guidelines to help choosing an appropriate MCDA method. Eur. J. Oper. Res. 109:2 (1998), 501–521.
30. Hardi, P., Zdan, T., Assessing Sustainable Development: Principles in Practice. 1997, International Institute for Sustainable Development, Winnipeg, Manitoba.
31. Hermans, E., Van den Bossche, F., Wets, G., Combining road safety information in a performance index. Accid. Anal. Prev. 40:4 (2008), 1337–1344.
32. Ho, W., Xu, X., Dey, P.K., Multi-criteria decision making approaches for supplier evaluation and selection: a literature review. Eur. J. Oper. Res. 202:1 (2010), 16–24.
33. Ho, W., Integrated analytic hierarchy process and its applications–A literature review. Eur. J. Oper. Res. 186:1 (2008), 211–228.
34. Huang, F., Wang, Y., Difficulties and counter-measures for biodiversity conservation. Biodiv. Sci. 9:4 (2001), 399–406.
35. Huang, L., Wu, J., Yan, L., Defining and measuring urban sustainability: a review of indicators. Landsc. Ecol. 30 (2015), 1175–1193.
36. Jollands, N., How to aggregate sustainable development indicators: a proposed framework and its application. Int. J. Agric. Resour. Governance Ecol. 5:1 (2005), 18–34.
37. Juwana, I., Muttil, N., Perera, B., Indicator-based water sustainability assessment—A review. Sci. Total Environ. 438 (2012), 357–371.
38. Kates, R., Clark, W., Our Common Journey: a Transition Toward Sustainability. 1999, National Academy Press, Washignton Dc.
39. Kates, R., Clark, W.C., Hall, J.M., Jaeger, C., Lowe, I., McCarthy, J.J., Schellnhuber, H.J., Bolin, B., Dickson, N.M., Faucheux, S., Sustainability science. Science, 2001, 641–642.
40. Kates, R.W., From the unity of nature to sustainability science: ideas and practice. Sustainability Science: The Emerging Paradigm and the Urban Environment, 2012, Springer, 3–19.
41. Kaufmann, D., Kraay, A., Zoido, P., Aggregating Governance Indicators. World Bank Policy Research Working Paper. 1999.
42. Kaufmann, D., Kraay, A., Mastruzzi, M., The worldwide governance indicators: methodology and analytical issues. Hague J. Rule Law 3:02 (2011), 220–246.
43. Keeney, R.L., A decision analysis with multiple objectives: the Mexico city airport. Bell J. Econ. Manage. Sci., 1973, 101–117.
44. Keeney, R.L., Multiplicative utility functions. Oper. Res. 22:1 (1974), 22–34.
45. Kleinbaum, D., Kupper, L., Nizam, A., Rosenberg, E., Applied Regression Analysis and Other Multivariable Methods. 2013, Cengage Learning.
46. Krajnc, D., Glavič, P., A model for integrated assessment of sustainable developmentResources. Conserv. Recycl. 43:2 (2005), 189–208.
47. Land, K., The Foundation for Child Development Child and Youth Well-Being Index (CWI), 1975–2004, with Projections for 2005. 2006, Duke University Durham, NC.
48. Li, Y., Shi, X., Yao, L., Evaluating energy security of resource-poor economies:A modified principle component analysis approach. Energy Econ. 58 (2016), 211–221.
49. Liberati, A., Altman, D., Tetzlaff, J., Mulrow, C., Gotzsche, P.C., Ioannidis, P.A., Clarke, M., Devereaux, P.J., Kleijnen, J., Moher, D., The PRISMA statement forreportingsystematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med., 6(7), 2009.
50. Loh, J., Randers, J., MacGillivray, A., Kapos, V., Jenkins, M., Groombridge, B., Living Planet Report, 1998., 1998, WWF, Gland, Switzerland.
51. Loh, J., Green, R.E., Ricketts, T., Lamoreux, J., Jenkins, M., Kapos, V., Randers, J., The Living Planet Index: using species population time series to track trends in biodiversity. Phil. Trans. R. Soc. B: Biol. Sci. 360:1454 (2005), 289–295.
52. Markulev, A., Long, A., On Sustainability: an Economic Approach. 2013, Productivity Commission Staff Research, Canberra.
53. Mayer, A.L., Strengths and weaknesses of common sustainability indices for multidimensional systems. Environ. Int. 34:2 (2008), 277–291.
54. McClelland, G., Equal Versus Differential Weighting for Multiattribute Decisions: There Are No Free Lunches. DTIC Document. 1978.
55. McGranahan, D., Development indicators and development models. J. Dev. Stud., 1971, 91–102.
56. Meadows, D.H., Indicators and Information Systems for Sustainable Development. 1998, Sustainability Institute, Hartland Four Corners, Vermont.
57. Melyn, W., Moesen, W., Towards a Synthetic Indicator of Macroeconomic Performance: Unequal Weighting when Limited Information Is Available. 1991.
58. Mikulić, J., Kožić, I., Krešić, D., Weighting indicators of tourism sustainability: A critical note. Ecol. Indic. 48 (2015), 312–314.
59. Mori, K., Christodoulou, A., Review of sustainability indices and indicators: towards a new City Sustainability Index (CSI). Environ. Impact Assess. Rev. 32:1 (2012), 94–106.
60. Morse, S., McNamara, N., Acholo, M., Okwoli, B., Sustainability indicators: the problem of integration. Sust. Dev. 9:1 (2001), 1–15.
61. Muldur, U., Technical Annex on Structural Indicators. Two Composite Indicators to Assess the Progress of Member States in Their Transition Towards a Knowledge Based Economy. 2001, Directorate-General for Research and Innovation, Brussel.
62. Munda, G., Nardo, M., Non-compensatory Composite Indicators for Ranking Countries: A Defensible Setting. EUR Report., 2005, EUR (21833).
63. Munda, G., Multicriteria Assessment. International Society for Ecological Econimics. 2003, Internet Encyclopaedia of Ecological Economics, 10.
64. Munda, G., Social multi-criteria evaluation: methodological foundations and operational consequences. Eur. J. Oper. Res. 158:3 (2004), 662–677.
65. Munda, G., Measuring sustainability: a multi-criterion frameworkEnvironment. Dev. Sustain. 7:1 (2005), 117–134.
66. Munda, G., Intensity of preference and related uncertainty in non-compensatory aggregation rules. Theory Decis. 73:4 (2012), 649–669.
67. Murray, C.J., Lauer, J., Tandon, A., Frenk, J., Overall Health System Achievement for 191 Countries. Global Programme on Evidence for Health Policy, Discussion Paper Series. 2000, World Health Organization, Geneva.
68. Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Tools for Composite Indicators Building. European Comission, EUR 21682 EN. 2005, Institute for the Protection and Security of the Citizen, Ispra, Italy.
69. OECD, Core Set of Indicators for Environmental Performance Reviews. 1993, OECD, Paris.
70. OECD, Handbook on Constructing Composite Indicators: Methodology and User Guide. 2008, OECD publishing.
71. Parker, J., Environmental Reporting and Environmental Indices. PhD Dissertation., 1991, University of Cambridge, Cambridge, UK.
72. Pennoni, F., Tarantola, S., Latvala, A., The 2005 European e-business Readiness Index. 2006. 2006, 1–54.
73. Pohekar, S., Ramachandran, M., Application of multi-criteria decision making to sustainable energy planning—a review. Renew. Sustain. Energy Rev. 8:4 (2004), 365–381.
74. Pollesch, N., Dale, V., Applications of aggregation theory to sustainability assessment. Ecol. Econ. 114 (2015), 117–127.
75. Porter, M.E., Stern, S., National Innovative Capacity. The Global Competitiveness Report. 2002., 2001, 102–118.
76. Prescott-Allen, R., The Wellbeing of Nations. 2001, Island Press, Washington DC.
77. Puolamaa, M., Kaplas, M., Reinikainen, T., Index of Environmental Friendliness: a Methodological Study, Official Statistics of Finland. 1996.
78. Riedler, B., Pernkopf, L., Strasser, T., Lang, S., Smith, G., A composite indicator for assessing habitat quality of riparian forests derived from Earth observation data. Int. J. Appl. Earth Observ. Geoinf. 37 (2015), 114–123.
79. Rowley, H.V., Peters, G.M., Lundie, S., Moore, S.J., Aggregating sustainability indicators: beyond the weighted sum. J. Environ. Manage. 111 (2012), 24–33.
80. Saaty, T.L., How to make a decision: the analytic hierarchy process. Eur. J. Oper. Res. 48:1 (1990), 9–26.
81. Saaty, T.L., Decision making with the analytic hierarchy process. Int. J. Serv. Sci. 1 (2008), 83–98.
82. Sachs, J.D., The Age of Sustainable Development. 2015, Columbia University Press, New York.
83. Saisana, M., Tarantola, S., State-of-the-art Report on Current Methodologies and Practices for Composite Indicator Development., 2002, Citeseer.
84. Sands, G.R., Podmore, T.H., A generalized environmental sustainability index for agricultural systemsAgriculture. Ecosys. Environ. 79:1 (2000), 29–41.
85. Shwartz, M., Burgess, J.F., Berlowitz, D., Benefit-of-the-doubt approaches for calculating a composite measure of quality. Health Serv. Outcomes Res. Methodol. 9:4 (2009), 234–251.
86. Singh, R.K., Murty, H., Gupta, S., Dikshit, A., Development of composite sustainability performance index for steel industry. Ecol. Indic. 7:3 (2007), 565–588.
87. Singh, R.K., Murty, H., Gupta, S., Dikshit, A., An overview of sustainability assessment methodologies. Ecol. Indic. 9:2 (2009), 189–212.
88. Smith, L.I., A Tutorial on Principal Components Analysis. 2002, Cornell University, USA.
89. Thomas, M.A., What do the worldwide governance indicators measure&quest. Eur. J. Dev. Res. 22:1 (2010), 31–54.
90. UNDP, Human Development Report 1990., 1990, Oxford University Press, New York.
91. Vaidya, O.S., Kumar, S., Analytic hierarchy process: an overview of applications. Eur. J. Oper. Res. 169:1 (2006), 1–29.
92. Van Haaster, B., Ciroth, A., Fontes, J., Wood, R., Ramirez, A., Development of a methodological framework for social life-cycle assessment of novel technologies. Int. J. Life Cycle Assess. 22:3 (2017), 423–440.
93. Van de Kerk, G., Manuel, A.R., A comprehensive index for a sustainable society: the SSI—the sustainable society index. Ecol. Econ. 66:2 (2008), 228–242.
94. Vitunskiene, V., Dabkiene, V., Framework for assessing the farm relative sustainability: a Lithuanian case study. Agricultural Economics, 62(3), 2016.
95. Wang, J., Jing, Y., Zhang, C., Zhao, J., Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew. Sustain. Energy Rev. 13:9 (2009), 2263–2278.
96. Warhurst, A., Sustainability Indicators and Sustainability Performance Management. Mining, Minerals and Sustainable Development [MMSD] Project Report., 2002, 43.
97. Wilson, M.C., Wu, J., The problems of weak sustainability and associated indicators. Int. J. Sustain. Dev. World Ecol. 24:1 (2017), 44–51.
98. Wind, Y., Green, P.E., Marketing Research and Modeling: Progress and Prospects: a Tribute to Paul E. 2013, Green Springer Science & Business Media.
99. WorldBank, World Development Indicators 1999. 1999, World Bank, Washington, DC.
100. Wu, J., Wu, T., Sustainability indicators and indices: an overview. Handbook of Sustainable Management, 2012, Imperial College Press, London, 65–86.
101. Wu, J., Landscape sustainability science: ecosystem services and human well-being in changing landscapes. Landscape Ecol. 28:6 (2013), 999–1023.
102. Yeheyis, M., Hewage, K., Alam, M.S., Eskicioglu, C., Sadiq, R., An overview of construction and demolition waste management in Canada: a lifecycle analysis approach to sustainability. Clean Technol. Environ. Policy 15:1 (2013), 81–91.