The Delphi technique in ecology and biological conservation: Applications and guidelines

Methods in Ecology and Evolution

Volumn 6, Issue 9, 2015, Pages 1097-1109

  Mukherjee, Nibedita ^a,b,c   Hugé, Jean ^c,d   Sutherland, William J ^a   Mcneill, Jeffrey ^e   Van Opstal, Maarten ^b,c   Dahdouh Guebas, Farid ^b,c   Koedam, Nico ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^c UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^d GHENT UNIVERSITY   (Belgium)

^e MASSEY UNIVERSITY   (New Zealand)

Author keywords

Conservation; Expert; Management support; Modelling; Participatory approach; Policy; Scenarios; The Delphi technique

Indexed keywords

EID: 84941803111     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/2041-210X.12387     Document Type: Article

References (90)

1. Adler, M. & Ziglio, E. (1996) Gazing Into the Oracle: The Delphi Method and its Application to Social Policy and Public Health. Jessica Kingsley Publishers, London, UK.
2. Ayton, P., Ferrell, W.R. & Stewart, T.R. (1999) Commentaries on 'The Delphi technique as a forecasting tool: issues and analysis' by Rowe and Wright. International Journal of Forecasting, 15, 3.
3. Benitez-Capistros, F., Hugé, J. & Koedam, N. (2014) Environmental impacts on the Galapagos Islands: identification of interactions, perceptions and steps ahead. Ecological Indicators, 38, 113-123.
4. Burgman, M., Carr, A., Godden, L., Gregory, R., McBride, M., Flander, L. & Maguire, L. (2011a) Redefining expertise and improving ecological judgment. Conservation Letters, 4, 81-87.
5. Burgman, M., McBride, M., Ashton, R., Speirs-Bridge, A., Flander, L., Wintle, B., Fidler, F., Rumpff, L. & Twardy, C. (2011b) Expert status and performance. PLoS ONE, 6, e22998.
6. Burgman, M.A., Regan, H.M., Maguire, L.A., Colyvan, M., Justus, J., Martin, T.G. & Rothley, K. (2014) Voting systems for environmental decisions. Conservation Biology, 28, 322-332.
7. Choi, H.C. & Sirakaya, E. (2006) Sustainability indicators for managing community tourism. Tourism Management, 27, 1274-1289.
8. Clark, K.E., Applegate, J.E., Niles, L.J. & Dobkin, D.S. (2006) An objective means of species status assessment: adapting the Delphi technique. Wildlife Society Bulletin, 34, 7.
9. Crabbe, M.J.C., Martinez, E., Garcia, C., Chub, J., Castro, L. & Guy, J. (2010) Is capacity building important in policy development for sustainability? A case study using action plans for sustainable marine protected areas in Belize. Society & Natural Resources, 23, 181-190.
10. Dalkey, N. & Helmer, O. (1963) An experimental application of the Delphi method to the use of experts. Management Science, 9, 458-467.
11. De Brucker, K., Macharis, C. & Verbeke, A. (2013) Multi-criteria analysis and the resolution of sustainable development dilemmas: a stakeholder management approach. European Journal of Operational Research, 224, 122-131.
12. De Lange, H.J., Sala, S., Vighi, M. & Faber, J.H. (2010) Ecological vulnerability in risk assessment-a review and perspectives. Science of the Total Environment, 408, 3871-3879.
13. De Urioste-Stone, S., McLaughlin, W.J. & Sanyal, N. (2006) Using the Delphi technique to identify topics for a protected area co-management capacity building programme. International Journal of Rural Management, 2, 191-211.
14. Diamond, I.R., Grant, R.C., Feldman, B.M., Pencharz, P.B., Ling, S.C., Moore, A.M. & Wales, P.W. (2014) Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of Clinical Epidemiology, 67, 401-409.
15. Donohoe, H.M. & Needham, R.D. (2009) Moving best practice forward: Delphi characteristics, advantages, potential problems, and solutions. International Journal of Tourism Research, 11, 415-437.
16. Eycott, A.E., Marzano, M. & Watts, K. (2011) Filling evidence gaps with expert opinion: the use of Delphi analysis in least-cost modelling of functional connectivity. Landscape and Urban Planning, 103, 400-409.
17. Fischer, A. & Young, J.C. (2007) Understanding mental constructs of biodiversity: implications for biodiversity management and conservation. Biological Conservation, 136, 271-282.
18. Frewer, L.J., Fischer, A.R.H., Wentholt, M.T.A., Marvin, H.J.P., Ooms, B.W., Coles, D. & Rowe, G. (2011) The use of Delphi methodology in agrifood policy development: some lessons learned. Technological Forecasting and Social Change, 78, 1514-1525.
19. Geneletti, D. (2008) Incorporating biodiversity assets in spatial planning: methodological proposal and development of a planning support system. Landscape and Urban Planning, 84, 252-265.
20. Gill, P., Stewart, K., Treasure, E. & Chadwick, B. (2008) Methods of data collection in qualitative research: interviews and focus groups. British Dental Journal, 204, 291-295.
21. Glass, J.H., Scott, A.J. & Price, M.F. (2013) The power of the process: co-producing a sustainability assessment toolkit for upland estate management in Scotland. Land Use Policy, 30, 254-265.
22. Gobbi, M., Riservato, E., Bragalanti, N. & Lencioni, V. (2012) An expert-based approach to invertebrate conservation: identification of priority areas in central-eastern Alps. Journal for Nature Conservation, 20, 274-279.
23. Gomez-Zamalloa, M.G., Caparros, A. & Ayanz, A.S.-M. (2011) 15 years of forest certification in the European Union. Are we doing things right? Forest Systems, 20, 14.
24. von der Gracht, H.A. (2012) Consensus measurement in Delphi studies. Technological Forecasting and Social Change, 79, 1525-1536.
25. Hasson, F. & Keeney, S. (2011) Enhancing rigour in the Delphi technique research. Technological Forecasting and Social Change, 78, 1695-1704.
26. Hasson, F., Keeney, S. & McKenna, H. (2000) Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 32, 8.
27. Hess, G.R. & King, T.J. (2002) Planning open spaces for wildlife I. Selecting focal species using a Delphi survey approach. Landscape and Urban Planning, 58, 16.
28. Hilbert, M., Miles, I. & Othmer, J. (2009) Foresight tools for participative policy-making in inter-governmental processes in developing countries: lessons learned from the eLAC Policy Priorities Delphi. Technological Forecasting and Social Change, 76, 880-896.
29. Hirsch, P.D., Adams, W.M., Brosius, J.P., Zia, A., Bariola, N. & Dammert, J.L. (2011) Acknowledging conservation trade-offs and embracing complexity. Conservation Biology, 25, 259-264.
30. Hugé, J., Le Trinh, H., Hai, P.H., Kuilman, J. & Hens, L. (2010) Sustainability indicators for clean development mechanism projects in Vietnam. Environment, Development and Sustainability, 12, 561-571.
31. Hussler, C., Muller, P. & Rondé, P. (2011) Is diversity in Delphi panelist groups useful? Evidence from a French forecasting exercise on the future of nuclear energy. Technological Forecasting and Social Change, 78, 1642-1653.
32. Hutchings, A. & Raine, R. (2006) A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. Journal of Health Services Research & Policy, 11, 172-179.
33. Janis, I.L. (1971) Groupthink. Psychology Today, 5, 74-76.
34. Keeney, S., Hasson, F. & McKenna, H. (2006) Consulting the oracle: ten lessons from using the Delphi technique in nursing research. Methodological Issues in Nursing Research, 53, 9.
35. Kerr, N.L. & Tindale, R.S. (2011) Group-based forecasting?: a social psychological analysis. International Journal of Forecasting, 27, 14-40.
36. Kuhnert, P.M., Martin, T.G. & Griffiths, S.P. (2010) A guide to eliciting and using expert knowledge in Bayesian ecological models. Ecology Letters, 13, 900-914.
37. Kuusi, O. (1999) Expertise in the future use of generic technologies-epistemic and methodological considerations concerning Delphi studies. VATT- Research report. Government Institute for Economic Research, Helsinki.
38. Landeta, J. (1999) El método Delphi. Una técnica de previsión para la incertidumbre. Ariel, Barcelona, Spain, 223 pp.
39. Landeta, J. (2006) Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change, 73, 467-482.
40. Landy, D. & Sigall, H. (1974) Beauty is talent: task evaluation as a function of the performer's physical attractiveness. Journal of Personality and Social Psychology, 29, 299-304.
41. Lemieux, C.J. & Scott, D.J. (2011) Changing climate, challenging choices: identifying and evaluating climate change adaptation options for protected areas management in Ontario, Canada. Environmental Management, 48, 675-690.
42. Likert, R. (1932) A technique for the measurement of attitudes. Archives of Psychology, 140, 1-55.
43. MacMillan, D.C. & Marshall, K. (2006) The Delphi process ? An expert-based approach to ecological modelling in data-poor environments. Animal Conservation, 9, 11-19.
44. Maier, N.R.F. (1967) Assets and liabilities in group problem solving: the need for an integrative function. Psychological Review, 74, 239-249.
45. Martin, T.G., Burgman, M.A., Fidler, F., Kuhnert, P.M., Low-Choy, S., McBride, M. & Mengersen, K. (2012) Eliciting expert knowledge in conservation science. Conservation Biology, 26, 29-38.
46. McBride, M.F., Garnett, S.T., Szabo, J.K., Burbidge, A.H., Butchart, S.H.M., Christidis, L. et al. (2012) Structured elicitation of expert judgments for threatened species assessment: a case study on a continental scale using email. Methods in Ecology and Evolution, 3, 906-920.
47. McShane, T.O., Hirsch, P.D., Trung, T.C., Songorwa, A.N., Kinzig, A., Monteferri, B. et al. (2011) Hard choices: making trade-offs between biodiversity conservation and human well-being. Biological Conservation, 144, 966-972.
48. Mehnen, N., Mose, I. & Strijker, D. (2013) The Delphi method as a useful tool to study governance and protected areas? Landscape Research, 38, 1-18.
49. Meijering, J.V., Kampen, J.K. & Tobi, H. (2013) Quantifying the development of agreement among experts in Delphi studies. Technological Forecasting and Social Change, 80, 1607-1614.
50. Miller, A. & Cuff, W. (1986) The Delphi approach to the mediation of environmental disputes. Environmental Management, 10, 321-330.
51. Moore, S.A., Wallington, T.J., Hobbs, R.J., Ehrlich, P.R., Holling, C.S., Levin, S. et al. (2009) Diversity in current ecological thinking: implications for environmental management. Environmental Management, 43, 17-27.
52. Moreno, V., Morales, M.B. & Traba, J. (2010) Avoiding over-implementation of agri-environmental schemes for steppe bird conservation: a species-focused proposal based on expert criteria. Journal of Environmental Management, 91, 1802-1809.
53. Mukherjee, N., Sutherland, W.J., Khan, M.N.I., Berger, U., Schmitz, N., Dahdouh-Guebas, F. & Koedam, N. (2014a) Using expert knowledge and modeling to define mangrove composition, functioning, and threats and estimate time frame for recovery. Ecology and Evolution, 4, 2247-2262.
54. Mukherjee, N., Sutherland, W.J., Dicks, L., Hugé, J., Koedam, N. & Dahdouh-Guebas, F. (2014b) Ecosystem service valuations of mangrove ecosystems to inform decision making and future valuation exercises. PLoS ONE, 9(9), e107706.
55. Murphy, D.D. & Noon, B.R. (1992) Integrating scientific methods with habitat conservation planning: reserve design for northern spotted owls. Ecological Applications, 2, 3-17.
56. Nisbett, R.E. & Wilson, T.D. (1977) The halo effect: evidence for unconscious alteration of judgments. Journal of Personality and Social Psychology, 35, 250-256.
57. Nowack, M., Endrikat, J. & Guenther, E. (2011) Review of Delphi-based scenario studies: quality and design considerations. Technological Forecasting and Social Change, 78, 1603-1615.
58. Ochoa-Gaona, S., Kampichler, C., de Jong, B.H.J., Hernández, S., Geissen, V. & Huerta, E. (2010) A multi-criterion index for the evaluation of local tropical forest conditions in Mexico. Forest Ecology and Management, 260, 618-627.
59. O'Faircheallaigh, C. (2010) Public participation and environmental impact assessment: purposes, implications, and lessons for public policy making. Environmental Impact Assessment Review, 30, 19-27.
60. Oliver, I. (2002) An expert panel-based approach to the assessment of vegetation condition within the context of biodiversity conservation Stage 1: the identification of condition indicators. Ecological Indicators, 2, 223-237.
61. O'Neill, S.J., Osborn, T.J., Hulme, M., Lorenzoni, I. & Watkinson, A.R. (2008) Using expert knowledge to assess uncertainties in future polar bear populations under climate change. Journal of Applied Ecology, 45, 1649-1659.
62. Orsi, F., Geneletti, D. & Newton, A.C. (2011) Towards a common set of criteria and indicators to identify forest restoration priorities: an expert panel-based approach. Ecological Indicators, 11, 337-347.
63. Parente, R. & Anderson-Parente, J. (2011) A case study of long-term Delphi accuracy. Technological Forecasting and Social Change, 78, 1705-1711.
64. Powell, C. (2003) The Delphi technique: myths and realities. Methodological Issues in Nursing Research, 41, 376-382.
65. Rauch, W. (1979) The decision Delphi. Technological Forecasting and Social Change, 15, 159-169.
66. Redpath, S.M., Arroyo, B.E., Leckie, E.M., Bacon, P., Bayfield, N., Gutierrez, R.J. & Thirgood, S.J. (2004) Using decision modeling with stakeholders to reduce human-wildlife conflict: a Raptor-Grouse case study. Conservation Biology, 18, 350-359.
67. Redpath, S.M., Young, J., Evely, A., Adams, W.M., Sutherland, W.J., Whitehouse, A. et al. (2013) Understanding and managing conservation conflicts. Trends in Ecology & Evolution, 28, 100-109.
68. Rist, S. & Dahdouh-Guebas, F. (2006) Ethnosciences-A step towards the integration of scientific and indigenous forms of knowledge in the management of natural resources for the future. Environment, Development and Sustainability, 8, 467-493.
69. Rowe, G. & Wright, G. (2011) The Delphi technique: past, present, and future prospects - Introduction to the special issue. Technological Forecasting and Social Change, 78, 1487-1490.
70. Rowe, G., Wright, G. & McColl, A. (2005) Judgment change during Delphi-like procedures: the role of majority influence, expertise, and confidence. Technological Forecasting and Social Change, 72, 377-399.
71. Scolozzi, R., Morri, E. & Santolini, R. (2012) Delphi-based change assessment in ecosystem service values to support strategic spatial planning in Italian landscapes. Ecological Indicators, 21, 134-144.
72. Shen, G., Feng, C., Xie, Z., Ouyang, Z., Li, J. & Pascal, M. (2008) Proposed conservation landscape for giant pandas in the Minshan Mountains, China. Conservation Biology, 22, 1144-1153.
73. Simon, H.A. (1984) Models of Bounded Rationality: Economic Analysis and Public Policy. The MIT Press, Cambridge, Massachusetts, USA/London, UK.
74. Sinha, I.P., Smyth, R.L. & Williamson, P.R. (2011) Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Medicine, 8, e1000393.
75. Spenceley, A. (2008) Requirements for sustainable nature-based tourism in transfrontier conservation areas: a Southern African Delphi consultation. Tourism Geographies, 10, 285-311.
76. Steinert, M. (2009) A dissensus based online Delphi approach: an explorative research tool. Technological Forecasting and Social Change, 76, 291-300.
77. Steyaert, S. & Lisoir, H. (2005) Participatory Methods Toolkit - A Practitioner's Manual. King Baudouin Foundation and Flemish Institute for Science and Technology Assessment, Belgium.
78. Sutherland, W.J. (2006) Predicting the ecological consequences of environmental change: a review of the methods. Journal of Applied Ecology, 43, 599-616.
79. Sutherland, W.J. (2013) Review by quality not quantity for better policy. Nature, 503, 16.
80. Sutherland, W.J., Fleishman, E., Mascia, M.B., Pretty, J. & Rudd, M.A. (2011) Methods for collaboratively identifying research priorities and emerging issues in science and policy. Methods in Ecology and Evolution, 2, 238-247.
81. Sutherland, W.J., Gardner, T.A., Haider, J. & Dicks, L.V. (2013) How can local and traditional knowledge be effectively incorporated into international assessments? Oryx, 48, 1-2.
82. Swor, T. & Canter, L. (2011) Promoting environmental sustainability via an expert elicitation process. Environmental Impact Assessment Review, 31, 506-514.
83. Tapio, P. (2002) Disaggregative policy Delphi using cluster analysis as a tool for systematic scenario formation. Technological Forecasting & Social Change, 70, 19.
84. Tapio, P., Paloniemi, R., Varho, V. & Vinnari, M. (2011) The unholy marriage? Integrating qualitative and quantitative information in Delphi processes. Technological Forecasting and Social Change, 78, 1616-1628.
85. Turoff, M. (1970) The design of a policy Delphi. Technological Forecasting & Social Change, 2, 149-171.
86. UNESCO (2009) UN World Water Development Report.
87. Wallington, T.J. & Moore, S.A. (2005) Ecology, values, and objectivity: advancing the debate. BioScience, 55, 873-878.
88. White, P.C.L., Jennings, N.V., Renwick, A.R. & Barker, N.H.L. (2005) Questionnaires in ecology: a review of past use and recommendations for best practice. Journal of Applied Ecology, 42, 421-430.
89. Woudenberg, F. (1991) An evaluation of Delphi. Technological Forecasting & Social Change, 40, 131-150.
90. Yaniv, I.I. & Kleinberger, E. (2000) Advice taking in decision making: egocentric discounting and reputation formation. Organizational Behavior and Human Decision Processes, 83, 260-281.