Combining experts' risk judgments on technology performance of phytoremediation: Self-confidence ratings, averaging procedures, and formative consensus building

Risk Analysis

Volumn 27, Issue 1, 2007, Pages 225-240

  Scholz, Roland W ^a   Hansmann, Ralf ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Expert risk judgments; Formative consensus building; Group decision making; Phytoremediation; Probability judgments

Indexed keywords

ALGORITHMS; DECISION SUPPORT SYSTEMS; HEAVY METALS; PROBABILITY DISTRIBUTIONS; PUBLIC POLICY; STATISTICAL METHODS;

EXPERT RISK JUDGMENTS; FORMATIVE CONSENSUS BUILDING; PHYTOREMEDIATION; PROBABILITY JUDGMENTS;

ENVIRONMENTAL REGULATIONS;

ALGORITHM; CLEANUP; DECISION MAKING; EXPERT SYSTEM; HEAVY METAL; PERFORMANCE ASSESSMENT; PHYTOREMEDIATION; POLLUTION POLICY; PROBABILITY; SOIL POLLUTION; TECHNOLOGICAL DEVELOPMENT;

ALGORITHM; ARTICLE; COMPARATIVE STUDY; CONTAMINATION; ENVIRONMENTAL MANAGEMENT; PHYTOREMEDIATION; PLANT; PROBABILITY; QUANTITATIVE ANALYSIS; RISK ASSESSMENT; SOIL MANAGEMENT; SOIL POLLUTION; SOIL STRUCTURE; STATISTICS; VALIDITY;

AIR POLLUTION, INDOOR; BENZENE; BIODEGRADATION, ENVIRONMENTAL; CALIBRATION; CONSERVATION OF NATURAL RESOURCES; DECISION MAKING; ENVIRONMENTAL EXPOSURE; ENVIRONMENTAL POLLUTANTS; ENVIRONMENTAL POLLUTION; HUMANS; PERCEPTION; PROBABILITY; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; SOIL POLLUTANTS;

EID: 33947113892     PISSN: 02724332     EISSN: 15396924     Source Type: Journal    
DOI: 10.1111/j.1539-6924.2006.00871.x     Document Type: Article

References (67)

1. Florig, H. K., Morgan, G., Morgan, K. M., Jenni, K. E., Fischhoff, B., Fischbeck, P. S., & DeKay, M. L. (2001). A deliberative method for ranking risks (1): Overview and test bed development. Risk Analysis, 21, 913-921.
2. Morgan, K. M., DeKay, M. L., Fischbeck, P. S., Morgan, M. G., Fischhoff, B., & Florig, H. K. (2001). A deliberative method for ranking risks (2): Evaluation of validity and agreement among risk managers. Risk Analysis, 21, 923-937.
3. Cooke, R. M., & Goossens, L. H. J. (2004). Expert judgement elicitation for risk assessments of critical infrastructures. Journal of Risk Research, 7, 643-656.
4. Willems, A., Janssen, M., & Verstegen, C. (2005). Expert quantification of uncertainties in a risk analysis for an infrastructure project. Journal of Risk Research, 8, 2-17.
5. Sniezek, J. A. (1992). Groups under uncertainty: An examination of confidence in group decision making. Organizational Behavior and Human Decision Processes, 52, 124-155.
6. Zarnoth, P., & Sniezek, J. A. (1997). The social influence of confidence in group decision making. Journal of Experimental Social Psychology, 33, 345-366.
7. Gigone, D., & Hastie, R. (1997). Proper analysis of the accuracy of group judgments. Psychological Bulletin, 121, 149-167.
8. Slevin, D. P., Boone, L. W., Russo, E. M., & Allen, R. S. (1998). CONFIDE: A collective decision-making procedure using confidence estimates of individual judgments. Group Decision and Negotiation, 7(2), 179-194.
9. Mieg, H. A. (2001). The Social Psychology of Expertise: Case Studies in Research, Professional Domains, and Expert Roles. Mahwah, NJ: Erlbaum.
10. Wenger, K., Gupta, S. K., Furrer, G., & Schulin, R. (2002). Zinc extraction potential of two common crop plants, Nicotiana tabacum and Zea mays. Plant and Soil, 242(2), 217-225.
11. Huang, J. W., & Cunningham, S. (1996). Lead phytoextraction: Species variation in lead uptake and translocation. New Phytologist, 134, 75-84.
12. Srivastava, M., Ma, L. Q., & Cotruvo, J. A. (2005). Uptake and distribution of selenium in different fern species. International Journal of Phytoremediation, 7(1), 33-42.
13. Blaylock, M. J., Salt, D. E., Duschenkow, S., Zakharova, O., Gussmann, C., Kapulnik, Y., Ensley, B. D., & Raskin, I. (1997). Enhanced accumulation of Pb in Indian mustard by soil-applied chelating agents. Environmental Science and Technology, 31, 860-865.
14. Salt, D. E., Smith, R. D., & Raskin, I. (1998). Phytoremediation. Annual Review of Plant Physiology and Plant Molecular Biology, 49, 643-668.
15. Lombi, E., Zhao, F. J., Dunham, S. J., & McGrath, S. P. (2001). Phytoremediation of heavy metal-contaminated soils: Natural hyperaccumulation versus chemically enhanced phytoextraction. Journal of Environmental Quality, 30(6), 1919-1926.
16. Otway, H., & von Winterfeldt, D. (1992). Expert judgment in risk analysis and management: Process, context, and pitfalls. Risk Analysis, 12(1), 83-93.
17. Sell, J., Kayser, A., Schulin, R., & Brunner, I. (2005). Contribution of ectomycorrhizal fungi to cadmium uptake of poplars and willows from a heavily polluted soil. Plant and Soil, 277(1-2), 245-253.
18. Kayser, A., Schröder, T. J., Grünwald, A., & Schulin, R. (2001). Solubilization and plant uptake of zinc and cadmium from soils treated with elemental Sulfur. International Journal of Phytoremediation, 3(4), 381-400.
19. Greger, M. (1999). Metal availability and bioconcentration in plant. In M. N. Prasard, & J. Hagenmeyer (Eds.), Heavy Metal Stress in Plants. From Molecules to Ecosystems (pp.1-27). Berlin: Springer.
20. Hammer, D. A., Kayser, A., & Keller, C. (2003). Phytoextraction of Cd and Zn with Salix viminalis in field trials. Soil Use and Management, 19, 187-192.
21. Beyth-Marom, R. (1982). How probable is probable? Numerical translation of verbal probability expressions. Journal of Forecasting, 1, 257-269.
22. Scholz, R. W., Popp, M., May, T. W., & Nothbaum, N. (1993). Risikoberechnungen zur Abwasserabgabe. [Risk calculations for the sewage discharge fee]. In ATV-Landesgruppen-Tagungen 1993, Donaueschingen (pp. 45-59). Hennef: Gesellschaft zur Förderung der Abwassertechnik e.V. (GFA).
23. Scholz, R. W., & Tietje, O. (2002). Embedded Case Study Methods: Integrating Quantitative and Qualitative Knowledge. Thousand Oaks: Sage.
24. Whitfield, R. G., & Wallsten, T. S. (1989). A risk assessment for selected lead-induced health effects: An example of a general methodology. Risk Analysis, 9(2), 197-207.
25. Stroop, J. R. (1932). Is the judgement of the group better than that of the average member of the group? Journal of Experimental Psychology, 15, 550-562.
26. McGrath, J. E. (1984). Groups: Interaction and Performance. Englewood Cliffs, NJ: Prentice-Hall.
27. Hastie, R. (1986). Review essay: Experimental evidence on group accuracy. In G. Owen & B. Grofman (Eds.), Information Pooling and Group Accuracy (pp. 129-157). Westport, CT: JAI.
28. Hansmann, R., Mieg, H. A., Scholz, R. W., & Crott, H. W. (2003). Shifting students to experts complex systems knowledge: Effects of bootstrapping, group discussion, and case study participation. International Journal of Sustainability in Higher Education, 4(2), 151-168.
29. Wallsten, T. S., Budescu, D. V., Erev, I., & Diederich, A. (1997). Evaluating and combining subjective probability estimates. Journal of Behavioral Decision Making, 10, 243-268.
30. Johnson, T. R., Budescu, D. V., & Wallsten, T. S. (2001). Averaging probability judgements: Monte Carlo analyses of asymptotic value. Journal of Behavioral Decision Making, 14(2), 123-140.
31. Ariely, D., Au, W. T., Bender, R. H., Budescu, D. V., Dietz, C. B., Gu, H. B., Wallsten, T. S., & Zauberman, G. (2000). The effects of averaging subjective probability estimates between and within judges. Journal of Experimental Psychology: Applied, 6(2), 130-147.
32. Hurley, W. J., & Lior, D. U. (2002). Combining expert judgment: On the performance of trimmed mean vote aggregation procedures in the presence of strategic voting. European Journal of Operational Research, 140, 142-147.
33. Crott, H. W., Szilvas, K., & Zuber, J. A. (1991). Group decision, choice shift, and polarization in consulting, political and local political scenarios: an experimental investigation. Organizational Behavior and Human Decision Processes, 49, 22-41.
34. Hinsz, V. B. (1999). Group decision making with responses of a quantitative nature: The theory of social decision schemes for quantities. Organizational Behavior and Human Decision Processes, 80, 28-49.
35. Kerr, N. L., & Tindale, R. S. (2004). Group performance and decision making. Annual Review of Psychology, 55, 623-655.
36. Crott, H. W., & Hansmann, R. (2003). Informative intervention to improve normative functioning and output of groups. Swiss Journal of Psychology, 62(3), 177-193.
37. Fischhoff, B. (1982). Debiasing. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under Uncertainty: Heuristics and Biases (pp. 422-444). New York: Cambridge University Press.
38. Sniezek, J. A., & Henry, R. A. (1989). Accuracy and confidence in group judgment. Organizational Behavior and Human Decision Processes, 43, 1-28.
39. Sniezek, J. A., & Henry, R. A. (1990). Revision, weighting and commitment in consensus group judgement. Organizational Behavior and Human Decision Processes, 45, 66-84.
40. Coombs, C. H. (1954). Social choice and strength of preference. In R. N. Thrall, C. H. Coombs, & R. N. Davis (Eds.), Decision Processes (pp. 69-86). New York: Wiley.
41. Crott, H. W. (1965). Gruppenentscheidungen unter verschiedenen Mehrheitsbedingungen [Group decisions with different majorities]. Archiv für die gesamte Psychologie, 117, 113-130.
42. Zuber, J. A., Crott, H. W., & Werner, J. (1992). Choice shift and group polarization: An analysis of the status of arguments and social decision schemes. Journal of Personality and Social Psychology, 62(1), 50-61.
43. Crott, H. W., Grotzer, T., Hansmann, R., Mieg, H. A., & Scholz, R. W. (1999). Prozeßanalyse von Gruppenentscheidungen zu Aspekten ökologischer Stadtplanung. [Analysis of decision processes with respect to facets of ecological town planning]. Zeitschrift für Sozialpsychologie, 30(1), 77-91.
44. Crott, H. W., Zuber, J. A., & Schermer, T. (1986). Social decision schemes and choice shift: An analysis of group decisions among bets. Journal of Experimental Social Psychology, 22, 1-21.
45. Bonner, B. L., Gonzalez, C. L., & Sommer, D. (2004). Centrality and accuracy in group quantity estimations. Group Dynamics: Theory, Research and Practice, 8(3), 155-165.
46. Black, D. (1948). On the rationale of group decision making. Journal of Political Economy, 56, 23-34.
47. Black, D. (1958). The Theory of Committees and Elections. Cambridge: Cambridge University Press.
48. Einhorn, H. J., Hogarth, R. M., & Klempner, E. (1977). Quality of group judgment. Psychological Bulletin, 84(1), 158-172.
49. Laughlin, P. R., Gonzales, C. M., & Sommer, D. (2003). Quantity estimations by groups and individuals: Effects of known domain boundaries. Group Dynamics: Theory, and Practice, 7(1), 55-63.
50. Laughlin, P. R., Bonner, B. L., Miner, A. G., & Carnevale, P. J. (1999). Frames of reference in quantity estimations by groups and individuals. Organizational Behavior and Human Decision Processes, 80, 103-117.
51. Brunswik, E. (1955). Representative design and probabilistic theory in a functional psychology. Psychological Review, 62(3), 193-217.
52. Morgan, G., & Henrion, M. (1990). Uncertainty. A Guide to Dealing with Uncertainty in Quantitative Risk and Policy. Cambridge, NJ: Cambridge University Press.
53. Cooke, R. M., & Goossens, L. H. J. (2000). Procedures Guide for Structured Expert Judgment. Report EUR 18820 EN Prepared under Contract FI4P-CT95-0006 for the European Commission, Directorate General for Research.
54. Janis, I. L. (1997). Groupthink. In R. P. Vecchio (Ed.), Leadership: Understanding the Dynamics of Power and Influence in Organizations. Notre Dame, IN: University of Notre Dame Press.
55. Hackman, J. R. (1998). Why teams don't work. In R. S.Tindale, L. Heath, J. Edwards, E. Posavac, F. B. Bryant, Y. Suarez-Balcazar, E. Henderson-King, & J. Meyers (Eds.), Theory and Research in Small Groups (pp. 245-267). New York: Plenum Press.
56. Hesske, S., Schärli, M., Tietje, O., & Scholz, R. W. (1998). Zum Umgang mit Schwermetallen im Boden: Falldossier Dornach. [Orientations on Dealing with Heavy Metal Contaminated Soils: Dossier to the Dornach Case]. Lengerich: Pabst Science Publisher.
57. Grasmück, D., & Scholz, R. W. (2005). Risk perception of heavy metal soil contamination by high-exposed and low-exposed inhabitants: The role of knowledge and emotional concerns. Risk Analysis, 25(3), 611-622.
58. Susskind, L. E., McKearnen, S., & Thomas-Lamar, J. (1999). The Consensus Building Handbook - A Comprehensive Guide to Reaching Agreement. Thousand Oaks: Sage.
59. Nowack, B., Obrecht, J. M., Schluep, M., Schulin, R., Hansmann, W., & Köppel, V. (2001). Elevated lead and zinc contents in remote alpine soils of the Swiss National Park. Journal of Environmental Quality, 30, 919-926.
60. Tandy, S., Schulin, R., & Nowack, B. (2006). The influence of EDDSon the uptake of heavy metals in hydroponically grown sunflowers. Chemosphere, 62, 1454-1463.
61. Seuntjens, P., Nowack, B., & Schulin, R. (2004). Root-zone modeling of heavy metal uptake and leaching in the presence of organic ligands. Plant and Soil, 265, 61-73.
62. Tandy, S., Bossart, K., Müller, R., Ritschel, J., Hauser, L., Schulin, R., & Nowack, B. (2004). Extraction of heavy metals from soils using biodegradable chelating agents. Environmental Science and Technology, 38, 937-944.
63. Kayser, A. (2000). Evaluation and enhancement of phytoextraction of heavy metals from contaminated soils. Dissertation Nr. 13563. ETH Zürich.
64. Häberli, R., Gessler, R., Grossenbacher-Mansuy, W., & Lehmann Pollheimer, D. (2002). Vision Lebensqualität. Nachhaltige Entwicklung - ökologisch notwendig, wirtschaftlich klug, gesellschaftlich möglich. Schlussbericht des Schwerpunktprogramms Umwelt Schweiz. Zürich: VDF.
65. Prichard, C. L., Ed. (1997). Risk Management: Concepts and Guidance. Arlington, VA: ESI International.
66. Nothbaum, N. (1997). Experten-Entscheidung unter Unsicherheit [Expert Decision Under Uncertainty]. Frankfurt: Peter Lang.
67. Einhorn, H. J., Hogarth, R. M., & Klempner, E. (1977). Quality of group judgments. Psychological Bulletin, 84(1), 158-172