Evaluating public-participation exercises: A research agenda

Science Technology and Human Values

Volumn 29, Issue 4, 2004, Pages 512-557

  Rowe, Gene ^a,c   Frewer, Lynn J ^b  

^a INSTITUTE OF FOOD RESEARCH   (United Kingdom)

^b WAGENINGEN UNIVERSITY   (Netherlands)

^c INSTITUTE OF FOOD RESEARCH   (United Kingdom)

Author keywords

Effectiveness; Evaluation; Public participation; Research agenda

Indexed keywords

EID: 0346009569     PISSN: 01622439     EISSN: None     Source Type: Journal    
DOI: 10.1177/0162243903259197     Document Type: Review

References (81)

1. Arnstein, S. R. 1969. A ladder of citizen participation. Journal American Institute of Planners 35:215-24.
2. Aronoff, M., and V. Gunter. 1994. A pound of cure: Facilitating participatory processes in technological hazard disputes. Society and Natural Resources 7:235-52.
3. Barnes, M. 1999. Building a deliberative democracy: An evaluation of two citizens' juries. London: IPPR.
4. Beierle, T. C., and D. M. Konisky. 2000. Values, conflict, and trust in participatory environmental planning. Journal of Policy Analysis and Management 19 (4): 587-602.
5. Berry, J. M., K. E. Portney, M.B. Bablich, and R. Mahoney. 1984. Public involvement in administration: The structural determinants of effective citizen participation. Journal of Voluntary Action Research 13:7-23.
6. Bickerstaff, K., and G. Walker. 2001. Participatory local governance and transport planning. Environment and Planning A 33:431-51.
7. Blahna, D. J., and S. Yonts-Shepard. 1989. Public involvement in resource planning: Toward bridging the gap between policy and implementation. Society and Natural Resources 2:209-27.
8. Bryman, A., and D. Cramer. 1997. Quantitative data analysis. London: Routledge.
9. Carnes, S. A., M. Schweitzer, E. B. Peelle, A. K. Wolfe, and J. F. Munro. 1998. Measuring the success of public participation on environmental restoration and waste management activities in the US Department of Energy. Technology in Society 20 (4): 385-406.
10. Carr, D. S., and K. Halvorsen. 2001. An evaluation of three democratic, community-based approaches to citizen participation: Surveys, conversations with community groups, and community dinners. Society and Natural Resources 14 (2): 107-26.
11. Checkoway, B. 1981. The politics of public hearings. The Journal of Applied Behavioral Science 17 (4): 566-82.
12. Chess, C., and K. Purcell. 1999. Public participation and the environment: Do we know what works? Environmental Science and Technology 33 (16): 2685-92.
13. Coglianese, C. 1997. Assessing consensus: The promise and performance of negotiated rule-making. Duke Law Journal 46 (6): 1255-1349.
14. Cole, R. L., and D. A. Caputo. 1983. The public hearing as an effective citizen participation mechanism: A case study of the General Revenue Sharing Program. American Political Science Review 78 (2): 404-16.
15. Crosby, N., J. M. Kelly, and P. Schaefer. 1986. Citizens panels: A new approach to citizen participation. Public Administration Review 46:170-78.
16. Desvousges, W. H., and V. K. Smith. 1988. Focus groups and risk communication: The "science" of listening to data. Risk Analysis 8 (4): 479-84.
17. Dryzek, J. S. 1997. The politics of the earth: Environmental discourses. Oxford: Oxford University Press.
18. Einsiedel, E. F., E. Jelsoe, and T. Breck. 2001. Publics at the technology table: The consensus conference in Denmark, Canada, and Australia. Public Understanding of Science 10 (1): 83-98.
19. Elder, P.S. 1982. Project approval, environmental assessment and public participation. The Environmentalist 2(1): 55-71.
20. Elmes, D. G., B. H. Kantowitz, and H. L. Roediger III. 1985. Research methods in psychology. 2nd ed. St. Paul, MN: West.
21. Esogbue, A. O., and Z. M. Ahipo. 1982. A fuzzy sets model for measuring the effectiveness of public participation in water resources planning. Water Resources Bulletin 18 (3): 451-56.
22. Fiorino, D. J. 1990. Citizen participation and environmental risk: A survey of institutional mechanisms. Science, Technology, & Human Values 15 (2): 226-43.
23. Fitzpatrick, R., and D. White. 1997. Public participation in the evaluation of health care. Health and Social Care in the Community 5(1): 3-8.
24. Frewer, L. J., and Salter, B. Forthcoming. Public attitudes, scientific advice and the politics of regulatory policy: The case of BSE. Science and Public Policy.
25. Gariepy, M. 1991. Toward a dual-influence system: Assessing the effects of public participation in environmental impact assessment for hydro-Quebec projects. Environmental Impact Assessment Review 11:353-74.
26. Godschalk, D. R., and B. Stiftel. 1981. Making waves: Public participation in state water planning. Journal of Applied Behavioral Science 17 (4): 597-614.
27. Gundry, K. G., and T. A. Heberlein. 1984. Do public meetings represent the public? American Planning Association Journal 50 (Spring): 175-82.
28. Guston, D. H. 1999. Evaluating the first US consensus conference: The impact of the citizens' panel on telecommunications and the future of democracy. Science, Technology, & Human Values 24 (4):451-82.
29. Halvorsen, K. E. 2001. Assessing public participation techniques for comfort, convenience, satisfaction and deliberation. Environmental Management 28 (2): 179-86.
30. Hannah, S. B., and H. S. Lewis. 1982. Internal citizen control of locally initiated citizen advisory committees: A case study. Journal of Voluntary Action Research 11 (4): 39-52.
31. Heberlein, T. A. 1976. Some observations on alternative mechanisms for public involvement: The hearing, public opinion poll, the workshop and the quasi-experiment. Natural Resources Journal 16 (1): 197-212.
32. Horlick-Jones, T., J. Rosenhead, I. Georgiou, J. Ravetz, and R. Lofstedt. 2001. Decision support for organisational risk management by problem structuring. Health, Risk & Society 3 (2): 141-65.
33. Houghton, D. G. 1988. Citizen advisory boards: Autonomy and effectiveness. American Review of Public Administration 18 (3): 283-96.
34. Joss, S. 1995. Evaluating consensus conferences: Necessity or luxury? In Public participation in science: The role of consensus conferences in Europe, edited by S. Joss and J. Durant, 89-108. London: The Science Museum.
35. _. 1998. Danish consensus conferences as a model of participatory technology assessment: An impact study of consensus conferences on Danish Parliament and Danish public debate. Science and Public Policy 25 (1): 2-22.
36. Kathlene, L., and J. A. Martin. 1991. Enhancing citizen participation: Panel designs, perspectives, and planning. Journal of Policy Analysis and Management 10: 46-63.
37. Kidder, L., and C. M. Judd. 1986. Research methods in social relations. 5th ed. New York: Holt, Rinehart and Winston.
38. Laird, F. N. 1993. Participatory analysis, democracy, and technological decision making. Science, Technology, & Human Values 18 (3): 341-61.
39. Lauber, T. B., and B. A. Knuth. 1999. Measuring fairness in citizen participation: A case study of moose management. Society and Natural Resources 11 (1): 19-37.
40. Leach, S., and M. Wingfield. 1999. Public participation and the democratic renewal agenda: Prioritisation or marginalisation? Local Government Studies 25:46-59.
41. Lenaghan, J., W. New, and E. Mitchell. 1996. Setting priorities: Is there arole for citizens' juries? British Medical Journal 312:1591-93.
42. Lynn, F. M. 1987. Citizen involvement in hazardous waste sites: Two North Carolina success stories. Environmental Impact Assessment Review 7:347-61.
43. Lynn, F. M., and G. J. Busenberg. 1995. Citizen advisory committees and environmental-policy: What we know, what's left to discover. Risk Analysis 15 (2): 147-62.
44. MacNair, R. H., R. Caldwell, and L. Pollane. 1983. Citizen participants in public bureaucracies: Foul-weather friends. Administration & Society 14 (4): 507-23.
45. Maloff, B., D. Bilan, and W. Thurston. 2000. Enhancing public input into decision making: Development of the Calgary Regional Health Authority public participation framework. Family and Community Health 23 (1): 66-78.
46. Martin, S., and A. Boaz. 2000. Public participation and citizen-centred local government: Lessons from the best value and better government for older people pilot programmes. Public Money and Management 20 (2): 47-53.
47. Mayer, I., J. de Vries, and J. Geurts, 1995. An evaluation of the effects of participation in a consensus conference. In Public participation in science: The role of consensus conferences in Europe, edited by S. Joss and J. Durant, 109-24. London: The Science Museum.
48. Mazmanian, D. A. 1976. Participatory democracy in a federal agency. In Water politics and public involvement, edited by J. C. Pierce and H. R. Doerksen, 201-23. Ann Arbor, MI: Ann Arbor Science.
49. McIver, S. 1998. Healthy debate? An independent evaluation of citizens' juries in health settings. London: King's Fund.
50. Milbraith, L. W. 1981. Citizen surveys as citizen participation mechanisms. Journal of Applied Behavioral Science 17 (4): 478-96.
51. Moore, S. A. 1996. Defining "successful" environmental dispute resolution: Case studies from public land planning in the United States and Australia. Environmental Impact Assessment Review 16:151-69.
52. Nelkin, D., and M. Pollak. 1979. Public participation in technological decisions: Reality or grand illusion? Technology Review 81:55-64.
53. Oppenheim, A.N. 1992. Questionnaire design, interviewing and attitude measurement. London: Pinter.
54. Quellet, F., D. Durand, and G. Forget. 1994. Preliminary-results of an evaluation of 3 healthy cities initiatives in the Montreal area. Health Promotion International 9 (3): 153-59.
55. Owens, S. 2000. Engaging the public: Information and deliberation in environmental policy. Environment and Planning A 32:1141-48.
56. Petts, J. 1995. Waste management strategy development: A case study of community involvement and consensus-building in Hampshire. Journal of Environmental Planning and Management 38 (4): 519-36.
57. Pierce, J. C., and H. R. Doerksen. 1976. Citizen advisory committees: The impact of recruitment on representation and responsiveness. In Water politics and public involvement, edited by J. C. Pierce and H. R. Doerksen, 249-66. Ann Arbor, MI: Ann Arbor Science.
58. Plumlee, J. P., J. D. Starling, and K. W. Kramer. 1985. Citizen participation in water quality planning. Administration and Society 16 (4): 455-73.
59. Poisner, J. 1996. A civic republican perspective on the National Environmental Policy Act's process for citizen participation. Environmental Law 26:53-94.
60. Reich, R. B. 1985. Public administration and public deliberation: An interpretive essay. Yale Law Journal 94 (7): 1617-41.
61. Renn, O., T. Webler, and p. Wiedemann. 1995. Fairness and competence in citizen participation: Evaluating models for environmental discourse, Dordrecht, the Netherlands: Kluwer Academic.
62. Renn, O., T. Webler, H. Rakel, P. Dienel, and B. Johnson. 1993. Public participation in decision making: A three-step procedure. Policy Sciences 26 (3): 189-214.
63. Roberts, T., S. Bryan, C. Heginbotham, and A. McCallum. 1999. Public involvement in health care priority setting: An economic perspective. Health Expectations 2:235-44.
64. Rosener, J. 1975. A cafeteria of techniques and critiques. Public Management 57 (December): 16-19.
65. _. 1978. Citizen participation: Can we measure its effectiveness? Public Administration Review 38 (September/October): 457-63.
66. _. 1981. User-oriented evaluation: A new way to view citizen participation. Journal of Applied Behavioral Science 17 (4): 583-96.
67. _. 1982. Making bureaucrats responsive: A study of the impact of citizen participation and staff recommendations on regulatory decision making. Public Administration Review 42 (July): 339-45.
68. Rossi, P. H., H. E. Freeman, and M. W. Lipsey. 1999. Evaluation: A systematic approach. 6th ed. London: Sage.
69. Rowe, G., and L. J. Frewer. 2000. Public participation methods: A framework for evaluation. Science, Technology, & Human Values 25 (1): 3-29.
70. Rowe, G., R. Marsh, and L. J. Frewer. Evaluation of a deliberative conference using validated criteria. 2004. Science, Technology, & Human Values 29(1): 88-121.
71. Sewell, W. R. D., and S. D. Phillips. 1979. Models for the evaluation of public participation programmes. Natural Resources Journal 19:337-58.
72. Shindler, B., and J. Neburka. 1997. Public participation in forest planning: 8 attributes of success. Journal of Forestry 95:17-19.
73. Sinclair, M. 1977. The public hearing as a participatory device: Evaluation of the IJC experience. In Public participation in planning, edited by W. R. D. Sewell and J. T. Coppock, 105-22. New York: John Wiley.
74. Stewart, T. R., R. L. Dennis, and D. W. Ely. 1984. Citizen participation and judgment in policy analysis: A case study of urban air quality policy. Policy Sciences 17:67-87.
75. Susskind, L., and C. Ozawa. 1983. Mediated negotiation in the public sector. American Behavioral Scientist 27:255-79.
76. Syme, G. J., and B. S. Sadler. 1994. Evaluation of public involvement in water resources planning: A researcher-practitioner dialogue. Evaluation Review 18 (5): 523-42.
77. Tuler, S., and T. Webler. 1999. Voices from the forest: What participants expect of a public participation process. Society and Natural Resources 12 (5): 437-53.
78. Twight, B. W., and M. S. Carroll. 1983. Workshops in public involvement: Do they help find common ground? Journal of Forestry 81 (November): 732-35.
79. Webler, T. 1999. The craft and theory of public participation: A dialectical process. Journal of Risk Research 2 (1): 55-71.
80. Wiedemann, P. M., and S. Femers. 1993. Public-participation in waste management decision-making - Analysis and management of conflicts. Journal of Hazardous Materials 33 (3): 355-68.
81. Yin, R. K. 1994. Case study research: Design and methods. 2nd ed. London: Sage.