Advancing environmental education program evaluation: Insights from a review of behavioral outcome evaluations

International Handbook of Research on Environmental Education

Volumn , Issue , 2013, Pages 298-309

  Zint, Michaela ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85073841235     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (94)

1. Ajzen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckmann (Eds.), Action control: From cognition to behavior (pp. 11-39). New York, NY: Springer-Verlag.
2. Ajzen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice-Hall.
3. Asch, J., & Shore, B. (1975). Conservation behavior as the outcome of environmental education. Journal of Environmental Education, 6(4), 25-33.
4. Bamberg, S., & Möser, G. (2007). Twenty years after Hines, Hungerford, and Tomera: A new meta-analysis of psycho-social determinants of pro-environmental behaviour. Journal of Environmental Psychology, 27(1), 14-25.
5. Bickman, L., & Rog, D. J. (1998). Handbook of applied social research methods. Thousand Oaks, CA: Sage Publications.
6. Birnbaum, M. (2010). Interview with Brett Jenks, President and CEO of Rare. Journal of Evaluation and Program Planning, 33(2), 191-193.
7. Birnbaum, M., & Mickwitz, P. (2009). Environmental program and policy evaluation: Addressing methodological challenges. New Directions for Evaluation, 122, 105-112.
8. Bogner, F. X. (1999). Empirical evaluation of an educational conservation programme introduced in Swiss secondary schools. International Journal of Science Education, 21(11), 1169-1185.
9. Camargo, C., & Shavelson, R. (2009). Direct measures in environmental education evaluation: Behavioral intentions versus observable actions. Applied Environmental Education and Communication, 8(3-4), 165-173.
10. Carleton-Hug, A., & Hug, J. W. (2010). Challenges and opportunities for evaluating environmental education programs. Journal of Evaluation and Program Planning, 33(2), 159-164.
11. Chelimsky, E. (1997). The coming transformation in evaluation. In E. Chelimsky & W. Shadish (Eds.), Evaluation for the twenty-first century (pp. 1-26). Thousand Oaks, CA: Sage.
12. Chen, H. T. (1990). Theory-driven evaluations. Newbury Park, CA: Sage.
13. Christensen, L., Nielsen, J. E., Rogers, C. M., & Volkov, B. (2005). Creative data collection in nonformal settings. New Directions for Evaluation, 108, 73-79.
14. Clavijo, K., Fleming, M. L., Hoermann, E. F., Toal, S. A., & Johnson, K. (2005). Evaluation use in nonformal education settings. New Directions for Evaluation, 108, 47-55.
15. Coffman, J. (2002). A conversation with Michael Quinn Patton. Cambridge, MA: Harvard Family Research Project.
16. Cohen, L., & Manion, L. (1986). Research methods in education. London, UK: Croom Helm.
17. Conley-Tyler, M. (2005). A fundamental choice: Internal or external evaluation? Evaluation Journal of Australasia, 4(1-2), 3-11.
18. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design analysis issues for field settings. Chicago, IL: Rand McNally.
19. Corral-Verdugo, V. (1997). Dual ‘realities’ of conservation behavior: Self-reports vs. observations of re-use and recycling behavior. Journal of Environmental Psychology, 17(2), 135-145.
20. Covitt, B. A., Gomez-Schmidt, C., & Zint, M. T. (2005). An evaluation of the risk education module: Exploring environmental issues: Focus on risk. Journal of Environmental Education, 36(2), 3-13.
21. Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Los Angeles, CA: Sage.
22. Denzin, N. (1978). Sociological methods: A sourcebook (2nd ed.). New York, NY: McGraw Hill.
23. Dillon, J., & Wals, A. E. J. (2006). On the danger of blurring methods, methodologies, and ideologies in environmental education research. Environmental Education Research, 12(3-4), 549-558.
24. Duffin, M., Murphy, M., & Johnson, B. (2008). Quantifying a relationship between place-based learning and environmental quality: Final report. Woodstock, VT: NPS Conservation Study Institute in cooperation with the Environmental Protection Agency and Shelburne Farms.
25. Duvall, J., & Zint, M. (2007). A review of research on the effectiveness of environmental education in promoting intergenerational learning. Journal of Environmental Education, 38(4), 14-24.
26. Ebbutt, D. (1998). Evaluation of projects in the developing world: Some cultural and methodological issues. International Journal of Educational Development, 18(5), 415-424.
27. Engels, C. A., & Jacobson, S. K. (2007). Evaluating long-term effects of the Golden Lion Tamarin environmental education program in Brazil. Journal of Environmental Education, 38(3), 3-14.
28. Ernst, J. (2005). A formative evaluation of the prairie science class. Journal of Interpretation Research, 10(1), 9-30.
29. Fedler, A. J. (2005). An evaluation of youth participant outcomes from fully-implemented hooked on fishing not on drugs programs. Gainesville, FL: Human Dimensions Consulting.
30. Fien, J., Scott, W., & Tilbury, D. (2001). Education and conservation: Lessons from an evaluation. Environmental Education Research, 7(4), 379-395.
31. Fishbein, M., & Pequegnat, W. (2000). Evaluating AIDS prevention interventions using behavioral and biological outcome measures. Sexually Transmitted Diseases, 27(2), 101-110.
32. Fleming, L., & Easton, J. (2010). Building environmental educators’ evaluation capacity through distance education. Journal of Evaluation and Program Planning, 33(2), 172-177.
33. Flowers, A. B. (2010). Blazing an evaluation pathway: Lessons learned from applying utilization-focused evaluation to a conservation education program. Journal of Evaluation and Program Planning, 33(2), 165-171.
34. Fournier, D. M. (2005). Evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 139-140). Thousand Oaks, CA: Sage.
35. Frechtling, J. (2007). Logic modeling methods in program evaluation. San Francisco, CA: Jossey-Bass.
36. Gayford, C. (2004). A model for planning and evaluation of aspects of education for sustainability for students training to teach science in primary schools. Environmental Education Research, 10(2), 255-271.
37. Goldman, D., Yavetz, B., & Pe’er, S. (2006). Environmental literacy in teacher training in Israel: Environmental behavior of new students. The Journal of Environmental Education, 38(1), 3-20.
38. Hart, P., & Nolan, K. (1999). A critical analysis of research in environmental education. Studies in Science Education, 34(1), 1-69.
39. Heimlich, J. E. (2010). Environmental education evaluation: Reinterpreting education as a strategy for meeting mission. Journal of Evaluation and Program Planning, 33(2), 180-185.
40. Heimlich, J. E., & Ardoin, N. M. (2008). Understanding behavior to understand behavior change: A literature review. Environmental Education Research, 14(3), 215-237.
41. Hines, J. M., Hungerford, H. R., & Tomera, A. N. (1987). Analysis and synthesis of research on responsible environmental behavior: A meta-analysis. The Journal of Environmental Education, 18, 1-8. (Original work published 1986)
42. Hungerford, H. R., & Volk, T. L. (1990). Changing learner behavior through environmental education. Journal of Environmental Education, 21(3), 8-21.
43. Irvine, K., Saunders, C., & Foster, J. S. (1995). Using evaluation to guide the development of behavior change programs. Visitor Studies: Theory, Research, and Practice, 8(2), 47-56.
44. Jacobson, S. K., & McDuff, M. D. (1997). Success factors and evaluation in conservation education programmes. International Research in Geographical and Environmental Education, 6(3), 204-221.
45. Janke, D. (1982). The use and interpretation of visual evidence in evaluating environmental education programs. Journal of Environmental Education, 13(4), 41-43.
46. Jenks, B., Vaughan, P. W., & Butler, P. J. (2010). The evolution of Rare Pride: Using evaluation to drive adaptive management in a biodiversity conservation organization. Journal of Evaluation and Program Planning, 33(2), 186-190.
47. Johnson-Pynn, J. S., & Johnson, L. R. (2005). Successes and challenges in East African conservation education. Journal of Environmental Education, 36(2), 25-39.
48. Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards. Thousand Oaks, CA: Sage.
49. Kaplan, S. (2000). New ways to promote proenvironmental behavior: Human nature and environmentally responsible behavior. Journal of Social Issues, 56(3), 491-508.
50. Kellaghan, T., Stufflebeam, D. L., & Wingate, L. A. (2003). Introduction. In T. Kellaghan, D. L. Stufflebeam, & L. A. Wingate (Eds.), International handbook of educational evaluation (pp. 1-8). Boston, MA: Kluwer Academic Publishers.
51. King, J. A., Morris, L. L., & Fitz-Gibbon, C. T. (1987). How to assess program implementation. Newbury Park, CA: Sage.
52. Labin, S. N. (2008). Research synthesis: Toward broad-based evidence. In L. Smith & P. R. Brandon (Eds.), Fundamental issues in evaluation (pp. 89-110). New York, NY: The Guildford Press.
53. Leeming, F. C., Dwyer, W. O., Porter, B. E., & Cobern, M. K. (1993). Outcome research in environmental education: A critical review. The Journal of Environmental Education, 24(4), 8-21.
54. Loomis, R. J. (2002). Visitor studies in a political world: Challenges to evaluation research. Journal of Interpretation Research, 7(1), 31-42.
55. Lucas, A. M. (1980). Science and environmental education: Pious hopes, self praise and disciplinary chauvinism. Studies in Science Education, 7(1), 1-26.
56. Mathison, S. (2008). What is the difference between evaluation and research-and why do we care? In L. Smith & P. R. Brandon (Eds.), Fundamental issues in evaluation (pp. 183-196). New York, NY: The Guildford Press.
57. McDuff, M. (2002). Needs assessment for participatory evaluation of environmental education programs. Applied Environmental Education & Communication, 1(1), 25-36.
58. McDuff, M. D., & Jacobson, S. K. (2001). Participatory evaluation of environmental education: Stakeholder assessment of the Wildlife Clubs of Kenya. International Research in Geographical and Environmental Education, 10(2), 121-148.
59. Monroe, M. C. (2002). Evaluation’s friendly voice: The structured openended interview. Applied Environmental Education and Communication, 1(2), 101-106.
60. Monroe, M. C., Fleming, M. L., Bowman, R. A., Zimmer, J. F., Marcinkowski, T., & Washburn, J. (2005). Evaluators as educators: Articulating program theory and building evaluation capacity. New Directions for Evaluation, 108, 57-71.
61. Monroe, M. C., Scollo, G., & Bowers, A. W. (2002). Assessing teachers’ needs for environmental education services. Applied Environmental Education and Communication, 1(1), 37-43.
62. Morgan, M., & Soucy, J. (2006). Usage and evaluation of nonformal environmental education services at a state park: Are anglers catching more than fish? Environmental Education Research, 12(5), 595-608.
63. Morris, J., Jacobson, S., & Flamm, R. (2007). Lessons from an evaluation of a boater outreach program for manatee protection. Environmental Management, 40(4), 596-602.
64. Mrazek, R. (Ed.). (1993). Alternative paradigms in environmental education research. Washington, DC: North American Association for Environmental Education.
65. Negev, M., Sagy, G., Garb, Y., Salzberg, A., & Tal, A. (2008). Evaluating the environmental literacy of Israeli elementary and high school students. The Journal of Environmental Education, 39(2), 3-20.
66. Norris, K. S., & Jacobson, S. K. (1998). Content analysis of tropical conservation education programs: Elements of success. Journal of Environmental Education, 30(1), 38-44.
67. Nowak, P., Wilke, R., Marcinkowski, T., Hungerford, H., & Mckeown-Ice, R. (1995). The secondary school environmental literacy instrument. Unpublished instrument.
68. O’Hearn, G. T. (1982). What is the purpose of evaluation? Journal of Environmental Education, 13(4), 1-3.
69. Patrick, D. L., Cheadle, A., Thompson, D. C., Diehr, P., Koepsell, T., & Kinne, S. (1994). The validity of self-reported smoking: A review and meta-analysis. American Journal of Public Health, 84(7), 1086-1093.
70. Patton, M. O. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.
71. Patton, M. Q. (1997). Utilization-focused evaluation (3rd ed.). Thousand Oaks, CA: Sage.
72. Powell, R. B., Stern, M. J., & Ardoin, N. (2006). A sustainable evaluation framework and its application. Applied Environmental Education & Communication, 5(4), 231-241.
73. Powers, A. L. (2004a). An evaluation of four place-based education programs. Journal of Environmental Education, 35(4), 17-32.
74. Powers, A. L. (2004b). Evaluation of one-and two-day forestry field programs for elementary school children. Applied Environmental Education & Communication, 3(1), 39-46.
75. Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring program outcomes: Using retrospective pretest methodology. The American Journal of Evaluation, 21(3), 341-349.
76. Putney, A. D., & Wagar, J. A. (1973). Objectives and evaluation in interpretive planning. Journal of Environmental Education, 5(1), 43-44.
77. Robottom, I. (1985). Evaluation in environmental education: Time for a change in perspective? Journal of Environmental Education, 17(1), 31-36.
78. Rogers, P., Hacsi, T., Petrosino, A., & Hubner, T. (Eds.). (2000). Program theory evaluation: Challenges and opportunities. New Directions in Evaluation, 87, 1-112.
79. Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). Evaluation: A systematic approach (7th ed.). Thousand Oaks, CA: Sage.
80. Rovira, M. (2000). Evaluating environmental education programmes: Some issues and problems. Environmental Education Research, 6(2), 143-155.
81. Schneller, A. J. (2008). Environmental service learning: Outcomes of innovative pedagogy in Baja California Sur, Mexico. Environmental Education Research, 14(3), 291-307.
82. Somers, C. (2005). Evaluation of the Wonders in Nature-Wonders in Neighborhoods conservation education program: Stakeholders gone wild! New Directions for Evaluation, 108, 29-46.
83. Storksdieck, M., Ellenbogen, K., & Heimlich, J. E. (2005). Changing minds? Reassessing outcomes in free-choice environmental education. Environmental Education Research, 11(3), 353-369.
84. Stufflebeam, D. L. (2001). Evaluation models. New Directions for Evaluation, 89, 7-98.
85. Stufflebeam, D. L., Madaus, G. F., & Kellaghan, T. (2000). Evaluation models: Viewpoints on educational and human services evaluation. Boston, MA: Kluwer Academic Publishers.
86. Thomas, I. G. (1990). Evaluating environmental education programs using case studies. Journal of Environmental Education, 21(2), 3-8.
87. Trewhella, W. J., Rodriguez-Clark, K. M., Corp, N., Entwistle, A., Garrett, S. R. T., Granek, E.,... Sewall, B. J. (2005). Environmental education as a component of multidisciplinary conservation programs: Lessons from conservation initiatives for critically endangered fruit bats in the western Indian Ocean. Conservation Biology, 19(1), 75-85.
88. Van Petegem, P., Blieck, A., & Pauw, J. B. (2007). Evaluating the implementation process of environmental education in preservice teacher education: Two case studies. The Journal of Environmental Education, 38(2), 47-54.
89. Wilke, R., Hungerford, H., Volk, T., & Bluhm, W. (1995). Middle school environmental literacy instrument. Unpublished instrument.
90. Wiltz, L. K. (2001). Proceedings of the Teton Summit for program evaluation in nonformal environmental education. Kelly, Wyoming, May 19-22, 2000. (p. 47). Retrieved from ERIC database. ED453066.
91. Zint, M. (2002). Comparing three attitude-behavior theories for predicting science teachers’ intentions. Journal of Research in Science Teaching, 39(9), 819-844.
92. Zint, M. (2010). An introduction to my environmental education evaluation resource assistant (MEERA), a web-based resource for self-directed learning about environmental education program evaluation. Journal of Evaluation and Program Planning, 33(2), 178-179.
93. Zint, M., Dowd, P., & Covitt, B. (2011). Enhancing environmental educators’ evaluation competencies: Insights from an examination of the effectiveness of the My Environmental Education Evaluation Resource Assistant (MEERA) web site. Environmental Education Research, 17(4), 471-497.
94. Zint, M., Kraemer, A., Northway, H., & Lim, M. (2002). Evaluation of the Chesapeake Bay Foundation’s conservation education programs. Conservation Biology, 16(3), 641-649.