Enhancing environmental educators' evaluation competencies: Insights from an examination of the effectiveness of the my environmental education evaluation resource assistant (MEERA) website

Environmental Education Research

Volumn 17, Issue 4, 2011, Pages 471-497

  Zint, Michaela T ^a   Dowd, Patrick F ^a   Covittd, Beth A ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF MONTANA   (United States)

Author keywords

Adult education; Beliefs; Capacity building; Environmental education; Evaluation

Indexed keywords

EID: 79960567555     PISSN: 13504622     EISSN: 14695871     Source Type: Journal    
DOI: 10.1080/13504622.2011.565117     Document Type: Article

References (58)

1. Arnold, M.E. 2006. Developing evaluation capacity in extension 4-H field faculty. American Journal of Evaluation 27, no. 2: 257-69.
2. Bennett, D.B. 1984. Evaluating environmental education in schools. Paris: Division of Science, Technical and Environmental Education, UNESCO-UNEP International Environmental Education Programme.
3. Bennett, C., and K. Rockwell. 1995. Targeting outcomes of programs (TOP): An integrated approach to planning and evaluation. Unpublished manuscript. Lincoln, NE: University of Nebraska.
4. Birnbaum, M. 2010. Interview with Brett Jenks, president and CEO of Rare. Journal of Evaluation and Program Planning 33, no. 2: 191-3.
5. Brandon, P.R., and R.A.F. Higa. 2004. An empirical study of building the evaluation capacity of K-12 site-managed project personnel. Canadian Journal of Program Evaluation 19, no. 1: 125-42.
6. st century, ed. E. Chelimsky and W.R. Shadish, 1-26. Thousand Oaks, CA: Sage.
7. Clavijo, K., M.L. Fleming, E.F Hoermann, S.A. Toal, and K. Johnson. 2005. Evaluation use in nonformal education settings. New Directions for Evaluation 108: 47-55.
8. Compton, D.W., R. Glover-Kudon, I.E. Smith, and M.E. Avery. 2002. Ongoing capacity building in the American Cancer Society (ACS) 1995-2002. New Directions for Evaluation 93: 47-61.
9. Cousins, J.B., and L.M. Earl, eds. 1995. Participatory evaluation in education: Studies in evaluation use and organizational learning. Washington, DC: Falmer Press.
10. Cousins, J.B., S.C. Goh, S. Clark, and L.E. Lee. 2004. Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base. Canadian Journal of Program Evaluation 19, no. 2: 99-141.
11. Creswell, J.W. 2009. Research design: Qualitative, quantitative, and mixed methods approaches. 3rd ed. Los Angeles: Sage.
12. Department of Environment and Conservation. 2004. Does your project make a difference? A guide to evaluating environmental education projects and programs. Sydney: Department of Environment and Conservation.
13. Dillard, J. 2006. The evaluation and revision of an online course entitled 'Applied environmental education program evaluation,' Master's thesis, University of Wisconsin-Stevens Point.
14. Ernst, J., M. Monroe, and B. Simmons. 2009. Evaluating your environmental education program: A workbook for practitioners. Washington, DC: North American Association for Environmental Education.
15. Fetterman, D.M., S.J. Kaftarian, and A. Wandersman, eds. 1996. Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.
16. Fleming, L. 2009. Environmental education: Professional development needs and priorities study. Stevens Point, WI: Environmental Education Training Partnership, University of Wisconsin-Stevens Point.
17. Fleming, L., and J. Easton. 2010. Building environmental educators' evaluation capacity through distance education. Evaluation and Program Planning 33, no. 2: 172-7.
18. Fournier, D.M. 2005. Evaluation. In Encyclopedia of evaluation, ed. S. Mathison, 139-40. Thousand Oaks, CA: Sage.
19. Ghere, G., J.A. King, L. Stevhan, and J. Minnema. 2006. A professional development unit for reflecting on program evaluator competencies. American Journal of Evaluation 27, no. 1: 108-23.
20. Hill, L.G., and D.L. Betz. 2005. Revisiting the retrospective pretest. American Journal of Evaluation 26, no. 4: 501-17.
21. Jacobson, S.K., and M.D. McDuff. 1997. Success factors and evaluation in conservation education programmes. International Research in Geographical and Environmental Education 6, no. 3: 204-21.
22. Jenks, B., P.W. Vaughan, and P. Butler. 2010. The evolution of Rare Pride: Using evaluation to drive adaptive management in a biodiversity conservation organization. Journal of Evaluation and Program Planning 33, no. 2: 186-90.
23. Joint Committee on Standards for Educational Evaluation. 1994. The program evaluation standards. Thousand Oaks, CA: Sage.
24. Kiernan, N.E., and T.R. Alter. 2004. Can a website be used as a vehicle for organizational learning about evaluation? Journal of Higher Education Outreach and Engagement 10, no. 1: 121-34.
25. King, J.A., L.L. Morris, and C.T. Fitz-Gibbon. 1987. How to assess program implementation. Newbury Park, CA: Sage.
26. Kreis, R. 2007. The impact of an online course on environmental education program evaluation. Master's thesis, University of Wisconsin-Stevens Point.
27. Labin, S.N. 2008. Research synthesis: Toward broad-based evidence. In Fundamental issues in evaluation, ed. L. Smith and P.R. Brandon, 89-110. New York: The Guildford Press.
28. Lam, T.C.M., and P. Bengo. 2003. A comparison of three retrospective self-reporting methods of measuring change in instructional practice. American Journal of Evaluation 24, no. 1: 65-80.
29. Mackay, R., D. Horton, L. Dupleich, and A. Andersen. 2002. Evaluating organizational capacity development. Canadian Journal of Program Evaluation 17, no. 2: 121-50.
30. Mandler, G. 1975. Memory storage and retrieval: Some limits on the research of attention and consciousness. In Attention and performance, ed. P.M. Rabbitt and S. Dornic, 499-516. London: Academic Publishers.
31. Mathison, S. 2008. What is the difference between evaluation and research, and why do we care? In Fundamental issues in evaluation, ed. L. Smith and P.R. Brandon, 183-96. New York: Guildford Press.
32. McDuff, M. 2001. Building the capacity of grassroots conservation organizations to conduct participatory evaluation. Environmental Management 27, no. 5: 715-27.
33. McDuff, M. 2002. Needs assessment for participatory evaluation of environmental education programs. Applied Environmental Education & Communication 1, no. 1: 25-36.
34. Miron, G. 2004. Evaluation report checklist. Kalamazoo, MI: Evaluation Center, Western Michigan University.
35. Monroe, M.C., M.L. Fleming, R.A. Bowman, J.F. Zimmer, T. Marcinkowski, J. Washburn, and N.J. Mitchell. 2005. Evaluators as educators: Articulating program theory and building evaluation capacity. New Directions for Evaluation 105: 57-71.
36. Norris, K.S., and S.K. Jacobson. 1998. Content analysis of tropical conservation education programs: Elements of success. Journal of Environmental Education 30, no. 1: 38-44.
37. Patton, M.Q. 1997. Toward distinguishing empowerment evaluation and placing it in a larger context. American Journal of Evaluation 18, no. 1: 147-63.
38. Patton, M.Q. 2008. Utilization-focused evaluation. 4th ed. Los Angeles: Sage.
39. Powell, R.B., M.J. Stern, and N. Ardoin. 2006. A sustainable evaluation framework and its application. Applied Environmental 5, no. 4: 231-41.
40. Pratt, C.C., W.M. McGuigan, and A.R. Katzev. 2000. Measuring program outcomes: Using retrospective methodology. American Journal of Evaluation 21, no. 3: 341-9.
41. Preskill, H., and S. Boyle. 2008. A multidisciplinary model of evaluation capacity building. American Journal of Evaluation 29, no. 4: 443-59.
42. Recreational Boating and Fishing Foundation. 2006. Best practices guide to program evaluation for aquatic educators. Alexandria, VA: Recreational Boating and Fishing Foundation.
43. Robottom, I. 1985. Evaluation in environmental education: Time for a change in perspective? Journal of Environmental Education 17, no. 1: 31-6.
44. th ed. Thousand Oaks, CA: Sage.
45. Russ-Eft, D., M.J. Bober, I. De La Teja, M. Foxon, and T.A. Koszalka. 2008. Evaluator competencies: Standards for the practice of evaluation in organizations. San Francisco, CA: Jossey-Bass.
46. Simmons, B. 2004. Designing evaluation for education projects. Washington, DC: Office of Education and Sustainable Development, National Oceanic and Atmospheric Administration.
47. Smith, N. 1982. Communication strategies in evaluation. Thousand Oaks, CA: Sage.
48. Somers, C. 2005. Evaluation of the wonders in nature-wonders in neighborhoods conservation education program: Stakeholders gone wild! New Directions for Evaluation 108: 29-46.
49. Stevahn, L., J. King, G. Ghere, and J. Minnema. 2005. Establishing essential competencies for program evaluators. American Journal of Evaluation 26, no. 1: 43-59.
50. Stokking, K., L. Van Aaert, W. Meijberg, and A. Kaskens. 1999. Evaluating environmental education. Gland: International Union for Conservation of Nature.
51. Stufflebeam, D.L., G.F. Madaus, and T. Kellaghan. 2000. Evaluation models: Viewpoints on educational and human services evaluation. Boston, MA: Kluwer.
52. Torres, R., H. Preskill, and M.E. Piontek. 2005. Evaluation strategies for communicating and reporting: Enhancing learning in organizations. 2nd ed. Thousand Oaks, CA: Sage.
53. Towne, L., and R.J. Shavelson. 2002. Scientific research in education. Washington, DC: National Academies Press.
54. Trevisan, M.S. 2002. Evaluation capacity in K-12 counseling programs. American Journal of Evaluation 23, no. 3: 291-305.
55. Yin, R. 2009. Case study research. 4th ed. Thousand Oaks, CA: Sage.
56. Zint, M. 2010. An Introduction to My Environmental Education Evaluation Resource Assistant (MEERA), a web-based resource for self-directed learning about environmental education program evaluation. Evaluation and Program Planning 33, no. 2: 178-179.
57. Zint, M. Forthcoming. Advancing environmental education program evaluation: Insights from a review of behavioral outcome evaluations. In International handbook of research in environmental education, ed. M. Brody, J. Dillon, B. Stevenson, and A. Wals. Washington, DC: American Education Research Association.
58. Zint, M., B. Covitt, and P.F. Dowd. Forthcoming. Insights from an evaluability assessment of the U.S. Forest Service More Kids in the Woods initiative. Journal of Environmental Education.