Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full?

American Journal of Evaluation

Volumn 31, Issue 1, 2010, Pages 84-104

  Carman, Joanne G ^a   Fredericks, Kimberly A ^b  

^a UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^b Russell Sage College   (United States)

Author keywords

Evaluation capacity; Evaluation practice; Implementation; Nonprofit organizations

Indexed keywords

EID: 77949323446     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214009352361     Document Type: Article

References (54)

1. Alaimo, S.P. (2008). Nonprofits and evaluation: Managing expectations from the leader's perspective. In J. Carman & K. Fredericks (Eds.), Nonprofits and evaluation. New directions for program evaluation (Vol. 119, pp. 73-92). San Francisco, CA: Jossey-Bass.
2. Arnold, M.E. (2006). Developing evaluation capacity in extension 4-H field faculty: A framework for success. American Journal of Evaluation, 27, 257-269.
3. Axelrod, N.R. (2005). Board leadership and development. In R. Herman & Associates (Eds.), The Jossey-Bass handbook of nonprofit leadership and management (2nd ed., pp. 131-152). San Francisco: Jossey-Bass.
4. Backer, E. (1995). Computer-assisted reasoning in cluster analysis. Englewood Cliffs, NJ: Prentice Hall.
5. Baizerman, M., Compton, D.W., & Stockdill, S.H. (2002). New directions for ECB. In D. W. Compton, M. Baizerman & S. H. Stockdill, (Eds.). The art, craft, and science of evaluation capacity building. Vol. 93: New Directions for Evaluation (pp. 109-120). San Francisco: Jossey Bass.
6. Beam, D.R. & Conlan, T.J. (2002). Grants. In L. M. Salamon (Ed.) The tools of government: A guide to the new governance (pp. 340-380). New York: Oxford University Press.
7. Beckstead, J.W. (2002). Using hierarchical cluster analysis in nursing research. Western Journal of Nursing, 24, 307-319.
8. Behrens, T.R., & Kelly, T. (2008). Paying the piper: Foundation evaluation capacity calls the tune. In J. G. Carman & K. A. Fredericks (Eds.), Nonprofits and evaluation. Vol. 119: New Directions for Evaluation (pp. 3750). San Francisco: Jossey Bass.
9. Bessant, J., Kaplinsky, R., & Morris, M. (2003). Developing capability through learning networks. International Journal of Technology Management and Sustainable Development, 2, 19-38.
10. Carman, J.G. (2005). Program evaluation use and practice in nonprofit organizations: A theory-based study of nonprofit organizations in New York State. A doctoral dissertation. Albany, NY: Department of Public Administration, SUNY Albany.
11. Carman, J.G. (2007). Evaluation practice among community-based organizations: Research into the reality. American Journal of Evaluation, 28, 60-75.
12. Carman, J.G. (2008). Nonprofits, funders, and evaluation: Accountability in action. American Review of Public Administration. DOI: 10.1177/0275074008320190.
13. Carman, J.G., & Millesen, J.L. (2005). Nonprofit program evaluation: Organizational challenges and resource needs. Journal of Volunteer Administration, 23, 36-43.
14. Caudle, S.L. (2004). Qualitative data analysis. In J. Wholey, H. Hatry, & K. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 417-438). San Francisco: Jossey-Bass.
15. Connolly, P., & York, P. (2002). Evaluating capacity-building efforts for nonprofit organizations. OD Practitioner, 34, 33-39.
16. Connolly, P., & York, P. (2003). Building the capacity of capacity builders: A study of management support and field-building organizations in the nonprofit sector. Retrieved December 26, 2008, from http://www.tccgrp.com/pdfs/buildingthecapacityofcapacitybuilders.pdf.
17. Cook, J.B. (1988). Managing nonprofits of different sizes. In M. O'Neill & D. Young (Eds.), Educating managers of nonprofit organizations (pp. 101-116). Westport, CT: Praeger.
18. Dillman, D.A. (1978). Mail and telephone surveys: The total design method. New York: John Wiley & Sons.
19. Dillman, D.A. (2000). Mail and telephone surveys: The total design method (2nd ed.). New York: John Wiley & Sons.
20. DiMaggio, P.J. (1988). Nonprofit managers in different fields of service: Managerial tasks and management training. In M. O'Neill & D. Young (Eds.), Educating managers of nonprofit organizations (pp. 51-69). Westport, CT: Praeger.
21. Dixon, N.M., & Shofer, M. (2006). Struggling to invent high-reliability organizations in health care settings: Insights from the field. Health Services Research, 41, 1618-1632.
22. Faulconbridge, J.R. (2007). London's and New York's advertising and law clusters and their networks of learning: Relational analyses with a politics of scale? Urban Studies, 44, 1635-1656.
23. Fine, A.H., Thayer, C.E., & Coghlan, A. (1998). Program evaluation practice in the nonprofit sector. Washington, DC: Innovation Network, Inc.
24. Fowler, F.J. Jr. (1988). Survey research methods. (rev. ed.). Applied Social Research Methods Series, Volume 1. Newbury Park, CA: Sage.
25. Fredericksen, P., & London, R. (2000). Disconnect in the hollow stage: The pivotal role of organizational capacity in community-based development organizations. Public Administration Review, 60, 230-239.
26. Gronbjerg, K.A. (1993). Understanding nonprofit funding. San Francisco: Jossey-Bass.
27. Hendricks, M., Plantz, M.C., & Pritchard, K.J. (2008). Measuring outcomes of United Way-funded programs: Expectations and reality. In J. G. Carman & K. A. Fredericks (Eds.), Nonprofits and evaluation. Vol. 119: New Directions for Evaluation (pp. 13-35). San Francisco: Jossey Bass.
28. Hoefer, R. (2000). Accountability in action? Program evaluation in nonprofit human service agencies. Nonprofit Management and Leadership, 11, 167-177.
29. Hoole, E., & Patterson, T.E. (2008). Voices from the field: Evaluation as part of a learning culture. In J. G. Carman & K. A. Fredericks (Eds.), Nonprofits and evaluation. Vol. 119: New Directions for Evaluation (pp. 93-113). San Francisco: Jossey Bass.
30. Hudson, M. (2005). Managing at the leading edge. San Francisco: Jossey-Bass.
31. Huffman, D., & Thomas, K. (2008). A collaborative immersion approach to evaluation capacity building. American Journal of Evaluation, 29, 358-638.
32. Joffres, C., Heath, S., Farquharson, J., Barkhouse, K., Latter, C., & MacLean, D.R. (2004). Facilitators and challenges to organizational capacity building in heart health promotion. Qualitative Health Research, 14, 39-60.
33. Kopczynski, M.E., & Pritchard, K. (2004). The use of evaluation by nonprofit organizations. In J. Wholey, H. Hatry, & K. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 649-669). San Francisco: Jossey-Bass.
34. LeRoux, K., & Wright, N. (2008). Does performance measurement improve organizational decision-making? Findings from a national survey of nonprofit social service agencies. Paper presented for symposium "Accountability and performance in the hollow state: A reflective dialogue on the evolving role of nonprofits in public service delivery," sponsored by ASPA/ARNOVA, Cleveland State University, Cleveland, Ohio, October 23-24, 2008.
35. Light, P.C. (2004). Sustaining nonprofit performance: The case for capacity building and the evidence to support it. Washington, DC: Brookings Institution.
36. Light, P.C., & Hubbard, E.T. (2004). The capacity building challenge: A research perspective. In P. Patrizi, K. Sherwood, & A. Spector (Eds.), Practice matters: The improving philanthropy project series 7. New York: The Foundation Center.
37. Murphy, D.M., & Mitchell, R. (2007). Building evaluation capacity in North Carolina's nonprofit sector: A survey report. Raleigh, NC: Institute for Nonprofits.
38. Naccarella, L., Pirkisa, J., Kohna, J., Morleya, B., Burgessb, P., & Blashkia, G. (2007). Building evaluation capacity: Definitional and practical implications from an Australian case study. Evaluation and Program Planning, 30, 231-236.
39. Newcomer, K. (2004). How might we strengthen evaluation capacity to manage evaluation contracts? American Journal of Evaluation, 25, 209-218.
40. Newcomer, K.E., & Triplett, T. (2004). Using surveys. In J. Wholey, H. Hatry, & K. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 257-291). San Francisco: Jossey-Bass.
41. Nightingale, D.S., & Rossman, S.B. (2004). Collecting data in the field. In J. Wholey, H. Hatry, & K. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 363-411). San Francisco: Jossey-Bass.
42. Peck, L.R. (2005). Using cluster analysis in program evaluation. Evaluation Review, 29, 178-196.
43. Preskill, H., & Boyle, S. (2008). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation. DOI: 10.1177/1098214008324182.
44. Quinn, L.S., Verclas, K., & Hoehling, A. (2006). Nonprofit IT staffing: Spending, salaries, and an infrastructure for success, results from the 2006 NTEN Nonprofit IT Staffing Survey. Retrieved October 31, 2008, from http://www.nten.org/sites/nten/files/NTEN_ITstaffing_survey.pdf.
45. Salamon, L.M. (2002). The resilient sector: The state of nonprofit America. In L. M. Salamon (Ed.). The state of nonprofit America. (pp. 3-61). Washington D.C.: Brookings Institution Press.
46. Schuh, R.G., & Leviton, L.C. (2006). A framework to assess the development and capacity of non-profit agencies. Evaluation and Program Planning, 29, 171-179.
47. Silverman, D. (1993). Interpreting qualitative data: Methods of analyzing talk, text and interaction. Thousand Oaks, CA: Sage.
48. Simon, J.S. (2001). The 5 stages of nonprofit organizations. St. Paul, MN: Amherst H. Wilder Foundation.
49. Smith, S.R. (2005). Managing the challenge of government contracts. In R. Herman Associates (Eds.), The Jossey-Bass handbook of nonprofit leadership and management (2nd ed., pp. 131-152). San Francisco: Jossey-Bass.
50. Snibbe, A.C. (2006). Drowning in data. Stanford Social Innovation Review. Retrieved October 30, 2007, from http://www.ssireview.org/images/articles/2006FA_feature_snibbe.pdf.
51. Stevenson, J.F., Florin, P., Mill, D.S., & Andrade, M. (2002). Building evaluation capacity in human service organisations: A case study. Evaluation and Program Planning, 25, 233-243.
52. Weiner, S.J., Kirsch, A.D., & McCormack, M.T. (2002). Balancing the scales: Measuring the roles and contributions of nonprofit organizations and religious congregations. Washington, DC: Independent Sector.
53. Vinzant, D.H., & Vinzant, J.C. (1996). Strategy and organizational capacity: Finding a fit. Public Productivity and Management Review, 20, 139-157.
54. Volkov, B., & King, J. (2005). A checklist for building organizational evaluation capacity. Retrieved October 27, 2008, from http://www.wmich.edu/evalctr/checklists/ecb.pdf.