Results Management: Can Results Evidence Gain a Foothold in the Public Sector?

The Evidence Book: Concepts, Generating, and Use of Evidence Comparative Policy Evaluatioon, Volume 15

Volumn 15, Issue , 2017, Pages 117-150

  Mayne, John ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85144427849     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781351298049-15     Document Type: Chapter

References (86)

1. Auditor General of Canada (1997). Moving towards managing for results. Report of the Auditor General of Canada to the House of Commons, October. Ottawa. http://www.oag-bvg.gc.ca/domino/reports.nsf/html/ch9711e.html (Retrieved September 3, 2007)
2. Auditor General of Canada (2000a). Managing Departments for Results and Managing for Horizontal Issues for Results. Report of the Auditor General of Canada to the House of Commons, October. Ottawa. http://www.oag-bvg.gc.ca/domino/reports.nsf/html/0020ce.html/$file/0020ce.pdf (Retrieved September 3, 2007)
3. Auditor General of Canada (2000b). Reporting performance to parliament: Progress too slow. Report of the Auditor General of Canada to the House of Commons, December. Ottawa. http://www.oag-bvg.gc.ca/domino/reports.nsf/html/0019ce.html/$file/0019ce.pdf (Retrieved September 3, 2007)
4. Auditor General of Canada (2002). Modernizing accountability in the public sector. Report of the Auditor General of Canada to the House of Commons, Chapter 9. Ottawa. http://www.oag-bvg.gc.ca/domino/reports.nsf/html/20021209ce.html/$file/20021209ce.pdf (Retrieved September 3, 2007)
5. Australian National Audit Office (2007). Application of the outcomes and iutputs framework. Canberra. Audit Report No.23 2006-07. http://www.anao.gov.au/uploads/documents/2006-07_Audit_Report_23.pdf (Retrieved September 3, 2007)
6. Baehler, K. (2003). "‘Managing for outcomes’: Accountability and thrust.” Australian Journal of Public Administration 62, 4: 23-34.
7. Barrados, M. and J. Mayne (2003). “Can public sector organizations learn?" OECD Journal on Budgeting 3, 3: 87-103.
8. Binnendijk, A. (2001). Results-based management in the development cooperation agencies: A review of experience. Background Report, DAC OECD Working Party on Aid Evalua tion. Paris. http://www.oecd.org/dataoecd/17/1/1886527.pdf (Retrieved 3 September 2007).
9. Boston, J., J. Martin, J. Pallot and P. Walsh (eds.) (1991). Reshaping the state: New Zealand’s bureaucratic revolution. Auckland: Oxford University Press.
10. Botcheva, L., C.R. White and L.C. Huffman (2002). “Learning culture and outcomes Measurement practices in community agencies.” American Journal of Evaluation 23, 4: 421-434.
11. Britton, B. (2005). Organisational learning in NGOs: Creating the motive, means and opportunity, Praxis Report No. 3: The International NGO training and Research Centre. Available at http://www.intrac.org/pages/PraxisPaper3.html (accessed 20 Feb 2008).
12. Caracelli, V. J. and H. Preskill (eds.) (2000). The expanding scope of evaluation use. New Directions for Evaluation, No. 88. San Francisco: Jossey-Bass.
13. Chalmers, I. (2005). “If evidence-informed policy works in practice, does it matter if it doesn’t work in theory?" Evidence and Policy: A Journal of Research, Debate and Practice, 1, 2: 227-242.
14. Cousins, B., S. Goh, S. Clark and L. Lee (2004). “Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base.” Canadian Journal of Program Evaluation, 19, 2: 99-141.
15. Curristine, T. (2005). “Government performance: Lessons and challenges.” OECD Journal on Budgeting 5, 1: 127-151.
16. David, T. (2002). Becoming a learning organization: Marguerite Casey Foundation. http://www.tdavid.net/pdf/becoming_learning.pdf (Retrieved 3 September 2007)
17. Davies, H.T.O., S.M. Nutley and P.C. Smith (1999). “Editorial: What works? The role of evidence in public sector policy and practice.” Public Money and Management 19, 1: 3-5.
18. Diamond, J. (2005). Establishing a performance management framework for government. IMF Working Paper, International Monetary Fund. http://www.imf.org/external/pubs/ft/wp/2005/wp0550.pdf (Retrieved September 3, 2007)
19. Feinstein, O.N. (2002). “Use of evaluations and the evaluation of their use.” Evaluation 8, 4: 433-439.
20. Furubo, J.-E. (2006). “Why evaluations sometimes can’t be used-and why they shouldn’t. In R.C. Rist and N. Stame (eds.), From studies to streams: Managing evaluative streams, New Brunswick, NJ, Transaction Publishers: 147-166.
21. Goh, S. (2001). “The learning organization: An empirical test of a normative perspective.” International Journal of Organizational Theory and Behaviour, 4(3and4): 329-355.
22. Goldsworthy, D. (1991). Setting up next steps. London: HMSO.
23. Government Accounting Office (2002). Results-oriented cultures: Insights for U.S. agencies from other countries’ performance management initiatives. Washington: U.S.
24. General Accounting Office. http://www.gao.gov/new.items/d02862.pdf (Retrieved September 3, 2007)
25. Government Accounting Office (2003). An evaluation culture and collaborative partnerships Help Build Agency Capacity. Program Evaluation. Washington, DC. http://www.gao.gov/new.items/d03454.pdf (Retrieved 3 September 2007)
26. Hernandez, G. and M. Visher (2001). Creating a culture of inquiry: Changing methods-and minds-on the use of evaluation in nonprofit organizations. The James Irving Foundation.
27. Johnson, C. and C. Talbot (2007). The UK parliament and performance. International Review of Administrative Sciences, 73(1):113-131.
28. Joyce, P.G. (2005). “Linking performance and budgeting: Opportunities in the federal budget process.” In. J.M. Kamensky and A. Morales (eds.), Managing for Results 2005, Oxford: Rowman and Littlefield.
29. Kamensky, J.M. and A. Morales (eds.) (2005). Managing for results 2005. The IBM Center for The Business of Government. Oxford: Rowman and Littlefield.
30. Kim, P.S. (2002). Cultural change in government: Promoting a high-performance culture A Review of ten years of modernisation: The HRM Perspective. Paris: OECD http://www.olis.oecd.org/olis/2002doc.nsf/LinkTo/PUMA-HRM(2002)11
31. Kogan, M. (1999). “The impact of research on policy.” In F. Coffield (ed.), Research and policy in lifelong learning, Bristol: Policy Press.
32. Launsø, L., J. Rieper and O. Reiper (2007). “Evaluative feedback as a contribution to learning between groups of professionals.” Evaluation 13, 1: 306-322.
33. Learmont, M. and N. Harding (2006). “Evidence-based management: The very idea.” Public Administration 8, 2: 245-266.
34. Leeuw, F. (2006). “Managing evaluations in the Netherlands and types of knowledge.” In R.C. Rist and N. Stame (eds.), From studies to streams: Managing rvaluative systems, New Brunswick, NJ, Transaction Publishers: 81-96.
35. Leeuw, F.L., R.C. Rist and R.C. Sonnichsen (eds.) (1994). Can governments learn? Comparative Perspectives on Evaluation and Organizational Learning, New Brunswick, NJ: Transaction.
36. Leeuw, F., L.M. v. d. Knaap and S. Bogaerts (2007). “Reducing the knowledge-practice gap: An example of an evaluation synthesis in criminal policy.” Public Money and Management 27, 4: 245-250.
37. Leviton, L.C. (2003). “Evaluation use: Advances, challenges and applications.” American Journal of Evaluation 24, 4: 525-535.
38. Leviton, L.C. and E.F.X. Hughes (1981). “Research on the utilization of evaluation: A review and synthesis.” Evaluation Review 5, 4: 525-548.
39. Lindquist, E. (2001). Discerning policy influence: Framework for a strategic evaluation of IDRC-supported research. University of Victoria. http://www.idrc.ca/uploads/user-S/10359907080discerning_policy.pdf (Retrieved September 3, 2007)
40. Mackay, K. (2006). Institutionalization of monitoring and evaluation systems to improve public sector management EDC Working Paper Series- No. 15. Washington, DC: Independent Evaluation Group, World Bank. http://www.worldbank.org/ieg/ecd/ (Retrieved September 3, 2007)
41. Mark, M. and G. Henry (2004). “The mechanisms and outcomes of evaluation influence.” Evaluation 10, 1: 35-57.
42. Marra, M. (2004). “The contribution of evaluation to socialization and externalization of tacit knowledge: The case of the World Bank.” Evaluation 10, 3: 263-283.
43. Mayne, J. (2001). “Addressing attribution through contribution analysis: Using performance measures sensibly.” Canadian Journal of Program Evaluation 16, 1: 1-24.
44. Mayne, J. (2007a). “Evaluation for accountability: Reality or myth?" In M.-L. Bemelmans-Videc, J. Lonsdale and B. Perrin (eds.), Making accountability work: Dilemmas for evaluation and for audit. New Brunswick, NJ, Transaction Publishers.
45. Mayne, J. (2007b). “Challenges and lessons in implementing results-based management.” Evaluation 13, 1: 89-107.
46. Mayne, J. (2007c). Best practices in results-based management: A review of experience-A report for the United Nations Secretariat. New York: UN Secretariat.
47. Mayne, J. and E. Zapico-Goni (eds.) (1997). Monitoring performance in the public sector: Future directions from international experience. New Brunswick, NJ: Transaction Publishers.
48. Mayne, J. and R. Rist (2006). “Studies are not enough: The necessary transformation of evaluation.” Canadian Journal of Program Evaluation.
49. Michael, D. (1993). “Governing by learning: boundaries, myths and metaphors.” Futures January/February: 81-89.
50. Moynihan, D.P. (2005). “Goal-based learning and the future of performance management.” Public Administration Review 65, 2: 203-216.
51. Moynihan, D.P. (2006). “Managing for results in state government: Evaluating a decade of reform.” Public Administration Review 66, 1:77-89.
52. Norman, R. (2002). “Managing through measurement or meaning? Lessons from experience with New Zealand’s public sector performance management systems.” International Review of Administrative Sciences, 68:619-628.
53. Nutley, S., I. Walter and H.T.O. Davies. (2003). “From knowing to doing: A framework for understanding the evidence-into-practice agenda.” Evaluation 9, 2: 125-148.
54. Nutley, S.M., I. Walter and H.T.O. Davies (2007). Using evidence: How research can inform public services. Bristol: The Policy Press.
55. OECD (2005). Modernizing government: The way forward. Paris, OECD.
56. OECD-DAC (2006). Managing for development results, Principles in action: Sourcebook on emerging good practices (Final-March 2006). Paris: OECD-Development Assistance Committee. http://www.mfdr.org/Sourcebook/1stSourcebook.html (Retrieved September 3, 2007)
57. Osborne, D. (2001). Paying for results. Government Executive, February: 61-67.
58. Pal, L. A. and T. Teplova (2003). Rubik’s cube? Aligning organizational culture, performance measurement, and horizontal management. Ottawa: Carleton University. http://www.ppx.ca/Research/PPX-Research%20-%20Pal-Teplova%2005-15-03[1].pdf (Retrieved September 3, 2007)
59. Pawson, R. (2002a). “Evidence-based policy: In search of a method.” Evaluation 8, 2: 157-181.
60. Pawson, R. (2002b). “Evidence-based Policy: The promise of ‘Realist Synthesis’.” Evaluation 8, 3: 340-358.
61. Perrin, B. (1998). “Effective use and misuse of performance measurement.” American Journal of Evaluation 19, 3: 367-379.
62. Perrin, B. (2002). Implementing the vision: Addressing challenges to results-focussed management and budgeting. Paris: OECD.
63. Perrin, B. (2006). Moving from outputs to outcomes: Practical advice from governments around the world. IBM Centre for The Business of Government and the World Bank. Washington, DC.
64. Pollitt, C. (2006). “Performance information for democracy: The missing link?" Evaluation, 12, 1: 38-55.
65. Pollitt, C. and G. Bouckaert (2000). Public management reform: A comparative analysis. New York, Oxford University Press.
66. Ramage, P. and A. Armstrong (2005). “Measuring success: Factors impacting on the implementation and use of performance measurement within Victoria’s human services agencies.” Evaluation Journal of Australasia, 5(new series), 2: 5-17.
67. Rist, R. and N. Stame (eds.) (2006). From studies to streams: Managing evaluative systems: Transaction Publishers.
68. Sanderson, I. (2002). “Evaluation, policy learning and evidence-based policy making.” Public Administration 80, 1: 1-22.
69. Sanderson, I. (2004). “Getting evidence into practice: Perspectives on rationality.” Evaluation 10, 3: 366-379.
70. Schwartz, R. and J. Mayne (2005). Does quality matter? Who cares about the quality of evaluative information? In Quality matters: Seeking confidence in evaluation, auditing and performance reporting. R. Schwartz and J. Mayne, Eds. New Brunswick, Transaction Publishers.
71. Smith, P. (1995). “On the unintended consequences of publishing performance data in the public sector.” International Journal of Public Administration 18, 2and3: 277-310.
72. Smutylo, T. (2005). Building an rvaluative culture. International Program for Development Evaluation Training. World Bank and Carleton University. Ottawa.
73. Sridharan, S. (2003). “Introduction to special section on ‘What is a useful evaluation?'" American Journal of Evaluation 24, 4: 483-487.
74. Swiss, J. (2005). “A framework for assessing incentives in results-based management.” Public Administration Review 65, 5: 592-602.
75. ter Bogt, H. (2004). “Politicians in search of performance information? Survey research on Dutch aldermen’s use of performance information.” Financial Accountability and Management 20, 3: 221-252.
76. The Council for Excellence in Government (2008). Coalition for evidence-based policy. Washington, DC. Available at http://www.excelgov.org/admin/FormManager/filesuploading/Coalition_purpose_agenda_3_06.pdf.
77. Thomas, G. (2004): “Introduction: evidence and practice.” In G. Thomas and R. Pring (eds.), Evidence-based practice in education, New York: Open University Press.
78. Torres, R.T., H.S. Preskill and M.E. Piontek (2005). Evaluation strategies for communicating and reporting: Enhancing learning in organizations. Thousand Islands: Sage.
79. Valovirta, V. (2002). “Evaluation utilization as argumentation.” Evaluation, 8, 1: 60-80.
80. van der Knaap, P. (1995). “Policy evaluation and learning: feedback, enlightenment or argumentation?" Evaluation 1, 2: 189-216.
81. Vedung, E. (1997). Public policy and program evaluation. New Brunswick: Transaction Publishers.
82. Walter, I., S. Nutley and H. Davies (2005). “What works to promote evidence-based practice? A cross-sector review.” Evidence and Policy: A Journal of Research, Debate and Practice 1, 3: 335-364.
83. Weiss, C.H. (1998). “Have we learned anything new about the use of evaluation?" American Journal of Evaluation 19, 1: 21-33.
84. Wholey, J.S. (1983). Evaluation and effective public management. Boston: Little, Brown and Co.
85. Williams, D. (2003). “Measuring government in the early twentieth century.” Public Administration Review 63, 6: 643-659.
86. World Bank-OED (2005). 2004 Annual Report on Operations Evaluation. Washington, DC: World Bank-Operations Evaluation Department. http://www.worldbank.org/oed/popular_corporate.html (Retrieved 3 September 2007)