Audit and evaluation in public management: Challenges, reforms, and different roles

Canadian Journal of Program Evaluation

Volumn 21, Issue 1, 2006, Pages 11-45

  Mayne, John ^a  

^a NONE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34250162898     PISSN: 08341516     EISSN: 00077720     Source Type: Journal    
DOI: None     Document Type: Article

References (67)

1. Altschuld, J. (2005). Certification, credentialing, licensure, competencies, and the like: Issues confronting the field of evaluation. Canadian Journal of Program Evaluation, 20(2), 157-168.
2. Auditor General of Canada. (1999). Involving others in governance: Accountability at risk. In Report of the Auditor General of Canada to the House of Commons. Ottawa: Author.
3. Auditor General of Canada. (2002). Modernizing accountability in the public sector. In Report of the Auditor General of Canada to the House of Commons. Ottawa: Author.
4. Barrett, P. (2001). Evaluation and performance auditing: Shared ground. Canberra: Australasian Evaluation Society International Conference.
5. Barzelay, M. (1997). Central audit institutions and performance auditing: A comparative analysis of organizational strategies in the OECD. Governance: An International Journal of Policy and Administration, 10(3), 235-260.
6. Bemelmans-Videc, M.-L. (2003). Audit and evaluation in the collaborative state: The role of supreme audit institutions. In A. Gray, B. Jenkins, F. Leeuw, & J. Mayne (Eds.), Collaborating in Public services: The challenge for evaluation (pp. 179-206). New Brunswick, NJ: Transaction.
7. Bourne, J. (1992). Evaluating the performance of central governments. In C. Pollitt & S. Harrison (Eds.), Handbook of public services management (pp. 25-46). Oxford: Blackwell Business.
8. Canadian Evaluation Society. (2005). CES guidelines for ethical conduct. Retrieved April 24, 2005, from 〈http://www.evaluationcanada. ca/site.cgi?s=5&ss=4&_lang=an〉.
9. Chelimsky, E. (1997). The coming transformations in evaluation. In E. Chelimsky & W. Shadish (Eds.), Evaluation for the 21st century: A handbook (pp. 1-26). Thousand Oaks, CA: Sage.
10. Divorski, S. (1996). Differences in the approaches of auditors and evaluators to the examination of government policies and programs. In C. Wisler (Ed.), Evaluation and auditing: Prospects for convergence (New Directions for Evaluation, No. 71) (pp. 7-14). San Francisco: Jossey-Bass.
11. Feinstein, O.N. (2002). Use of evaluations and the evaluation of their use. Evaluation, 8(4), 433-439.
12. Fetterman, D., Kaftarian, S., & Wandersman, A. (1995). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.
13. Furubo, J.-E., Rist, R., & Sandahl, R. (Eds.). (2002). International atlas of evaluation. New Brunswick, NJ: Transaction.
14. Ginsburg, A., & Rhett, N. (2003). Building a better body of evidence: New opportunities to strengthen evaluation utilization. American Journal of Evaluation, 24(4), 489-498.
15. Gray, A., Jenkins, W., Leeuw, F., & Mayne, J. (Eds.). (2003). Collaboration in public services: The challenges for evaluation. New Brunswick, NJ: Transaction.
16. Gray, A., Jenkins, B., & Segsworth, R. (Eds.). (1993). Budgeting, auditing, and evaluation: Functions and integration in seven governments. New Brunswick, NJ: Transaction.
17. Guba, E., & Lincoln, Y. (1989). Fourth generation evaluation. Thousand Oaks, CA: Sage.
18. Gunvaldsen, J.A., & Karlsen, R. (1999). The auditor as an evaluator: How to remain an influential force in the political landscape. Evaluation, 5(4), 458-467.
19. Hepworth, N.P. (1995). The role of performance audit. Public Money and Management, October-December, 39-42.
20. Hudson, J., & Mayne, J. (1992). Program evaluation: An overview. In J. Hudson, J. Mayne, & R. Thomlinson (Eds.), Action-oriented evaluation in organizations: Canadian practices. Toronto: Wall and Emerson.
21. Institute of Internal Auditors. (2004). The International Standards for the Professional Practice of Internal Auditing (Standards). Retrieved April 24, 2005, from 〈http://www.theiia.org/index.cfm?doc_id=124〉.
22. Institute of Internal Auditors. (2005). Certification. Retrieved April 24, 2005, from 〈http://www.theiia.org/?doc_id=3〉.
23. INTOSAI (International Organization of Supreme Audit Institutions). (2001). Code of ethics and auditing standards. Auditing Standards Committee. Retrieved April 24, 2005, from 〈http://www.intosai.org/Level3/ Guidelines/3_AudStandComm/3_CodEth_AudStand2001_E.pdf〉.
24. Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs (2nd ed.). Thousand Oaks, CA: Sage.
25. Keen, J. (1999). On the nature of audit judgements: The case of value for money studies. Public Administration, 77(3), 509-526.
26. Leeuw, F. (1992). Performance auditing and policy evaluation: Discussing similarities and dis-similarities. Canadian Journal of Program Evaluation, 7(1), 53-68.
27. Leeuw, F. (1996). Auditing and evaluation: Bridging a gap, worlds to meet? New Directions for Evaluation, 71 (Fall), 51-60.
28. Levin-Rozalis, M., & Rosenstein, B. (2005). The changing role of the evaluator in the process of organizational learning. Canadian Journal of Program Evaluation, 20(1), 81-104.
29. Ling, T. (2003). Ex ante evaluation and the changing public audit function: The scenario planning approach. Evaluation, 9(4), 437-452.
30. Long, B., & Kishchuk, N. (1997). Professional certification: A report to the National Council of the Canadian Evaluation Society on the experiences of other organizations. Retrieved April 24, 2005, from 〈http://www. evaluationcanada.ca/txt/longkishchukreport.pdf〉.
31. Lonsdale, J. (2001). Auditing in a changing world: Developments in the work of the National Audit Office 1997-2001. Paper presented at a conference on Advances in the Public Management of Information and Control: Auditing, Evaluation and Inspection in the EU Member States and the European Union, European Institute of Public Administration, Maastricht.
32. Lonsdale, J., & Mayne, J. (2005). Neat and tidy ... and 100% correct: Assuring the quality of SAI performance audit work. In R. Schwartz & J. Mayne (Eds.), Quality matters: Seeking confidence in evaluation, auditing and performance reporting (pp. 173-196). New Brunswick, NJ: Transaction.
33. Lovell, A. (1996). Notions of accountability and state audit: A UK perspective. Financial Accountability & Management, 12(4), 261-280.
34. Lusthaus, C., Adrien, M.-H., Anderson, G., Carden, F., & Montalvan, G.P. (2002). Organizational assessment: A framework for improving performance. Ottawa: Inter-american Development Bank and International Development Research Centre.
35. Mackay, R., Horton, D., et al. (2002). Evaluating organizational capacity development. Canadian Journal of Program Evaluation, 17(2), 121-150.
36. Mayne, J. (2001). Addressing attribution through contribution analysis: Using performance measures sensibly. Canadian Journal of Program Evaluation, 6(1), 1-24.
37. Mayne, J. (2003). Results-based governance: Collaborating for outcomes. In A. Gray, B. Jenkins, F. Leeuw, & J. Mayne (Eds.), Collaborating in public services: The challenge for evaluation (pp. 155-178). New Brunswick, NJ: Transaction.
38. Mayne, J. (2005). Ensuring quality for evaluation: Lessons from auditors. Canadian Journal of Program Evaluation, 20(1), 37-64.
39. Mayne, J. (in press). Evaluation for accountability: Reality or myth? In M.-L. Bemelmans, J. Lonsdale, & B. Perrin (Eds.), Accountability and the role of evaluation. New Brunswick, NJ: Transaction.
40. Mayne, J., Divorski, S., & Lemaire, D. (1999). Locating evaluation: Anchoring evaluation in the executive or the legislature, or both or elsewhere? In R. Boyle & D. Lemaire, Building an effective evaluation capacity: Lessons from practice (pp. 23-52). New Brunswick, NJ: Transaction.
41. Mayne, J., & Zapico-Goni, E. (Eds.). (1997). Monitoring performance in the public sector: Future directions from international experience. New Brunswick, NJ: Transaction.
42. Morgan, S., & Raaum, R. (2001). Performance auditing: A measurement approach. Altamonte Springs, FL: Institute of Internal Auditors.
43. National Audit Office. (2000). Modernising government: How the NAO are responding - A progress report. London, UK: National Audit Office.
44. OECD. (1997). In search of results: Performance management practices. Paris: Author.
45. OECD. (2001). Evaluation feedback for effective learning and accountability. DAC Working Group. Paris: Author.
46. Pollitt, C. (1999). Overview. In C. Pollitt, X. Girre, J. Lonsdale, et al. (Eds.), Performance or compliance? Performance audit and public management in five countries (pp. 194-219). New York: Oxford University Press.
47. Pollitt, C., & Bouckaert, G. (2000). Public management reform: A comparative analysis. New York: Oxford University Press.
48. Pollitt, C., & Summa, H. (1996). Performance audit and evaluation: Similar tools, different relationships? In C. Wisler (Ed.), Evaluation and auditing: Prospects for convergence (New Directions for Evaluation, No. 71) (pp. 29-50). San Francisco: Jossey-Bass.
49. Power, M. (1994). The audit explosion. London: White Dove.
50. Power, M. (1997). The audit society: Rituals of verification. Oxford: Oxford University Press.
51. President of the Treasury Board. (2005). Management in the government of Canada: A commitment to continuous improvement, Ottawa. Retrieved April 24, 2005, from 〈http://www.tbs-sct.gc.ca/spsm-rgsp/cci-acg/cci-acg_e. asp〉.
52. Public Audit Forum. (1998). The principles of public audit. Retrieved April 24, 2005, from 〈http://www.public-audit-forum.gov.uk/popa. htm〉.
53. Rist, R. (1989). Management accountability: The signals sent by auditing and evaluation. Journal of Public Policy, 9(3), 355-369.
54. Rist, R. (Ed.). (1990). Program evaluation and the management of government. New Brunswick, NJ: Transaction.
55. Rist, R., & Stame, N. (Eds.), (in press). From studies to streams: Managing evaluative systems. New Brunswick, NJ: Transaction.
56. Roberts, S., & Pollitt, C. (1994). Audit or evaluation? A National Audit Office VFM study. Public Administration, 72(Winter), 527-549.
57. Schwartz, R. (1999). Coping with the effectiveness dilemma: Strategies adopted by state auditors. International Review of Administrative Sciences, 65(4), 511-526.
58. Schwartz, R., & Mayne, J. (2005a). Assuring the quality of evaluation: Theory and practice. Evaluation and Program Planning, 28(1), 1-14.
59. Schwartz, R., & Mayne, J. (2005b). Does quality matter? Who cares about the quality of evaluative information. In R. Schwartz & J. Mayne (Eds.), Quality matters: Seeking confidence in evaluation, auditing and performance reporting (pp. 301-322). New Brunswick, NJ: Transaction.
60. Shand, D., & Anand, P. (1996). Performance auditing in the public sector: Approaches and issues in OECD member countries. In Performance auditing and the modernization of government. Paris: OECD.
61. Smith, M.F. (1999). Should AEA begin a process for restricting membership in the profession of evaluation. American Journal of Evaluation, 20(3), 521-531.
62. State Government of Victoria. (2005). Environmental auditing in Victoria. Retrieved April 24, 2005, from 〈http://www.epa.vic.gov.au/ EnvAudit/〉.
63. Stierhoff, K.A. (1999). The certification of program evaluators: A pilot survey of clients and employers. A report presented to the Canadian Evaluation Society. Retrieved April 24, 2005, from 〈http://www.evaluationcanada.ca/ txt/certification_survey_sep99.pdf〉.
64. Sutherland, S. (2002). The Office of the Auditor General of Canada: Government in exile? Working paper 31, School of Policy Studies. Kingston, ON: Queen's University.
65. Vedung, E. (1997). Public policy and program evaluation. New Brunswick, NJ: Transaction.
66. Wisler, C. (Ed.). (1996). Evaluation and auditing: Prospects for convergence (New Directions for Evaluation, No. 71). San Francisco: Jossey-Bass.
67. World Bank. (1994), Building evaluation capacity, lessons and practices. OED, No. 4. Washington: Author.