Evaluating evaluation: Implications or assessing quality

International Journal of Health Care Quality Assurance

Volumn 14, Issue 7, 2001, Pages 317-327

  McCoy, Mairead ^a   Hargie, Owen D W ^a  

^a UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

Evaluation; Literature

Indexed keywords

COST BENEFIT ANALYSIS; HEALTH CARE QUALITY; HUMAN; ORGANIZATION; REVIEW; SYSTEM ANALYSIS; TOTAL QUALITY MANAGEMENT; UNITED STATES;

COST-BENEFIT ANALYSIS; EVALUATION STUDIES; HUMAN; ORGANIZATIONAL OBJECTIVES; PROGRAM EVALUATION; SYSTEMS THEORY; TOTAL QUALITY MANAGEMENT; UNITED STATES;

EID: 0035233682     PISSN: 09526862     EISSN: None     Source Type: Journal    
DOI: 10.1108/09526860110409081     Document Type: Article

References (68)

1. Berk, R.A. and Rossi, P.H. (1990), Thinking About Program Evaluation, Sage, Newbury Park, CA.
2. Blalock, A.B. (1999), "Evaluation research and the performance management movement: from estrangement to useful integration?", Evaluation, Vol. 5 No. 2, pp. 117-49.
3. Blythe, J. and Rayner, T. (1996), "The evaluation of non-selling activities at British trade exhibitions - an exploratory study", Marketing Intelligence & Planning, Vol. 14 No. 5, pp. 20-4.
4. Boudreau, J.W. (1990), "Cost-benefit analysis applied to personnel human resource management decisions: answers to common questions and a case study application", Asia Pacific Human Resource Management, November, pp. 70-9.
5. Brewer, M. (1983), "Evaluation: past and present", in Struening, E.L. and Brewer, M.B. (Eds), The UniversityEdition of the Handbook of Evaluation Research, 2nd ed., Sage, Beverly Hills, CA, pp. 15-27.
6. Campbell, D.T. (1969), "Reforms as experiments", American Psychologist, Vol. 24, pp. 409-29.
7. Cheetam, J., Soydan, H., Mullan, E.J. and Tengvald, K. (1998), "The development of social work discourse", Evaluation, Vol. 4 No. 1, pp. 9-24.
8. Chelimsky, E. (1995), "Where we stand today in the practice of evaluation: some reflections", Knowledge and Policy, Vol. 8 No. 3, pp. 8-19.
9. Chen, H. (1990), "Issues in constructing program theory", in Bickman, L. (Ed.), Advances in Program Theory: New Directions for Evaluation, Vol. 47, Jossey-Bass, San Francisco, CA, pp. 7-18.
10. Colyer, H. and Kamath, P. (1999), "Evidence-based practice. A philosophical and political analysis: some matters for consideration by professional practitioners", Journal of Advanced Nursing, Vol. 29 No. 1, pp. 188-93.
11. Cook, J.R. and Panza, C.M. (1987), "ROI. What should training take credit for?", Training, January, pp. 59-68.
12. Cronbach, L.J., Ambron, S.R., Dornbusch, S.M., Hess, R.D., Hornik, R.C., Phillips, D.C., Walker, D.F. and Weiner, S.S. (1980), Toward Reform of Program Evaluation, Jossey-Bass, San Francisco, CA.
13. Dabinett, G. and Richardson, T. (1999), "The European spatial approach: the role of power and knowledge in strategic planning and policy evaluation", Evaluation, Vol. 5 No. 2, pp. 220-36.
14. Davis, H.R. and Salasin, S.E. (1983), "The utilisation of evaluation", in Struening, E.L. and Brewer, M.B. (Eds), The University Edition of the Handbook of Evaluation Research, 2nd ed., Sage, Beverly Hills, CA, pp. 381-427.
15. Davis, I.C. (1999), "Evaluation and performance management in government", Evaluation, Vol. 5 No. 2, pp. 150-9.
16. Doctors, S.I. and Wokutch, R.E. (1980), "Social program evaluation: six models", Values, Ethics and Standards in Evaluation: New Directions for Program Evaluation, Jossey- Bass, San Francisco, CA, Vol. 7, pp. 27-38.
17. Drewett, A. (1997), "Evaluation and consultation: learning the lessons of user involvement", Evaluation, Vol. 3 No. 2, pp. 189-204.
18. Forss, K. and Carlsson, J. (1997), "The quest for quality - or can evaluation findings be trusted?", Evaluation, Vol. 3 No. 4, pp. 481-501.
19. Georghiou, L. (1998), "Evaluation of innovation and technology policy", Evaluation, Vol. 4 No. 1, pp. 37-51.
20. Gordon, J. (1991), "Measuring the 'goodness' of training", Training, August, pp. 19-25.
21. Grandori, A. (1987), Perspectives on Organisational Theory, Ballinger, Cambridge, MA.
22. Greene, J.C. (1999), "The inequality of performance measurements", Evaluation, Vol. 5 No. 2, pp. 160-72.
23. Guba, E.G. and Lincoln, Y.S. (1989), Fourth Generation Evaluation, Sage, Newbury Park, CA.
24. Guba, E.G. and Stufflebeam, D.L. (1968), Evaluation: The Process of Stimulating, Aiding and Abetting Insightful Action, address delivered at 2nd National Symposium for Professors of Educational Research, November 21, Evaluation Centre, College of Education, Ohio State University, Columbus, OH.
25. Hargie, O. and Tourish, D. (2000), Handbook of Communication Audits for Organisations, Routledge, London.
26. Hargie, O., Morrow, N. and Woodman, C. (2000), "Pharmacists' evaluation of key communication skills in practice", Patient Education and Counselling, Vol. 39, pp. 61-70.
27. House, E.R. (2000), "The limits of cost benefit evaluation", Evaluation, Vol. 6 No. 1, pp. 79-86.
28. House, E.R., Haug, C. and Norris, N. (1996), "Producing evaluations in a large bureaucracy", Evaluation, Vol. 2 No. 2, pp. 135-50.
29. Huebner, A.J. and Betts, S.C. (1999), "Examining fourth generation evaluation: application to positive youth development", Evaluation, Vol. 5 No. 3, pp. 340-58.
30. Hyman, H.H. and Wright, C. (1967), "Evaluating social action programs", in Lazarsfield, P.F., Sewell, W.H. and Wilensky, H.L. (Eds), The Uses of Sociology, Basic Books Inc., New York, NY.
31. Knapp, M. (1995), "How shall we study comprehensive collaborative services for children and families?", Educational Researcher, Vol. 24 No. 4, pp. 5-16.
32. Laughlin, R. and Broadbent, J. (1996), "Redesigning fourth generation evaluation: an evaluation model for the public sector reforms in the UK?", Evaluation, Vol. 2 No. 4, pp. 431-52.
33. Levin, H.M. (1983), "Cost-effectiveness analysis in evaluation research", in Struening, E.L. and Brewer, M.B. (Eds), The UniversityEdition of the Handbook of Evaluation Research, 2nd ed., Sage, Beverly Hills, CA, pp. 345-79.
34. Locke, E.A. and Latham, G.P. (1990), A Theoryof Goal Setting and Task Performance, Prentice- Hall, Englewood Cliffs, NJ.
35. March, J.G. (1972), "Model bias in social action", Review of Educational Research, Vol. 42, pp. 413-29.
36. Marra, M. (2000), "How much does evaluation matter? Some examples of the utilization of the evaluation of the world bank's anti- corruption activities", Evaluation, Vol. 6 No. 1, pp. 22-36.
37. Martin, S. and Sanderson, I. (1999), "Evaluating public policy experiments: measuring outcomes, monitoring processes or managing pilots?", Evaluation, Vol. 5 No. 3, pp. 245-58.
38. Mintzberg, H. (1989), Mintzberg on Management: Inside Our Strange World of Organisations, Free Press, New York, NY.
39. Nay, J.N., Scanlon, J.W., Schmidt, R.E. and Wholey, J.S. (1976), "If you don't care where you get to, then it doesn't matter which way you go", in Abt, C.C. (Ed.), The Evaluation of Social Programs, Sage, Beverly Hills, CA, pp. 97-125.
40. Newcomer, K. (1997), "Using performance measurement to improve public and nonprofit programs", New Directions for Program Evaluation, Vol. 75, Jossey-Bass, San Francisco, CA.
41. Øvretveit, J. (2000), "The economics of quality - a practical approach", International Journal of Health Care QualityAssurance, Vol. 13 No. 5, pp. 200-07.
42. Parlett, M. (1977), "Critiques of traditional approaches", in Parlett, M. and Dearden, G. (Eds), Introduction to Illuminative Evaluation: Studies in Higher Education, Pacific Soundings Press, CA, pp. 1-7.
43. Parlett, M. and Hamilton, D. (1977), "Evaluation as illumination", in Parlett, M. and Dearden, G. (Eds), Introduction to Illuminative Evaluation: Studies in Higher Education, Pacific Soundings Press, CA, pp. 9-29.
44. Patton, M.Q. (1986), Utilisation-Focused Evaluation, Sage, Beverly Hills, CA.
45. Patton, M.Q. (1989), "A context and boundaries for a theory-driven approach to validity", Evaluation and Program Planning, Vol. 12, pp. 375-7.
46. Pawson, R. and Tilley, N. (1997), Realistic Evaluation, Sage, Thousand Oaks, CA.
47. Peled, E. and Spiro, S.E. (1998), "Goal focused evaluation: lessons from a study of a shelter for homeless youth", Evaluation, Vol. 4 No. 4, pp. 455-68.
48. Picciotto, R. (1999), "Towards an economics of evaluation", Evaluation, Vol. 5 No. 1, pp. 7-22.
49. Richards, M.D. (1978), Organisational Goal Structures, West Publishing, St Paul, MN.
50. Rivers, P.A. and Glover, S.H. (2000), "Quality in finance of health care: the unaddressed imperative", International Journal of Health Care QualityAssurance, Vol. 13 No. 3, pp. 134-9.
51. Robinson, J. and Lefort, W. (2000), "Costing clinical audit: preparing for clinical governance", International Journal of Health Care QualityAssurance, Vol. 13 No. 3, pp. 111-17.
52. Rogers, E.M. and Storey, J.D. (1987), "Communication campaigns", in Berger, C. and Chaffe, S. (Eds), Handbook of Communication Science, Sage, Beverly Hills, CA, pp. 817-46.
53. Rossi, P.H. and Freeman, H.E. (1989), Evaluation: A Systematic Approach, 4th ed., Sage, Newbury Park, CA.
54. Savaya, R. and Waysman, M. (1999), "Outcome evaluation of an advocacy program to promote early childhood education for Israeli Arabs", Evaluation Review, Vol. 23 No. 3, pp. 281-303.
55. Scriven, M. (1967), "The methodology of evaluation", in Perspectives on Curriculum Evaluation, AERA Monograph Series on Curriculum Evaluation, No. 1, Rand McNally, Chicago, IL.
56. Scriven, M. (1996), "The theory behind practical evaluation", Evaluation, Vol. 2 No. 4, pp. 393-404.
57. Shadish, W.R. (1987), "Program micro- and macrotheories: a guide for social change", Using Program Theoryin Evaluation: New Directions for Program Evaluation, Vol. 33, Jossey-Bass, San Francisco, CA, pp. 93-109.
58. Shadish, W.R., Cook, T. and Levinton, L.C. (1991), Foundations of Program Evaluation: Theories of Practice, Sage, Newbury Park, CA.
59. Spiro, M.H. and Sussna, E. (1980), "Barriers and values in the measurement of program benefits", Values, Ethics and Standards in Evaluation: New Directions for Program Evaluation, Vol. 7, Jossey-Bass, San Francisco, CA, pp. 39-50.
60. Stillman, F., Hartman, A., Graubard, B., Gilpin, E., Chavis, D., Garcia, J., Wun, L., Lynn, W. and Manley, M. (1999), "The American Stop Smoking Intervention Study: conceptual framework and evaluation design", Evaluation Review, Vol. 23 No. 3, pp. 259-80.
61. Stufflebeam, D.L. and Shinkfield, A.J. (1985), Systematic Evaluation, Kluwer-Nijhoff Publishing, New York, NY.
62. Suchman, E.A. (1967), Evaluative Research: Principles and Practice in Public Service and Social Action Programs, Russell Sage Foundation, New York, NY.
63. Torres, R.T. (1994), "Guest editor's introduction", Evaluation and Program Planning, Vol. 17 No. 3, p. 289.
64. Tyler, R.W. (1942), "General statement of evaluation", Journal of Educational Research, Vol. 35, pp. 492-501.
65. Verschuren, P.J.M. and Zsolnai, L. (1998), "Norms, goals and stakeholders in program evaluation", Human Systems Management, Vol. 17 No. 2, pp. 155-60.
66. Weiss, C.H. (1972), Evaluation Research, Prentice- Hall, Englewood Cliffs, NJ.
67. Weiss, C.H. (1997), "How can theory-based evaluation make greater headway?", Evaluation Review, Vol. 21 No. 4, pp. 501-24.
68. Wholey, J.S. (1979), Evaluation: Promise and Performance, Urban Institute, Washington, DC.