Evaluation for the real world: The impact of evidence in policy making

Evaluation for the Real World: The Impact of Evidence in Policy Making

Volumn , Issue , 2012, Pages 1-248

  Palfrey, Colin ^a   Thomas, Paul ^b   Phillips, Ceri ^b  

^a Cathays Park   (United Kingdom)

^b SWANSEA UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85030997546     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Book

References (440)

1. Alpsten, B. (1974) 'Methods of evaluation and planning of police work', in Methods of evaluation and planning in the field of crime, Reports presented to the First Criminological Colloquium (1973), vol xii Strasbourg: Council of Europe.
2. Bamberger, M., Rugh, J. and Mabry, L. (2006) Real world evaluation, London: Sage.
3. Campbell, D.T. (1969) 'Reforms as experiments', American Psychologist, vol 24, pp 409-29.
4. Care, F.G. (1977) Readings in evaluation research, Beverly Hills, CA: Russell Sage.
5. Carter, N. (1988) 'Performance indicators in the criminal justice system', in Crime UK 1988, Newbury: Policy Journals.
6. Clarke, A. (2006) Evaluation research, London: Sage.
7. Cochrane, A.L. (1972) Effectiveness and efficiency, Nuffield Provincial Hospitals Trust.
8. Cordray, D. and Lipsey, M.W. (1986) 'Program evaluation and program research', in Evaluation studies: A review annual, Beverly Hills, CA: Sage, pp 17-31.
9. Davies, H.T.O., Nutley, S.M. and Smith, P.C. (eds) (2000) What works? Evidence-based policy and practice in public services, Bristol: The Policy Press.
10. Dent, T.H.S. and Sadler, M. (2002) 'From guidance to practice: why NICE is not enough', British Medical Journal, vol 324, pp 842-45.
11. Department of the Environment (1992) Policy evaluation: The role of social research, London: HMSO.
12. Duke, K. (2001) 'Evidence-based policy making? The interplay between research and the development of prison drugs policy', Criminal Justice, vol 1, no 3, pp 277-300.
13. Fink, A. (2005) Evaluation fundamentals (2nd edn), Thousand Oaks, CA: Sage.
14. Fowler, P.B.S. (1997) 'Evidence-based everything', Journal of Evaluation in Clinical Practice, vol 3, no 3, pp 239-43.
15. Gafni, A. and Birch, S. (2003) 'NICE methodological guidelines and decision-making in the NHS in England and Wales', Pharmacoeconomics, vol 21, no 3, pp 149-57.
16. Goffman, E. (1968) Asylums, Harmondsworth: Penguin.
17. Gray, D.E. (2004) Doing research in the real world, London: Sage.
18. Greenhalgh, T. (1997) How to read a paper: The basics of evidence-based medicine, British Medical Journal Publishing.
19. Henkel, M. (1991) Government, evaluation and change, London: Jessica Kingsley.
20. HM Treasury (1986) Output performance measurement in central government, Working Paper No 38 (ed. S. Lewis), London: HM Treasury.
21. HM Treasury (1987) Output performance measurement in central government, Working Paper No 45 (ed. P. Durham), London: HM Treasury.
22. HM Treasury (2003) The Green Book: Appraisal and evaluation in central government, London: TSO.
23. HM Treasury (2011) The Magenta Book: Guidance for evaluation, London: HM Treasury.
24. Hogwood, J. and Gunn, N. (1984) Policy analysis for the real world, Oxford: Oxford University Press.
25. Hughes, O.E. (1994) Public management and administration, Basingstoke: Macmillan.
26. Oakley, A. (2000) Experiments in knowing: Gender and method in the social sciences, Cambridge: Polity Press.
27. Palfrey, C., Phillips, C., Thomas, P. and Edwards, D. (1992) Policy evaluation in the public sector, Aldershot: Avebury.
28. Patton, M.Q. (1986) Utilization-focused evaluation, London: Sage.
29. Patton, M.Q. (1988) 'Politics and evaluation', Evaluation Practice, vol 9, no 1, pp 89-94.
30. Pollitt, C. (1985) 'Measuring performance: a new system for the NHS', Policy & Politics, vol 13, no 1, pp 1-15.
31. Ranson, S. and Stewart, J. (1994) Management for the public domain, London: Macmillan.
32. Raynor, P., Smith, D. and Vanstone, M. (1994) Effective probation practice, Basingstoke: Macmillan.
33. Robson, C. (1993) Real world research, Oxford: Blackwell.
34. Rossi, P.H. and Freeman, H.E. (1993) Evaluation: A systematic approach, Newbury Park, CA: Sage.
35. Rossi, P.H., Freeman, H. and Lipsey, M.W. (1999) Evaluation: A systematic approach (6th edn), Beverly Hills, CA: Sage.
36. Shaw, I.A, Greene, J.C. and Mark, M. (eds) (2006) Handbook of evaluation: Policies, programs and practices, London: Sage.
37. Sheldon, B. and Chilvers, R. (2000) Evidence-based social care, Lyme Regis: Russell House Publishing.
38. Smith, R.M. (1996) 'What clinical information do doctors need?', British Medical Journal, vol 313, pp 3062-68.
39. Smith, R.M. (2000) 'The failings of NICE', British Medical Journal, vol 321, pp 1363-64.
40. Suchman, E.A. (1967) Evaluative research: Principles in public service and action programs, Beverly Hills, CA: Sage.
41. Walshe, K. (2001) 'Evidence-based policy. Don't be timid', British Medical Journal, vol 323, p 187.
42. Weiss, C. (1972) Evaluation research, Eaglewood Cliffs, CA: Prentice Hall.
43. Weiss, C. (1977) Using research in public policy making, Lexington, MA: D.C. Heath.
44. Alkin, M.C. (ed) (2004) Evaluation roots: Tracing theorists' views and influences, Thousand Oaks, CA: Sage.
45. Bickman, L. (1987) 'The functions of program theory', in L. Bickman (ed) Using program theory in evaluation, San Francisco, CA: Jossey Bass.
46. Bryk, A.S. (ed) (1983) Stakeholder-based evaluation, New Directions in Program Planning Evaluation No 17, San Francisco, CA: Jossey-Bass.
47. Carter, N., Klein, R. and Day, P. (1992) How organizations measure success: the use of performance indicators in government, London: Routledge.
48. Chen, H.T. (1990) Theory-driven evaluations, Newbury Park, CA: Sage.
49. Clarke, A. (1999) Evaluation research: an introduction to principles, methods and practice, London: Sage.
50. Cronbach, L.J. and associates (1980) Towards reform of program evaluation, San Francisco, CA: Jossey Bass.
51. Daily Telegraph (2010) 'Audit Commission scrapped as austerity drive intensifies' [by N. Triggle], 24 February.
52. Darzi, Lord (2008) High quality care for all, NHS Next Stage Review: Final report (June) Cmnd 7432.
53. Doem, G.B. (1993) 'The UK Citizens' Charter: origins and implementation in three agencies', Policy & Politics, vol 21, no 1, pp 17-29.
54. Donabedian, A. (1969) 'Evaluating the quality of medical care', Milbank Memorial Quarterly, vol 44, pp 166-206.
55. Donabedian, A. (1980) The definition of quality and approaches to its assessment, Ann Arbor, MI: Health Administration Press.
56. Donaldson, S.I. (2001) 'Overcoming our negative reputation: evaluation becomes known as a helping profession', American Journal of Evaluation, vol 22, pp 35-6.
57. Donaldson, S.I. and Lipsey, M.W. (2006) Roles for theory in contemporary evaluation practice: developing practical knowledge, Ann Arbor MI: Health Administration Press.
58. Dror, Y. (1989) Public policy making re-examined (2nd edn), New Brunswick, NJ: Transaction Publishers.
59. Edelman, M. (1984) The symbolic use of politics, Urbank: Illinois Press.
60. Eggers, H.W. and Chelimsky, E. (1999) 'Purposes and use: what can we expect?', Evaluation, vol 5, no 1, pp 92-6.
61. Epstein, I. and Tripodi, T. (1977) Research techniques for program planning, New York: Columbia University Press.
62. Etzioni, A. (1967) 'Mixed-scanning: a "third" approach to decisionmaking', Public Administration Review, vol 27, pp 385-92.
63. Feinstein, O.N. (2002) 'Use of evaluation and the evaluation of use', Evaluation, vol 8, no 4, pp 433-39.
64. Fetterman, D. (2003) 'Empowerment evaluation strikes a responsive chord', in S. Donaldson and M. Scriven (eds) Evaluating social programs and problems, Hillsdale, NJ: Erlbaum.
65. Finch, J. (2004) Evaluating mental health services for older people, Oxford: Radcliffe.
66. Furibo, J.-E., Rist, R.C. and Sandahl, R. (2002) The international atlas of evaluation, NJ: Transaction Publishers.
67. Gaster, L. (1995) Quality in public services: Managers' choices, Buckingham: Open University Press.
68. Gray, D. A. (2004) Doing research in the real world, London: Sage.
69. Green, J. and South, J. (2006) Evaluation, Maidenhead: Open University Press.
70. Guba, E.G. (1981) Improving the usefulness of evaluation results through responsive and naturalistic approaches, San Francisco, CA: Jossey Bass.
71. Guba, E.G. and Lincoln, Y.S (1981) Effective evaluation: Improving the usefulness of evaluation results through responsive and naturalistic approaches, San Francisco, CA: Jossey Bass.
72. Hambleton, R. and Hoggett, P. (1990) Beyond excellence: Quality local government in the 1990s, Working Paper No 85, Bristol: School for Advanced Urban Studies, University of Bristol.
73. Hamilton, D. (ed) (1977) Beyond the numbers game: A reader in educastional evaluation, London: Macmillan.
74. Hansen, H.F. (2005) 'Choosing evaluation models', Evaluation, vol 11, no 4, pp 447-461.
75. Hedrick, T.E. (1988) 'The interaction of politics and evaluation', Evaluation Practice, vol 9, no 3, pp 5-14.
76. Herman, J.L., Morris, L.L. and Fitz-Gibbon, C.T. (1987) Evaluation handbook, Newbury Park, CA: Sage.
77. Ho, S.Y. (1999) 'Evaluating urban regeneration programmes in Britain', Evaluation, vol 5, no 4, pp 422-38.
78. Hogwood, B.W. (1987) From crisis to complacency, Oxford: Oxford University Press.
79. House, E.R. (1993) Professional evaluation: Social impact and political consequences, London: Sage.
80. Karlsson, O. (1996) 'A critical dialogue in evaluation', Evaluation, vol 2, no 4, pp 405-16.
81. Lang, A. (1844-1912) quoted in C. Robertson (ed) (1997) Wordsworth Dictionary of Quotations, Ware, Herts: Wordsworth Editions, p 277.
82. Leeuw, F.L. and Furibo, J-E. (2008) 'Evauation systems: what are they and why study them?', Evaluation, vol 14, no 2, pp 151-69.
83. Lindblom, C. (1959) 'The science of "muddling through"', Public Administration Review, vol 19, no 3, pp 517-26.
84. Lipsey, M.W. (1993) 'Theory as method: small theories of treatments', New Directions for Program Evaluation, vol 57, pp 5-38.
85. Lipsky, M. (1980) Street-level bureaucracy, NY: Russell Sage.
86. Luker, K.A. (1981) 'An overview of evaluation research in nursing', Journal of Advanced Nursing, vol 6, pp 87-93.
87. Macdonald, B. (1977) 'A political classification of evaluation studies', in D. Hamilton (ed) Beyond the numbers game, London: Macmillan.
88. Macmillan, H. (2003) The Macmillan diaries: The Cabinet years 1950-57 (ed P. Catterall), London: Macmillan.
89. Office of Public Services Reform (2003) The government's policy on inspection of public services, London: Cabinet Office.
90. Palfrey, C. and Thomas, P. (1999) 'Politics and policy evaluation', Public Policy and Administration, vol 14, no 4, pp 58-70.
91. Palfrey, C., Thomas, P. and Phillips, C. (2004) Effective health care management: An evaluative approach, Oxford: Blackwell.
92. Palfrey, C., Thomas, P., Phillips, C. and Edwards, D. (1992) Policy evaluation in the public sector, Aldershot: Avebury.
93. Parsons, W. (1995) Public policy: An introduction to the theory and practice of policy analysis, London: Edward Elgar.
94. Patton, M.Q. (1981) Creative evaluation, Beverly Hills, CA: Sage.
95. Patton, M.Q. (1988) 'Six honest serving men', Studies in Educational Evaluation, vol 14, pp 301-30.
96. Patton, M.Q. (2002) Utilization-focused evaluation.Available at www. wmich.edu/evalctr/checklists/
97. Pawson, R. and Tilley, N. (1997) Realistic evaluation, London: Sage.
98. Phillips, C., Palfrey, C. and Thomas, P. (1994) Evaluating health and social care, London: Macmillan.
99. Potter, C. (2006) 'Psychology and the art of program evaluation', South African Journal of Psychology, vol 36, no 1, pp 82-102.
100. Power, M. (1997) The audit society: Rituals of verification, Oxford: Oxford University Press.
101. Redwood, J (2006) I don't like politics but I want to make a difference, London: Politico's Publishing Ltd.
102. Robson, C. (1993) Real world evaluation research, Oxford: Blackwell.
103. Rossi, P.H., Lipsey, M.W. and Freeman, H.E. (2004) Evaluation: A systematic approach, Thousand Oaks, CA: Sage.
104. Schulberg, B.C. and Baker, F.B. (1968) 'Program evaluation and the implementation of research findings', American Journal of Public Health, vol 58, pp 1238-55.
105. Scriven, M. (1967) 'The methodology of evaluation', in R.W. Tyler, R.M. Gagne and M. Scriven (eds) Perspectives of curriculum evaluation, Chicago, IL: Rand McNally.
106. Scriven, M. (2004) Practical program evaluation: A checklist approach, Claremont Graduate University Annual Professional Development Workshop.
107. Shaw, C.D. and Collins, C.D. (1995) 'Health service accreditation: report of a pilot programme for community hospitals', British Medical Journal, vol 310, pp 781-784l.
108. Shaw, I.A., Greene, J.C. and Mark, M.M. (eds) (2006) Handbook of evaluation: Policies, programs and policies, London: Sage.
109. Sieber, J. (1980) 'Being ethical: professional and personal decision in program evaluation', in R. Perloff and E. Perloff (eds) Values, ethics and standards in evaluation, San Francisco, CA: Jossey Bass.
110. Simey, M. (1985) Government by consent, London: Bedford Square Press.
111. Simon, H.A. (1957) Administrative behaviour, London: Macmillan.
112. Simons, H. (1984) 'Negotiating conditions for independent evaluation', in M. Simey (1985) Government by consent, London: Bedford Square Press.
113. Smith, B. (1976) Policy making in British government: An analysis of power and rationality, Oxford: Martin Robertson.
114. Smith, G. and Cantley, C. (1985) Assessing healthcare: A study in organisational evaluation, Milton Keynes: Open University Press.
115. Stufflebeam, D. (2001) Evaluation models, New Directions for Evaluation No 89, San Francisco, CA: Jossey Bass.
116. Suchman, E.A. (1967) Evaluative research, NY: Russell Sage.
117. Tones, K. and Tilford, S. (2001) Health promotion: Effectiveness, efficiency and equity, Cheltenham: Nelson Thornes.
118. Vickers, G. (1965) The art of judgement, London: Chapman and Hall.
119. Weiss, C. (1972) Evaluation research, New Jersey: Englewood Cliffs.
120. Weiss, C. (1999) 'The interface between evaluation and public policy', Evaluation, vol 5, no 1, pp 468-86.
121. White, H. (2010) 'A contribution to current debates in impact evaluation', Evaluation, vol 16, no 2, pp 153-64.
122. Whynes, D.K. (1987) 'On assessing efficiency in the provision of local authority services', Local Government Studies, vol 13, no 1, pp 53-68.
123. Williams, D.D. (1986) Naturalistic evaluation, San Francisco, CA: Jossey Bass.
124. World Health Organization (1998) Health promotion evaluation: recommendations to policy makers, WHO Copenhagen Regional Office for Europe.
125. Abma, T. (2006) 'The practice and politics of responsive evaluation', American Journal of Evaluation, vol 27, no 31, pp 30-43.
126. Carr, W. and Kemmis, S. (1986) Becoming critical: Education, knowledge and action research, Lewes: Falmer Press.
127. Carter, N., Klein, R. and Day, P. (1992) How organisations measure success: The use of performance indicators in government, London: Routledge.
128. Caulley, D. (1993) 'Overview of approaches to program evaluation: the five generations', in N. Denzin and Y. Lincoln (eds) (1994) Handbook of qualitative research, London: Sage.
129. Chen, H. and Rossi, P. (1983) 'Evaluation with sense: the theory-driven approach', Evaluation Review, vol 7, pp 283-302.
130. Clarke, A. and Dawson, R. (1999) Evaluation research: An introduction to principles, methods and practice, London: Sage.
131. Clarke, M. and Stewart, J. (1997) Handling the wicked issues: A challenge for government, Birmingham: INLOGOV.
132. Cochrane, A. (1972) Effectiveness and efficiency: Random reflections on health services, London: Nuffield Provincial Hospitals Trust.
133. Dobrow, M., Goel, V. and Upshur, R. (2004) 'Evidence-based health policy: context and utilisation', Social Science and Medicine, vol 58, pp 207-17.
134. Easterby-Smith, M. (2004) Evaluating management development, training and education, Aldershot: Gower.
135. Eden, C. and Huxham, C. (1996) 'Action research for the study of organisations', in S. Clegg and W. Nord (eds) Handbook of organisational studies, Beverly Hills, CA: Sage.
136. Glaser, B. and Strauss, A. (1967) The discovery of grounded theory, NJ: Aldine.
137. Government Chief Social Researcher's Office (2003) Trying it out: The role of 'pilots' in policy making, London: Cabinet Office.
138. Guba, E. and Lincoln, Y. (1987) 'The countenances of fourth-generation evaluation: description, judgment and negotiation', in D. Palumbo (ed) The politics of program evaluation, IL: Sage.
139. Guba, E. and Lincoln, Y. (1989) Fourth generation evaluation, Newbury Park, CA; Sage.
140. Hart, E. and Bond, M. (1995) Action research for health and social care: A guide to practice, Milton Keynes: Open University.
141. Hill, M. (2005) The public policy process, Harlow: Pearson.
142. Ho, S. (1999) 'Evaluating urban regeneration programmes in Britain: exploring the potential of the realist approach', Evaluation, vol 5, no 4, pp 422-38.
143. Jones, S. (1985) 'The analysis of depth interviews', in R. Walker (ed) Applied qualitative research, London: Gower, pp 56-70.
144. Karlsson, O. (1996) 'A critical dialogue in evaluation: how can the interaction between evaluation and politics be tackled?', Evaluation, vol 2, no 4, pp 405-16.
145. Knox, C. and McAlister, D. (1995) 'Policy evaluation: Incorporating Users' views', Public Administration, vol 73, pp 413-36.
146. Laughlin, R. and Broadbent, J. (1996) 'Redesigning fourth generation evaluation: an evaluation model for the public sector reforms in the UK?', Evaluation, vol 2, no 4, pp 431-51.
147. Lewin, K. (1946) 'Action research and minority problems', in G.W. Lewin (ed) (1948) Resolving social conflicts, NY: Harper.
148. Love, A. (1991) Internal evaluation, London: Sage.
149. Miles, M. and Huberman, A. (1993) Qualitative data analysis: A sourcebook of new methods, London: Sage.
150. Nutley, S., Walter, I. and Davies, H. (2003) 'From knowing to doing: a framework for understanding the evidence-into-practice agenda', Evaluation, vol 9, no 2, pp 125-48.
151. Nutley, S., Walter, I. and Davies, H. (2007) Using evidence: How research can inform public services, Bristol: The Policy Press.
152. Palfrey, C. and Thomas, P. (1999) 'Politics and policy evaluation', Public Policy and Administration, vol 14, no 4, pp 58-70.
153. Palumbo, D. (1987) 'Politics and evaluation', in D. Palumbo (ed) The politics of program evaluation, IL: Sage.
154. Patton, M. (1987) Creative evaluation, London: Sage.
155. Pawson, R. (2006) Evidence-based policy: A realist perspective, London: Sage.
156. Pawson, R. and Tilley, N. (1997) Realistic evaluation, London: Sage.
157. Petticrew, M., Cummins, S., Ferrell, C., Findlay, A., Higgins, C., Hoy, C., Kearns, A. and Sparks, L. (2005) 'Natural experiments: an underused tool for public health?', Public Health, vol 119, pp 751-57.
158. Phillips, C., Palfrey, C. and Thomas, P. (1994) Evaluating health and social care, London: Macmillan.
159. Plottu, B. and Plottu, E. (2009) 'Approaches to participation in evaluation: some conditions for implementation', Evaluation, vol 15, no 3, pp 343-59.
160. Preskill, H. and Torres, R. (1999) 'Building capacity for organisational inquiry through evaluative inquiry', Evaluation, vol 5, no 1, pp 42-60.
161. Roethlisberger, F. and Dickson, W. (1939) Management and the worker, Harvard, MA: Harvard University Press.
162. Rossi, P. and Freeman, H. (1993) Evaluation: A systematic approach, CA: Sage.
163. Runciman, W. (1983) A treatise on social theory: The methodology of social theory, Cambridge: Cambridge University Press.
164. Sanderson, I. (2004) 'Getting evidence into practice: perspectives on rationality', Evaluation, vol 10, no 3, pp 366-79.
165. Schon, D. (1983) The reflective practitioner: How professionals think in action, NY: Basic Books.
166. Schon, D. (1987) Educating the reflective practitioner: Towards a new design for teaching and learning in the professions, San Francisco, CA: Jossey-Bass.
167. Shaxson, L. (2005) 'Is your evidence robust enough? Questions for policy makers and practitioners', Evidence and Policy vol 1, no 1, pp 101-11.
168. Skinner, D. (2004) 'Primary and secondary barriers to the evaluation of change: evidence from two public sector organisations', Evaluation, vol 10, no 2, pp 135-54.
169. Smith, G. and Cantley, C. (1985) Assessing health care: A study in organisational evaluation, Milton Keynes: Open University.
170. Stake, R. (2004) Standards-based and responsive evaluation, CA: Sage.
171. Taylor, D. and Balloch, S. (eds) (2005) The politics of evaluation: Participation and implementation, Bristol: The Policy Press.
172. Thomas, P. and Palfrey, C. (1996) 'Evaluation: stakeholder-focused criteria', Social Policy and Administration, vol 30, no 2, pp 125-42.
173. Walker, R. (ed) (1985) Applied qualitative research, London: Gower.
174. Walshe, K. (2006) 'Research, evaluation and evidence-based management', in K. Walshe and J. Smith (eds) Healthcare management, Milton Keynes: Open University Press.
175. Walshe, K. and Rundall, T. (2001) 'Evidence-based management: from theory to practice in health care', The Milbank Quarterly, vol 79, no 3.
176. Weiss, C. (1987) 'Where politics and evaluation research meet', in D. Palumbo (ed) The politics of program evaluation, IL: Sage. (Originally a paper presented to the American Psychological Association in 1973.)
177. Abma, T. (1997) 'Playing with/in plurality', Evaluation, vol 3, no 1, pp 25-48.
178. Bradshaw, J. (1972) 'A taxonomy of human need', New Society, March, pp 640-3.
179. Department of Health (2006) Achieving high performance in health care systems: The impact and influence of organisational arrangements, NHS Service Delivery and Organisation R&D programme.
180. Dixon, A. and Le Grand, J. (2006) 'Is greater patient choice consistent with equity? The case of the English NHS', Journal of Health Services Research and Policy, vol 11, no 3, pp 162-6.
181. Edgar, A., Salek, S., Shickle, D. and Cohen, D. (1998) The ethical QALY: Ethical issues in healthcare resource allocations, Haslemere: Euromed Communications.
182. Elcock, H. and Haywood, S. (1980) The buck stops where? Accountability and control in the NHS, Hull: University of Hull.
183. Ferlie, E., Ashburner, L., Fitzgerald, L. and Pettigrew, A. (1996) The new public management in action, Oxford: Oxford University Press.
184. Foot, P. (2003) Virtues and vices and other essays in moral philosophy, Oxford: Oxford University Press.
185. Gillon, R. (1994) Philosophical medical ethics, NY: John Wiley.
186. Goddard, M. (2009) 'Access to health care services-an English policy perspective', Health Economics, Policy and Law, vol 4, pp 195-208.
187. Gulliford, M. (2009) 'Modernizing concepts of access and equity', Health Economics, Policy and Law, vol 4, pp 223-30.
188. Hill, M. (ed) (1997) The policy process: A reader, London: Wheatsheaf.
189. Hirschman, A. (1971) Exit, voice and loyalty: Responses to decline of firms, organisations and states, Harvard, MA: Harvard University Press.
190. Honderich, T. (ed)(1995) The Oxford companion to philosophy, Oxford: Oxford University Press.
191. Karlsson, O. (1996) 'A critical dialogue in evaluation; how can the interaction between evaluation and politics be tackled', Evaluation, vol 2, no 4, pp 405-16.
192. MacIntyre, A. (1985) After virtue: A study in moral theory, London: Duckworth.
193. McLaughlin, K., Osbourne, S. and Ferlie, E. (eds.) (2002) New public management: Current trends and future prospects, London: Routledge.
194. Mooney, G. (2009) 'Is it not time for health economists to rethink equity and access?', Health Economics, Policy and Law, vol 4, pp 209-21.
195. Morgan, C. and Murgatroyd, S. (1994) Total quality management in the public sector, Milton Keynes: Open University.
196. Newman, D. and Brown, R. (1996) Applied ethics for program evaluation, London: Sage.
197. Nolan Committee (1995) Standards in public life, London: HMSO.
198. Palfrey, C. and Thomas, P. (1996) 'Ethical issues in policy evaluation', Policy & Politics, vol 24, no 3, pp 277-85.
199. Palfrey, C., Thomas, P. and Phillips, C. (2004) Effective health care management: An evaluative approach, Oxford: Blackwell.
200. Peckham, S., Exworthy, M. and Greener, I. and Powell, M. (2005) 'Decentralising health services: more accountability or just more central control', Public Money and Management, vol 25, no 4, pp 221-30.
201. Phillips, C., Palfrey, C. and Thomas, P. (1994) Evaluating health and social care, London: Macmillan.
202. Roberts, H. (1991) 'Outcome and performance in health care: survey of current activities', in Public Finance Foundation, Outcome and performance in health care, Discussion Paper 40, London: PFF.
203. Smith, G. and Cantley, C. (1985) Assessing health care: A study in organisational evaluation, Milton Keynes: Open University Press.
204. Thomas, P. and Palfrey, C. (1996) 'Evaluation: stakeholder-focused criteria', Social Policy and Administration, vol 30, no 2, pp 125-42.
205. Ackerman, F. and Heinzerling, L. (2004) Priceless: On knowing the price of everything and the value of nothing, NY: The New Press.
206. Anema, J.R., Jettinghoff, K., Houtman, I. et al (2006) 'Medical care of employees long-term sick listed due to mental health problems: a cohort study to describe and compare the care of the occupational physician and the general practitioner', Journal of Occupational Rehabilitation, vol 16, no 1, pp 41-52.
207. Barabasi, A.L. and Bonabeau, E. (2003). 'Scale-free networks', Scientific American, vol 288, pp 50-9.
208. Bateman I.J, Carson, R.T., Day, B., Haneman, M., Hanleys, N., Hett,T., Jones-Lee, M., Loomes, G., Mourato, E., Ozdemiroglu, E., Pearce, D,. Sugden. R. and Swanson, J. (2002) Economic valuation with stated preferences, Cheltenham: Edward Elgar.
209. Bateman, I.J. and Willis, K.G. (1999) Valuing normal preferences: Theory and practice of the contingent valuation method in US, EU and developing countries, Oxford: OUP.
210. Bell, I.R. and Koithan, M. (2006). 'Models for the study of whole systems', Integrative Cancer Therapies, vol 5, no 4, pp 293-307.
211. Blaug, M. (1998) 'Where are we now in British health economics?', Health Economics, vol 7, no 1, pp 63-78.
212. Brouwer, W., Rutten, F. and Koopmanschap, M. (2001) 'Costing in economic evaluation', in M.F. Drummond and A. McGuire (eds) Economic evaluation in health care: Merging theory with practice, Oxford: Oxford University Press.
213. Bunker, B. and Alban, B. (1994) Large group intervention, San Francisco, CA: Barret Koehler.
214. Byford, S., McDaid, D. and Sefton, T.A.J. (2003) Because it's worth it: A practical guide to conducting economic evaluations in the social welfare field, York: Joseph Rowntree Foundation.
215. Byford, S., Barrett, B., Dubourg, R., Francis, J. and Sisk, J. (2010) 'The role of economic evidence in formulation of public policy and practice', in I. Shemilt, M. Mugford, L. Vale, K. Marsh and C. Donaldson (eds) Evidence-based decisions and economics: Health care, social welfare, education and criminal justice, Oxford: Wiley-Blackwell.
216. Carlyle, T. (1849) 'Occasional discourse on the negro question', in Frazer's Magazine for Town and Country, Vol XL, London. Available at:http://www.efm.bris.ac.uk/het/carlyle/occasion.htm. (accessed 02/01/2012)
217. Claxton, K.P., Sculpher, M.J. and Culyer, A.J. (2007) Mark versus Luke? Appropriate methods for the evaluation of public health interventions, University of York, Centre for Health Economics Research Paper 31.
218. Coast, J. (2004) 'Is economic evaluation in touch with society's health values?', British Medical Journal, vol 329, pp 1233-36.
219. Commonwealth Fund Commission on a High Performance Health System (2006) Framework for a high performance health system for the United States. New York: The Commonwealth Fund. Available at: www.cmwf. org/usr_doc/Commission_framework_high_performance:943.pdf.
220. CPHE (2006) Methods for the development of NICE public health guidance, London: NICE.
221. Culyer, A.J. (1989) 'The normative economics of health care finance and provision', Oxford Review of Economic Policy, vol 5, no 1, pp 34-58.
222. Dolan, P. (2001) 'Output measures and valuation in health', in M.F. Drummond and A. McGuire (eds) Economic evaluation in health care: merging theory with practice, Oxford: Oxford University Press.
223. Dolan, P. and Metcalfe, R. (2008) 'Valuing non-market goods: A comparison of preference-based and experience-based approaches'. Available at http://cep.lse.ac.uk/seminarpapers/25-02-08-DOL.pdf.
224. Dolan, P. and Tsuchiya, A. (2006) 'The elicitation of distributional judgements in the context of economic evaluation', in A. Jones (ed) Companion to health economics, Cheltenham: Elgar, Chapter 36.
225. Dolan, P., Peasgood, T. and White, M. (2008) 'Do we really know what makes us happy? A review of the economic literature on the factors associated with subjective wellbeing', Journal of Economic Psychology, vol 29, pp 94-122.
226. Dolan, P., Metcalfe, R., Munro, V. and Christensen, M.C. (2008) 'Valuing lives and life years: anomalies, implications and an alternative', Health Economics, Policy, and Law, vol 3, pp 277-300.
227. Drummond, M.F., Sculpher, M.J. and Torrance, G.W. (2005) Methods for the economic evaluation of health care programmes, Oxford: Oxford University Press.
228. Drummond, M., Weatherly. H., Claxton, K. et al. (2007) Assessing the challenges of applying standard methods of economic evaluation to public health interventions, Public Health Research Consortium, York. Available at http://www.york.ac.uk/phrc/D1-05%20RFR.pdf.
229. Eckstein, O. (1958) Water resource development, Cambridge, MA: Harvard University Press.
230. Epping-Jordan, J.E., Pruitt, S.D., Bengoa, R., Wagner, E.H. (2004) 'Improving the quality of health care for chronic conditions', Quality and Safety in Health Care, vol 13, pp 299-305.
231. Evans, T. and Brown, H. (2003) 'Road traffic crashes: operationalizing equity in the context of health sector reform', Injury Control and Safety Promotion, vol 10, no 1-2, pp 11-12.
232. Frank, J., Sinclair, S., Hogg-Johnson, S., Shannon, H. et al. (1998) 'Preventing disability from work-related low-back pain. New evidence gives new hope-if we can just get all the players onside', Canadian Medical Association Journal, vol 158, pp 1625-31.
233. Frank, J.W, Brooker, A.S., DeMaio S.E., Kerr, M.S., et al. (1996) 'Disability resulting from occupational low back pain: Part II: what do we know about secondary prevention? A review of the scientific evidence on prevention after disability begins', Spine, vol 21, pp 2918-29.
234. Friesen, M.N., Yassi, A., Cooper, J. (2001) 'Return-to-work: The importance of human interactions and organizational structures', Work, vol 17, pp 11-22.
235. Galbraith, J.K. (1958) The affluent society, Cambridge. MA: The Riverside Press.
236. Godlee, F. (2010) 'Wishing you a rational new year', British Medical Journal, vol 341, c7377.
237. Hajkowicz, S. and Higgins, A. (2008) 'A comparison of multiple criteria analysis techniques for water resource management', European Journal of Operational Research, vol 184, pp 255-65.
238. Haynes, B. (1999) 'Can it work? Does it work? Is it worth it?', British Medical Journal, vol 319, pp 652-653.
239. Heller, R.F., Gemmell, I., Wilson, E., Fordham, R. and Smith, R.D. (2006) 'Using economic analysis for local priority setting: The population cost-impact approach', Applied Health Economics and Health Policy, vol 5, no 1, pp 45-54.
240. HM Treasury (2003) Green Book, London: HM Treasury. Available at http://www.hm-treasury.gov.uk/d/green_book_complete.pdf.
241. HM Treasury (2009) Developments in the economics of well-being, Treasury Economic Working Paper No. 4. Available at http://webarchive. nationalarchives.gov.uk/20100407010852/http://www.hm-treasury. gov.uk/d/workingpager4_031108.pdf.
242. James, P., Cunningham, I. and Dibbren, P. (2006) 'Job retention and return to work of ill and injured workers: towards an understanding of organisational dynamics', Employee Relations, vol 28, no 3, pp 290-303.
243. Jansen, M.P. and Koffijberg, H. (2009) 'Enhancing value of information analyses', Value in Health, vol 12, pp 935-41.
244. Johansson, P.-O. (1987) The economic theory and measurement of environmental benefits, Cambridge: Cambridge University Press.
245. Jones-Lee, M.W. (1990) 'The value of transport safety', Oxford Review of Economic Policy, vol 6, pp 39-60.
246. Knapp, M. (1999) 'Economic evaluation and mental health: Sparse past. fertile future?', Journal of Mental Health Policy and Economics, vol 2, pp 163-67.
247. Krutilla, J.V. and Eckstein, O. (1958) Multiple purpose river development, Baltimore, MD: John Hopkins University Press.
248. Laurance, J. (2006) 'The real cost of a bag of salad', The Independent, April.
249. Lessard, C. and Birch, S. (2010) 'Complex problems or simple solutions? Enhancing evidence-based economics to reflect reality', in I. Schemit et al (eds) Evidence-based decisions and economics: health care, social welfare, education and criminal justice, Oxford: Wiley-Blackwell, BMJ Books.
250. Maciosek, M.V., Coffield, A.B., Edwards, N.M., Flottemesch, T.J., Goodman, M.J. and Solberg, L.I. (2006) 'Priorities among effective clinical preventive services: results of a systematic review and analysis', American Journal of Preventive Medicine, vol 31, no 1, pp 52-61.
251. Maciosek, M.V., Edwards, N.M., Coffield, A.B., Flottemesch, T.J., Nelson, W.W., Goodman, M.J. and Solberg, L.I. (2006) 'Priorities among effective clinical preventive services: methods', American Journal of Preventive Medicine, vol 31, no 1, pp 90-6.
252. Mallenson, A. (2002) Whiplash and other useful illnesses, Montreal: McGill- Queen's University Press.
253. Mansell, W. (2007) Education by numbers: The tyranny of testing, London: Politico Publishing.
254. Marsh, K. (2010) 'The role of review and synthesis methods in decision models', in I. Schemit et al (eds) (2010) Evidence-based decisions and economics: Health care, social welfare, education and criminal justice, Oxford: Wiley-Blackwell, BMJ Books.
255. Maynard, A. and Sheldon, T.A. (1997). 'Health economics: has it fulfilled its potential?', in A. Maynard and I. Chalmers Non-random reflections on health services research: on the 25th anniversary of Archie Cochrane's Effectiveness and Efficiency, London: BMJ Books.
256. McGuire, A. and Henderson, J. (1987). The economics of health care: An introductory text, London: Routledge and Kegan Paul.
257. McKean, R. (1958) Efficiency in government through systems analysis, New York: Wiley.
258. Newman, M., Bird, K., Tripney, J. et al (2010) Understanding the drivers, impact and value of engagement in culture and sport. CASE, London. Available at http://www.culture.gov.uk/images/research/CASEsupersummaryFINAL- 19-July2010.pdf
259. NICE (2007) 'Behaviour change at population, community and individual levels', Public Health Guidance 6, London: NICE.
260. NICE (2008) Guide to the methods of technology appraisal, London: NICE.
261. OECD (2007) 'Is happiness measurable and what do those measures mean for policy?', Available at www.oecd.org/document/12/0,334, en_21571361_31938349_37720396_1_1_1_1,00.html
262. Pearce, D.W. and Turner, R.K. (1990), Economics of natural resources and the environment, Hemel Hempstead: Harvester Wheatsheaf.
263. Phillips C.J. (2001) 'The real cost of pain management', Anaesthesia, vol 56, pp 1031-3.
264. Phillips, C.J. (2005) Health economics: An introduction for health professionals, Oxford: Blackwells BMJ Books.
265. Phillips, C.J. and Prowle, M.J. (1992) 'Evaluating a health campaign: the Heartbeat Wales no-smoking initiative', Contemporary Wales, vol 5, pp 187-212.
266. Phillips, C.J. and Prowle, M.J. (1993) 'The economics of a reduction in smoking: a case study from Heartbeat Wales', Journal of Epidemiology and Community Health, vol 47, no 3, pp 215-23.
267. Phillips, C.J., Humphreys, I., Kendrick, D. et al (2011) 'Preventing bath water scalds: a cost-effectiveness analysis of introducing bath thermostatic mixer valves in social housing', Injury Prevention, vol 17, no 4, pp 238-43.
268. Pirmohamed, M., James, S., Meakin, S. et al. (2004) 'Adverse drug reactions as cause of admission to hospital: prospective analysis of patients', British Medical Journal, vol 329, pp 15-19.
269. Plsek, P.E. and Greenhalgh, T. (2001) 'The challenge of complexity in health care', British Medical Journal, vol 323, pp 625-628.
270. Rainer, T.H., Jacobs, P., Ng, Y.C. et al (2000) 'Cost effectiveness analysis of intravenous ketorolac and morphine for treating pain after limb injury: double blind randomized controlled trial', British Medical Journal, vol 321, pp 1-9.
271. Rawlins, M., Barnett, D. and Stevens, A. (2010) 'Pharmacoeconomics: NICE's approach to decision-making', British Journal of Clinical Pharmacology, vol 70, no 3, pp 346-9.
272. Romero, C. (1997) 'Multicriteria decision analysis and environmental economics: an approximation', European Journal of Operational Research, vol 96, pp 81-89.
273. Runge, M.C., Converse, S.J. and Lyons, J.E. (2011) 'Which uncertainty? Using expert elicitation and expected value of information to design an adaptive program', Biological Conservation, vol 144, pp 1214-23.
274. Sculpher, M.J., Pang, F.S., Manca, A. et al (2004) 'Generalisability in economic evaluation studies in healthcare: a review and case studies', Health Technology Assessment, vol 8, no 49, iii-iv, pp 1-192.
275. Seddon, J. (2008) Systems thinking in the public sector: The failure of the reform regime. and a manifesto for a better way, Axminster: Triarchy Press.
276. Seldon, A. (2007) Foreword to W. Mansel, Education by numbers: The tyranny of testing, London: Politico Publishing.
277. Sen, A.K. (1985) Commodities and capabilities, Oxford: Oxford University Press.
278. Senge, P. (1990) The fifth discipline: The art and practice of the learning organisation, NY: Doubleday.
279. Stiglitz, J. (2002) Globalization and its discontents, London: Penguin Books.
280. The Economist (2000) 'The price of safety', 23 November. Available at http://www.economist.com/node/434618.
281. The Economist (2000) 'How not to run a railway', 23 November. Available at http://www.economist.com/node/433992.
282. Ueffing, E., Tugwell, P., Welch, V., Petticrew, M. and Kridtjansson, E., Cochrane Health Equity Field (2010) 'C1, C2 Equity checklist for systematic review authors', Cochrane Health Equity Field, Ottawa, Available at www.equity.cochrane.org/Files/equitychecklist.pdf.
283. Vincent, C., Neale, G. and Woloshynowych, M. (2001) 'Adverse events in British hospitals: preliminary retrospective record review', British Medical Journal, vol 322, pp 517-9.
284. Wagner, E.H. (1998) 'Chronic disease management: what will it take to improve care for chronic illness?', Effective Clinical Practice, vol 1998, no 1, pp 2-4.
285. Waldorp, M. (1992) Complexity: The emerging science at the edge of chaos, New York: Simon & Schuster.
286. White, L. (2000) 'Changing the "whole system" in the public sector', Journal of Organizational Change Management, vol 13, no 2, pp 162-77.
287. Wiffen, P., Gill, M., Edwards, J. and Moore, A. (2002) 'Adverse drug reactions in hospital patients: a systematic review of the prospective and retrospective studies', Bandolier Extra, June.
288. Williams, I. and Bryan, S. (2007) 'Understanding the limited impact of economic evaluation in health care resource allocation: a conceptual framework', Health Policy, vol 80, pp 135-43.
289. Williams, I., Bryan, S. and McIver, S. (2008) 'The use of economic evaluations in NHS decision-making: a review and empirical investigation', Health Technology Assessment, vol 12, no 7, pp iii, ix-x, 1-175.
290. Wilson, E.C., Rees, J. and Fordham, R.J. (2006) 'Developing a prioritisation framework in an English Primary Care Trust', Cost Effectiveness and Resource Allocation, vol 4, p 3.
291. Wilson, E.C., Sussex, J., Macleod, C. and Fordham, R.J. (2007) 'Prioritizing health technologies in a Primary Care Trust', Journal of Health Services Research and Policy, vol 12, no 2, pp 80-85.
292. Wilkinson, R. and Pickett, K. (2010) The spirit level: Why equality is better for everyone, London: Penguin Books.
293. Yokota, F., Thompson, K.M. (2004) 'Value of information literature analysis: a review of applications in health risk management', Medical Decision Making, vol 24, pp 287-298.
294. Zarkin, G., Dunlap, L.J., Hicks, K.A. and Mano, D. (2005) 'Benefits and costs of methadone treatment: results from a lifetime simulation model', Health Economics, vol 14, pp 1133-50.
295. Alexander, H. (2003) 'Health service evaluations: should we expect the results to change practice?', Evaluation, vol 9, no 4, pp 405-14.
296. Alpsten, B. and Clarke, E.V.G. (1974) Methods of evaluation and planning in the field of crime, Strasbourg: Council of Europe.
297. Ambrose, P. (2005) 'Urban regeneration: who defines the indicators?', in D. Taylor and S. Balloch (eds) The politics of evaluation, Bristol: The Policy Press.
298. Bernstein, I.N. and Freeman, H.E. (1975) Academic and entrepreneurial research: The consequence of diversity in federal evaluation studies, NY: Russell Sage.
299. Bhola H.S (1998) 'Constructivist capacity building and systems evaluation and training in South Africa', Evaluation, vol 4, no 3, pp 329-50.
300. Caplan, N. (1979) 'The two-communities theory and knowledge utilization', American Behavioral Scientist, vol 2, no 3, pp 459-70.
301. Chelimsky, E. (1987) 'What have we learned about the politics of program evaluation?', Evaluation Practice, vol 8, no 1, pp 5-21.
302. Chelimsky, E. (1991) 'On the social science contribution to governmental decision-making', Science, vol 254, Oct, pp 226-30.
303. Chelimsky E (1997) 'Thoughts for a new evaluation society', Evaluation, vol 3, no 1, pp 97-109.
304. Clarke, A. (1999) Evaluation research: An introduction to principles, methods and practice, London: Sage.
305. Cousins, J.B. and Shulha, L.M. (2006) 'A comparative analysis of evaluation utilization and its cognate fields of inquiry: current issues and trends', in I.F. Shaw, J.G. Greene and M.M. Mark (eds) Handbook of evaluation: Policies, programs and practices, London: Sage.
306. Cronbach, L.J. and associates (1980) Towards reform of program evaluation, San Francisco, CA: Jossey Bass.
307. Department for Education (2011) Children and young people: Multiagency working, London.
308. Department of Health (2005) Partnership and regulation in adult protection: The effectiveness of multi-agency working and the regulatory framework in adult protection, University of Sheffield/King's College London.
309. Department of Health and Social Security (1980) Inequalities in health: Report of a research working group ('the Black Report'), London: DHSS.
310. Dickinson, H. (2008) Evaluating outcomes in mental health and social care, Bristol: The Policy Press.
311. Eggers, H.W. and Chelimsky, E. (1999) 'Purposes and use: what can we expect?', Evaluation, vol 5, no 1, pp 92-6.
312. Green, J. and South, J. (2006) Evaluation, Maidenhead: Open University Press.
313. Guba, E.G. and Lincoln, Y.S (1981) Improving the effectiveness of evaluation results through responsive and naturalistic approaches, San Francisco, CA: Jossey Bass.
314. Hedrick, T.E. (1988) 'The interaction of politics and evaluation', Evaluation Practice, vol 9, no 3, pp 5-14.
315. Henkel, M. (1991) Government, evaluation and change, London: Jessica Kingsley.
316. Ho, S.Y. (1999) 'Evaluating urban regeneration programmes in Britain', Evaluation, vol 5, no 4, pp 422-38.
317. Hogwood, B.W. and Gunn, L.A. (1984) Policy analysis for the real world, Oxford: Oxford University Press.
318. Imboden, N. (1978) A management approach to project appraisal and evaluation, Paris: Development Centre of the Organisation for Economic Co-operation and Development.
319. Keynes, J.M. (The Times, 11 March 1937) from Keynes' collected writings, vol 21, p 8409.
320. Leviton, L.C. and Baruch, R.F. (1983) 'Contributions of evaluation to educational programs', Evaluation Review, vol 7, no 5, pp 563-99.
321. Mohr, L.B. (1995) Impact analysis for program evaluation, Thousand Oaks, CA: Sage.
322. Nutley, S.M., Walter, I. and Davies, H.T.O. (2007) Using evidence: How research can inform public services Bristol: The Policy Press.
323. Owen, J.M. (1993) Program evaluation: Forms and approaches, St Leonards, NSW: Allen and Unwin.
324. Patton, M.Q. (1997) Utilization-focused evaluation: The new century text (3rd edn), Thousand Oaks, CA: Sage.
325. Patton, M.Q. (2002) Utilization-focused evaluation (U-FE) checklist. Available at www.wmich.edu/evalctr/checklists
326. Pawson, R. (2006) Evidence-based policy: A realist perspective, London: Sage.
327. Perloff, R. and Rich, R.F. (1986) 'The teaching of evaluation in Schools of Management', in B. Gross Davis (ed) Teaching of evaluation across the disciplines, San Francisco, CA: Jossey Bass.
328. Rossi, P.H., Freeman, H.E and Lipsey, M.W. (1999) Evaluation: A systematic approach, Thousand Oaks, CA: Sage.
329. Scriven, M. (1991) Evaluation thesaurus, Newbury Park, CA: Sage.
330. Shadish, W., Cook, T. and Leviton, L. (1991) Foundations of programme evaluation, London: Sage.
331. Solomon, M.A. and Shortell, S.M. (1981) 'Designing health policy research for utilization', Health Policy Quarterly, vol 1 (May), pp 261-73.
332. Suchman, E.A. (1967) Evaluative research: principles in public service and action programs, NY: Russell Sage.
333. Veney, J.E. and Kaluzny, A.D. (1984) Evaluation and decision making for health services programs, NJ: Prentice Hall.
334. Weiss, C. (1972) Evaluation research: Methods for assessing program effectiveness, NJ: Prentice Hall.
335. Weiss, C. (1973) 'Where politics and evaluation research meet', Evaluation, vol 1, no 3, pp 37-45.
336. Weiss, C. (1977) Evaluating action programs: Readings in social action and education, Boston, MA: Allyn and Bacon.
337. Weiss, C. (1978) 'Improving the linkage between social research and public policy', in L.E. Lynn Knowledge and policy: The uncertain connection, WA: National Academy of Science, pp 23-81.
338. Weiss, C. (1979) 'The many meanings of research utilization', in E. Chelimsky (1985) Program evaluation: Patterns and directions, WA: American Society for Public Administration.
339. Weiss, C. (1980) 'Toward the future of stakeholder approaches in evaluation', New Directions for Program Evaluation, vol 1983, no 17, pp 83-90.
340. Weiss, C. (1999) 'The interface between evaluation and public policy', Evaluation, vol 5, no 4, pp 468-86.
341. Weiss, C. and Bucuvalas, M.J. (1980) Social science research and decision making, NY: Columbia Press.
342. Wye, C.G. and Hatry, H.P. (eds) (1988) Timely, low-cost evaluation in the public sector, New directions for program evaluation No 38, American Evaluation Association, San Fransisco, CA: Jossey Bass.
343. Alkin, M.C. and Christie, C.A. (2004) 'An evaluation theory tree', in M.C. Alkin (ed) Evaluation roots: Tracing theorists' views and influences, Thousand Oaks, CA: Sage.
344. Alkin, M.C., Christie, C.A. and Rose, M. (2004) 'Communicating evaluation', in I.A. Shaw, J.C. Greene and M.M. Mark (eds) (2006) Handbook of evaluation: Policies, programs and policies, London: Sage.
345. Ashworth, K., Cebulla, A., Greenberg, D. and Walker, R. (2004) 'Meta-evaluation: discovering what works best in welfare provision', Evaluation, vol 10, no 2, pp 193-216.
346. Bickman, L. (1997) 'Evaluating evaluation: where do we go from here?', Evaluation Practice, vol 18, pp 1-16.
347. Boruch, K. (1997) Randomized experiments for planning and evaluation, Thousand Oaks, CA: Sage.
348. Cabinet Office (1999) Professional policy making for the 21st century, London: Cabinet Office Strategic Policy Making Team.
349. Cabinet Office (2004) Trying it out: review of effectiveness of government pilots, London Cabinet Office.
350. Campbell, D.T. (1969) 'Reforms as experiments', American Psychologist, vol 24 (April), pp 409-29.
351. Campbell, D.T. and Stanley, J.C. (1966) Experimental and quasiexperimental designs for research, Skokie IL: Rand-McNally.
352. Chelimsky, E. (1983) The definition and measurement of quality as a management tool, New Directions for Program Evaluation, Summer vol 18, pp 113-26.
353. Chelimsky, E. (1987) 'What have we learned about the politics of program evaluation?', Evaluation Practice, vol 8, no 1, pp 55-21.
354. Chen, H. (1990) Theory-driven evaluation, Beverly Hills, CA: Sage.
355. Chitty, C. (2000) 'Why pilot?', Paper presented to the Royal Statistical Society Conference, 'The evaluation of economic and social policies', RSS London, 4 July.
356. Chivers T. (2010) The Telegraph, 24 May. Available at http://blogs. telegraph.co.uk/culture/tomchivers/100008226/mmr-autism-scareso- farewell-then-dr-andrew-wakefield/.
357. Clarke A. (1999) Evaluation research: An introduction to principles, methods and practice, London: Sage.
358. Cochrane, A.L. (1972) Effectiveness and efficiency, Nuffield Provincial Hospitals Trust.
359. Cook, T.D., Cooper, H., Cordray, D. and Hartman, H. (1992) Metaanalysis for explanation: A casebook, NY: Russell Sage.
360. Cooksy, L.J and Caracelli, V.J. (2005) 'Quality, context and use: issues in achieving the goals of evaluation', American Journal of Evaluation, vol 26, no 31, pp 31-42.
361. Datta, L.E. (2006) 'The practice of evaluation challenges and New Directions', in F. Shaw, J.C. Greene and M.M. Mark (eds) The Sage handbook of evaluation, Thousand Oaks, CA: Sage, pp 419-38.
362. Davis, P. (2005) 'The limits of realist evaluation: surfacing and exploring assumptions', Evaluation, vol 11, no 3, pp 275-96.
363. Department of the Environment (1992) Policy evaluation: The role of social research, London: HMSO.
364. Donaldson, S.I. and Christie. C.A. (2006) 'Emerging career opportunities in the transdiscipline of evaluation science', in S.I. Donaldson, D.E. Berger and K. Pezdak (eds) Applied psychology: New frontiers and rewarding careers, Mahwah N.J: Erlbaum Associates, pp 243-59.
365. Egger, M. and Smith, G.D. (1997) 'Meta-analysis: principles and procedures', British Medical Journal, vol 315, p 1533.
366. Epstein, I. and Tripodi, T. (1977) Research techniques for program planning, monitoring and evaluation, Columbia: University Press.
367. Fitzgibbon, C.T. and Morris, L.L. (1987) How to design a program evaluation, Beverly Hills, CA: Sage.
368. Fournier, D.M. and Smith, N.L. (1993) 'Clarifying the merits and argument in evaluation practice', Evaluation and Program Planning, vol 16, no 4, pp 315-23.
369. Georghiou, I. (1999) 'Meta-evaluation: evaluation of evaluations', Scientometrics, vol 45, no 3, pp 523-30.
370. Geva-May, I. and Pal, L.A. (1999) 'Good fences make good neighbours: policy evaluation and policy analysis-exploring the differences', Evaluation, vol 5, no 3, pp 259-77.
371. Goldacre, B. (2009) Bad science, London: Fourth Estate.
372. Gomby, D.S. and Larson, C.S. (1992) The future of children, NJ: Princeton University Publishers.
373. Gomm R and Davies C. (eds) (2000) Using evidence in health and social care, London: Sage/The Open University.
374. Gomm, R, Needham, G. and Bullman, A. (eds) (2000) Evaluating research in health and social care, London: Sage.
375. Granger, R.C. (1998) 'Establishing causality in evaluations of comprehensive community initiatives', in K. Fulbright-Anderson, A.C. Kubisch and J.C. Connell (eds) New approaches to evaluating community initiatives, vol 2, 'Theory, measurement and analysis', WA: Aspen Institute.
376. Green, J. and South. J. (2006) Evaluation, Maidenhead: Open University Press.
377. Greene, J.C. (1992) 'A case study of evaluation auditing as metaevaluation', Evaluation and Program Planning, vol 15, pp 71-4.
378. Guba, E.G. and Lincoln, Y.S. (1985) Naturalistic inquiry, Thousand Oaks, CA: Sage.
379. Guba, E.G. and Lincoln, Y.S (1989) Fourth generation evaluation, San Francisco, CA: Jossey Bass.
380. Hansen, H.F. (2005) 'Choosing evaluation models', Evaluation, vol 11, pp 447-61.
381. Haralambos, M. and Holborn, M. (1995) Sociology: Themes and perspectives, London: Collins Educational.
382. Hattie, J.A and Hansford, B.C. (1984) 'Meta-analysis: a reflection on problems', Australian Journal of Psychology, vol 36, no 2, pp 239-54.
383. Hawe, P., Sheill, A. and Riley, T. (2004) 'Complex interventions: how "out of control" can a randomised trial be?', BMJ 328: 7455, pp 1561-63, 26 June.
384. Hogwood, B (1987) From crisis to complacency, Oxford: Oxford University Press.
385. House, E.R. (1980) Stakeholder-based evaluation and value judgments, Beverly Hills, CA; Sage.
386. HM Treasury (1988) Policy evaluation: A guide for managers, London: HMSO.
387. Hurteau, M., Houle, S. and Mongiat, S. (2009) 'How legitimate and justified are judgments in program evaluation?', Evaluation, vol 15, no 3. pp 307-19.
388. Kuhn, T.S. (1962) The structure of scientific revolutions, Chicago: University of Chicago Press.
389. Jacob, S. and Boisvert, Y. (2010) 'To be or not to be a profession: pros, cons and challenges for evaluation', Evaluation, vol 16, no 4, pp 349-69.
390. Lipsey, M.W., Crosse, S., Dunkle, J., Pollard, J. and Stobart, G. (1985) 'Evaluation: the state of the art and the sorry state of the science', in D.S. Cordray (ed) Utilizing prior research in evaluation, New Directions in Evaluation Planning No 27, San Francisco, CA: Jossey Bass, pp 7-28.
391. Madison, A. (2002) Bridging evaluation theory and practice, Lecture to the African Evaluation Association. Available at www.afrea.org/org/ documents/Document.cfm?docID=130.
392. Mark M.M. (2005) 'Evaluation theory or what are evaluation methods for?', The Evaluation Exchange, vol 11, no 2, pp 2-3.
393. Morley S., Eccleston C. and Williams, A. (1999) Systematic review and meta-analysis of randomized controlled trials of cognitive behaviour therapy and behaviour therapy for chronic pain in adults, excluding headache, International Association for the Study of Pain Elsevier Science.
394. Moynihan, A. (2004) Evaluating health services, Milbank Memorial Fund New York.
395. Nutbeam, D. (1998) 'Evaluating health promotion: progress, problems and solutions', Health Promotion International, vol 13, pp 27-43.
396. Orr, L.L. (1999) Social experiments: Evaluating public programs with experimental methods, Thousand Oaks, CA: Sage.
397. Palfrey, C.F. and Thomas, P. (1996) 'Ethical issues in policy evaluation', Policy & Politics, vol 24, no 3, pp 277-86.
398. Patton, M.Q. (1982) Practical evaluation, NY: Sage.
399. Patton, M.Q. (1987) How to use qualitative methods in evaluation, NY: Sage.
400. Pawson, R. (2002a) 'Evidence-based policy: in search of a method', Evaluation, vol 8, no 2, pp 157-81.
401. Pawson, R. (2002b) 'Evidence-based policy: the promise of "realist synthesis"', Evaluation, vol 8, no 3, pp 340-58.
402. Pawson, R. and Tilley, N. (1997) Realistic evaluation, London: Sage.
403. Pedersen, L.H. and Rieper, O. (2008) 'Is realist evaluation a realistic approach to complex reforms?', Evaluation, vol 14, no 3, pp 271-94.
404. Rossi, P.H, Freeman, H.E. and Lipsey, M.W. (1999) Evaluation: A systematic approach, Newbury Park, CA: Sage.
405. Sanderson, I. (2002) 'Evaluation, policy learning and evidence-based policy', Public Administration, vol 80, no 1, pp 1-22.
406. Scriven, M. (1969) 'An introduction to meta-evaluation', Educational Products Report, vol 2, pp 36-8.
407. Scriven, M. (1995) 'The logic of evaluation and evaluation practice', in D.M. Fournier (ed) Reasoning in evaluation: Inferential links and leaps, New Directions for Evaluation No 68, San Francisco, CA: Jossey- Bass, pp 49-70.
408. Schwandt, T.A, and Halpern, E.S. (1988) Linking auditing and metaevaluation, Newbury Park, Beverly Hills, CA: Sage.
409. Shadish, W.R., Cook, T.D. and Leviton, L.D. (1991) Foundations of program evaluation: Theories of practice, Newbury Park, CA: Sage.
410. Shaw, I.A., Greene, J.C. and Mark, M.M. (eds) (2006) Handbook of evaluation: Policies, programmes and practices, London: Sage.
411. Smelser, N.J. (1994) Sociology, Cambridge, MA: Blackwell.
412. Stufflebeam D.L. (1981) 'Meta-evaluation: concepts, standards and uses', in R.A. Beck (ed) Educational evaluation: The state of the art, London: John Hopkins University Press.
413. Stufflebeam, D.L. (2001) 'The metaevaluation imperative', American Journal of Evaluation, vol 22, no 2, pp 183-209.
414. Stufflebeam D.L. and Shinkfield A.J. (2007) Evaluation theory: Models and applications, Boston: Kluwer-Nijhoff.
415. Tilley, N. and Clarke, A. (2006) 'Evaluation in criminal justice', in I.F. Shaw, J.C. Greener and M.M. Mark (eds) Handbook of evaluation London: Sage, pp 512-35.
416. Treasury Board of Canada Secretariat (2004) Review of the quality of evaluations across departments and agencies. Available at www.tbs-sct. gc.ca/cee/pubs/review-examen2004-eng.asp.
417. Van der Knaap, P. (1995) 'Policy evaluation and learning', Evaluation, vol 1, no 2, pp 189-216.
418. Vedung, E (1997) Public policy and program evaluation, New Brunswick, NJ: Transaction.
419. Walker, R. (1997) 'Public policy evaluation in a centralized state: a case study of social assistance in the United Kingdom', Evaluation, vol 3, no 5, pp 261-89.
420. Walker, R. and Wiseman, M. (2006) 'Managing evaluations', in I.A. Shaw, J.C. Greene and M.M. Mark (eds) (2006) Handbook of evaluation: Policies, programmes and practices, London: Sage.
421. Weiss, C. (1972) Evaluation research: Methods for assessing program effectiveness, NJ: Prentice-Hall.
422. Weiss, C. (1995) 'Nothing as practical as good theory', in J. Connell, A. Kubish, H. Schon and C. Weiss (eds) New approaches in evaluating community initiatives, NY: Aspen Institute.
423. Weiss, C. (1999) 'The interface between evaluation and public policy', Evaluation, vol 5, no 2, pp 468-86.
424. Wortman, P.M. (1994) 'Judging research quality', in H. Cooper and L.V. Hodges (eds) The handbook of research synthesis, NY: Russell Sage Foundation, pp 97-110.
425. Cochrane, A. (1972) Effectiveness and efficiency, London: Nuffield Provincial Hospital Trust.
426. Feinstein, O.N. (2002) 'Use of evaluations and evaluation of their use', Evaluation, vol 8, no 4, pp 433-39.
427. Georghiou, L. (1995) 'Assessing the framework programme', Evaluation, vol 1, no 2, pp 171-88.
428. Guba, E. and Lincoln, Y. (1987) 'The countenances of fourth-generation evaluation: description, judgment and negotiation', in D. Palumbo (ed) The politics of program evaluation, CA: Sage.
429. Guba, E. and Lincoln, Y. (1989) Fourth generation evaluation, Newbury Park, CA: Sage.
430. Hart, E. and Bond, M. (1995) Action research for health and social care: A guide to practice, Milton Keynes: Open University.
431. Palfrey, C. and Thomas, P. (1999) 'Politics and policy evaluation', Public Policy and Administration, vol 14, no 4, pp 58-70.
432. Palumbo, D. (1987) 'Politics and evaluation', in D. Palumbo (ed) The politics of program evaluation, California: Sage.
433. Pawson, R. and Tilley, N. (1989) 'What works in evaluation research?', British Journal of Criminology, vol 34, no 3, pp 291-306.
434. Pawson, R. and Tilley, N. (1997) Realistic evaluation, London: Sage.
435. Plottu, B. and Plottu, E. (2009) 'Approaches to participation in evaluation: some conditions for implementation', Evaluation, vol 15, no 3, pp 343-59.
436. Praestgaard, E. (1999) 'Meta-evaluation: evaluation of evaluations', Scientometrics, vol 43, no 3, pp 531-32.
437. Smith, G. and Cantley, C. (1985) Assessing health care: A study in organisational evaluation, Milton Keynes: Open University.
438. Tilley, N. (1996) 'Demonstration, exemplification, duplication and replication in evaluation research', Evaluation, vol 2, no 1, pp 35-50.
439. Walshe, K. (2006) 'Research, evaluation and evidence-based management', in K. Walshe and J. Smith (eds) Healthcare management, Milton Keynes: Open University Press.
440. Weiss, C. (1999) 'The interface between evaluation and public policy', Evaluation, vol 5, no 4, pp 468-86.