Performance measurement of "Knights" and "Knaves": Differences in approaches and Impacts in British countries after devolution

Journal of Comparative Policy Analysis: Research and Practice

Volumn 12, Issue 1-2, 2010, Pages 33-56

  Bevan, Gwyn ^a  

^a UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79960336730     PISSN: 13876988     EISSN: 15725448     Source Type: Journal    
DOI: 10.1080/13876980903076187     Document Type: Article

References (104)

1. Abbasi, Kamran, 1998, Butchers and gropers. British Medical Journal, 317, 1599.
2. Alvarez-Rosete, Arturo, Bevan, Gwyn, Mays, Nicholas and Dixon, Jennifer, 2005, Effects of diverging policy across the NHS. British Medical Journal, 335, 946-950.
3. Anonymous, 2005, Statistics and politics in Britain. Economist, 23 March.
4. Audit Commission, 2003, Waiting List Accuracy (London: The Stationery Office), http://www.auditcommission. gov.uk/nationalstudies/health/other/Pages/waitinglistaccuracy.aspx (accessed 25 February 2010).
5. Audit Commission, 2006, Learning the Lessons from Financial Failure in the NHS (London: The Stationery Office), http://www.audit-commission.gov.uk/nationalstudies/health/financialmanagement/ Pages/financialfailureinthenhs.aspx (accessed 25 February 2010).
6. Auditor General for Wales, 2005a, NHS Waiting Times in Wales. Volume 1-The Scale of the Problem (Cardiff: The Stationery Office), http://www.wao.gov.uk/reportsandpublications/2005.asp (accessed 25 February 2010).
7. Auditor General for Wales, 2005b, NHS Waiting Times in Wales. Volume 2-Tackling the Problem (Cardiff: The Stationery Office), http://www.wao.gov.uk/reportsandpublications/2005.asp (accessed 25 February 2010).
8. Auditor General for Wales, 2006, Is the NHS in Wales Managing within its Available Financial Resources? (Cardiff: The Stationery Office), http://www.wao.gov.uk/reportsandpublications/1015. asp (accessed 25 February 2010).
9. Auditor General for Scotland, 2001, Review of the Management of Waiting Lists in Scotland (Edinburgh: Audit Scotland), http://www.audit-scotland.gov.uk/utilities/search_report.php?id=325 (accessed 25 February 2010).
10. Auditor General for Scotland, 2006, Tackling Waiting Times in the NHS in Scotland (Edinburgh: Audit Scotland), http://www.audit-scotland.gov.uk/utilities/search_report.php?id=237 (accessed 25 February 2010).
11. Barber, Michael, 2007, Instruction to Deliver: Tony Blair, the Public Services and the Challenge of Achieving Targets (London: Politico's).
12. Berliner, Joseph S., 1988, Soviet Industry from Stalin to Gorbachev (Aldershot: Edward Elgar).
13. Berwick, Donald M., Brent, James, and Coye, Molly J., 2003, Connections between quality measurement and improvement. Medical Care, 41(1), I30-I38.
14. Bevan, Gwyn, 2006, Setting targets for health care performance: lessons from a case study of the English NHS. National Institute Economic Review, 197, 67-79.
15. Bevan, Gwyn and Hood, Christopher, 2006a, Have targets improved performance in the English NHS? British Medical Journal, 332, 419-422.
16. Bevan, Gwyn and Hood, Christopher, 2006b, What's measured is what matters: targets and gaming in the English public health care system. Public Administration, 84(3), 517-538.
17. Bevan, Gwyn and Robinson, Ray, 2005, The interplay between economic and political logics: path dependency in health care in England. Journal of Health Politics, Policy and Law, 30(1-2), 53-78.
18. Brindley, Madeleine, 2005, Devastating reality of the Welsh NHS, Western Mail, January 14, http:// icwales.icnetwork.co.uk/0100news/0200wales/tm_objectid=15074968%26method=full%26siteid=50082-name_page.html#story_continue (accessed 25 February 2010).
19. British Medical Association, 2005, BMA Survey of A&E Waiting Times (London: British Medical Association).
20. Campbell, Denis, 2008, Scandal of patients left for hours outside A&E, The Observer, February 17, pp. 1 and 5.
21. Carter, Neil, Klein, Rudolf and Day, Patricia, 1995, How Organisations Measure Success. The Use of Performance Indicators in Government (London: Routledge).
22. Chassin, Mark R., 2002, Achieving and sustaining improved quality: lessons from New York State and cardiac surgery. Health Affairs, 21(4), 40-51.
23. Commission for Health Improvement, 2003a, NHS Performance Ratings. Acute Trusts, Specialist Trusts, Ambulance Trusts 2002/03 (London: The Stationery Office), http://www.chi.nhs.uk/ratings/ (accessed 25 February 2010).
24. Commission for Health Improvement, 2003b, NHS Performance Ratings. Primary Care Trusts, Mental Health Trusts, Learning Disability Trusts 2002/03 (London: The Stationery Office), http://www.chi. nhs.uk/ratings/ (accessed 25 February 2010).
25. Commission for Health Improvement, 2003c, What CHI Has Found In: Ambulance Trusts (London: The Stationery Office).
26. Commission for Health Improvement, 2004, What CHI has Found In: Acute Services (London: The Stationery Office).
27. CRAG, 2002, Clinical Outcome Indicators. A report from the Clinical Outcomes Working Group (Edinburgh: Scottish Executive).
28. Department for Education and Skills, 2004, DfES School and College Achievement and Attainment Tables (formerly Performance Tables) (London: Department for Education and Skills), http://www.dfes. gov.uk/performancetables/
29. Department of Health, 2001, NHS Performance Ratings Acute Trusts 2000/01 (London: Department of Health), http://www.dh.gov.uk/PublicationsAndStatistics/Publications/PublicationsPolicyAndGuidance/ PublicationsPolicyAndGuidanceArticle/fs/en?CONTENT_ID=4003181&chk=wU4Zop
30. Department of Health, 2002a, Hospital Star Ratings System-Franchising of Four Zero Star trusts (London: Department of Health), http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/ @dh/@en/documents/digitalasset/dh_4013782.pdf (accessed 25 February 2010).
31. Department of Health, 2002b, NHS Performance Ratings Acute Trusts, Specialist Trusts, Ambulance Trusts, Mental Health Trusts 2001/02 (London: Department of Health), http://www.dh.gov.uk/Publications AndStatistics/Publications/PublicationsPolicyAndGuidance/PublicationsPolicyAndGuidanceArticle/fs/ en?CONTENT_ID=4002706&chk=dBD1wB (accessed 25 February 2010).
32. Department of Health, 2005a, Chief Executive's Report to the NHS-Statistical Supplement May. Table 3.5.1: Waiting lists for inpatient treatment at year end (London: Department of Health), http://www. dh.gov.uk/assetRoot/04/08/26/27/04082627.pdf (accessed 25 February 2010).
33. Department of Health, 2005b, Healthcare Output and Productivity: Accounting for Quality Change (London: Department of Health), http://www.dh.gov.uk/PublicationsAndStatistics/Publications/ PublicationsPolicyAndGuidance/PublicationsPolicyAndGuidanceArticle/fs/en?CONTENT_ID=41242 66&chk=5QmbY7 (accessed 25 February 2010).
34. Department of Health, 2007, Explaining NHS Deficits-2003/04-2005/06 (London: Department of Health), http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/ DH_065958 (accessed 25 February 2010).
35. Dranove, David, Kessler, Daniel, McClellan, Mark and Satterthwaite, Mark, 2003, Is more information better? The effects of "report cards" on health care providers, Journal of Political Economy, 111, 555-588.
36. Farrar, Shelley, Harris, Fiona, Scott, Tony and McKee, Lorna, 2004, The Performance Assessment Framework: Experiences and Perceptions of NHS Scotland, http://www.scotland.gov.uk/library5/ health/pafr.pdf (accessed 25 February 2010).
37. Ferlie, Ewan, Lynn, Laurence E., Jr., and Pollitt, Christopher (Eds), 2005, The Oxford Handbook of Public Management (New York: Oxford University Press).
38. Friedman, John N. and Kelman, Steven, 2007, Effort as Investment: Analyzing the Response to Incentives. John F. Kennedy School of Government Faculty Research Working Paper Series, No. RWP07-024, Harvard University, http://ksgnotes1.harvard.edu/Research/wpaper.nsf/rwp/RWP07-024 (accessed 25 February 2010).
39. Fung, Constance, H., Lim, Yee-Wei, Mattke, Soeren, Damberg, Cheryl and Shekelle, Paul G., 2008, Systematic review: the evidence that publishing patient care performance data improves quality of care. Annals of Internal Medicine, 148, 111-123.
40. Green, Jesse, and Wintfeld, Neil, 1995, Report cards on cardiac surgeons-assessing New York State's approach. New England Journal of Medicine, 332, 1229-1233.
41. Greer, Scott L., 2004, Four Way Bet: How Devolution has led to Four Different Models for the NHS. Working Paper No. 106, Constitution Unit, School of Public Policy, University College London.
42. Hauck, Katharina and Street, Andrew, 2007, Do targets matter? A comparison of English and Welsh National Health priorities. Health Economics, 16(3), 275-290.
43. Healthcare Commission, 2004, 2004 Performance Ratings (London: Healthcare Commission), http:// ratings2004.healthcarecommission.org.uk/ (accessed 25 February 2010).
44. Healthcare Commission, 2005a, NHS performance ratings 2004/2005 (London: Healthcare Commission), http://ratings2005.healthcarecommission.org.uk/ (accessed 25 February 2010).
45. Healthcare Commission, 2005b, Assessment for Improvement. The Annual Health Check (London: Health Care Commission), http://www.cqc.org.uk/_db/_documents/04016828.pdf (accessed 25 February 2010).
46. Healthcare Commission, 2005c, Performance Ratings Methodology for 2004/05-Acute & Specialist (London: Health Care Commission), http://ratings2005.healthcarecommission.org.uk/more_ information.asp (accessed 25 February 2010).
47. Healthcare Commission, 2005d, Star Ratings Show NHS Improving against Tougher Targets. Press release 27 July (London: Health Care Commission), http://ratings2005.healthcarecommission.org.uk/ more_information.asp (accessed 25 February 2010).
48. Healthcare Commission, 2006, Results of the Annual Health Check 2005/2006 (London: Health Care Commission), http://www.cqc.org.uk/_db/_documents/Performance_ratings_0506.pdf (accessed 25 February 2010).
49. Health of Wales Information Service, 2006, Waiting Times Information, http://www.hsw.wales.nhs.uk/ ipd/Specproc.Htm
50. Hibbard, Judith H., 2008, What can we say about the impact of public reporting? Inconsistent execution yields variable results. Annals of Internal Medicine, 148, 160-161.
51. Hibbard, Judith H., Stockard, Jean, and Tusler, Martin, 2003, Does publicizing hospital performance stimulate quality improvement efforts? Health Affairs, 22(2), 84-94.
52. Hibbard, Judith H., Stockard, Jean, and Tusler, Martin, 2005, Hospital performance reports: impact on quality, market share, and reputation. Health Affairs, 24(4), 1150-1160.
53. Hood, Christopher, 2007, Public service management by numbers: why does it vary? Where has it come from? What are the gaps and the puzzles? Public Money and Management, 27(2), 95-102.
54. Hood, Christopher, James, Oliver, Jones, George, Scott, Colin, and Travers, Tony, 1999, Regulation Inside Government (Oxford: Oxford University Press).
55. Kelman, Steven, 2006, Review of The Oxford Handbook of Public Management. Academy of Management Review, 31(4), 1094-1108.
56. Klein, Rudolf, 1998, Why Britain is reorganising its National Health Service-yet again. Health Affairs, 17(4), 111-125.
57. Klein, Rudolf, 2002, Mr Milburn's good hospital guide. British Medical Journal, 325, 230-231.
58. Klein, Rudolf E., 2006, The New Politics of the National Health Service, 5th edition (Oxford: Radcliffe Press).
59. Kornai, Janos, 1994, Overcentralisation in Economic Administration (Oxford: Oxford University Press).
60. Iezzoni, Lisa, I., 1996, 100 apples divided by 15 red herrings: a cautionary tale from the mid-19th century on comparing hospital mortality rates. Annals of Internal Medicine, 124(12), 1079-1085.
61. Labour Party, 1997, New Labour because Britain Deserves Better (London: Labour Party).
62. Le Grand, Julian, 2003, Motivation, Agency and Public Policy: Of Knights and Knaves, Pawns and Queens (Oxford: Oxford University Press).
63. Leatherman, Sheila and Sutherland, Kim, 2003, The Quest for Quality in the NHS: A Mid-term Evaluation of the Ten-year Quality Agenda (London: The Stationery Office).
64. Macleod, Angus, 2005, McConnell shaken by SNP waiting times attack. The Times, 11 March, http:// www.timesonline.co.uk/tol/news/uk/article424777.ece (accessed 25 February 2010).
65. Mannion, Russell and Goddard, Maria, 2001, Impact of published clinical outcomes data: Case study in NHS hospital trusts. British Medical Journal, 323, 260-263.
66. Mannion, Russell and Goddard, Maria, 2003, Public disclosure of comparative clinical performance data: lessons from the Scottish experience. Journal of Evaluation in Clinical Practice, 9(2), 277-286.
67. Mannion, Russell, Davies, Huw and Marshall, Martin, 2005a, Impact of star performance ratings in English acute hospital organisations. Journal of Health Services Research & Policy, 10(1), 18-24.
68. Mannion, Russell, Davies, Huw and Marshall, Martin, 2005b, Cultures for Performance in Health Care (Maidenhead: McGraw Hill).
69. Marmor, Ted, Freeman, Richard, and Okma, Kieke, 2005, Comparative perspectives and policy. Learning in the world of health care. Journal of Comparative Policy Analysis, 7(4), 331-348.
70. Marshall, Martin, Shekelle, Paul, Brook, Robert, and Leatherman, Sheila, 2000a, Dying to Know: Public Release of Information about Quality of Care (London: The Nuffield Trust).
71. Marshall, Martin, Shekelle, Paul, Brook, Robert, and Leatherman, Sheila, 2000b, The public release of performance data: What do we expect to gain? A review of the evidence. Journal of the American Medical Association, 283(14), 1866-1874.
72. Marshall, Martin N., Shekelle, Paul G., Davies, Huw T.O., and Smith, Peter C., 2003, Public reporting on quality in the United States and the United Kingdom. Health Affairs, 22(3), 134-148.
73. Maynard Alan and Street Andrew, 2006, Seven years of feast, seven years of famine: boom to bust in the NHS? British Medical Journal, 332, 906-908.
74. Mayor, Susan, 2003, Hospitals take short term measures to meet targets. BMJ, 326, 1054.
75. McClelland, Siobhan, 2002, Health policy in Wales-distinctive or derivative? Social Policy and Society, 1, 325-333.
76. McLellan, Alastair, 2003, Millburn secured three stars for PM's trust. Health Service Journal, December 18, 3-5.
77. National Assembly for Wales, 2000, NHS Wales Performance Management Framework. Summary Report (Cardiff: National Assembly for Wales).
78. National Assembly for Wales, 2001, Health Statistics Wales 2001, 6.1 Waiting Lists (a) (Cardiff: National Assembly for Wales).
79. National Assembly for Wales, 2003, The Review of Health and Social Care in Wales (Cardiff: National Assembly for Wales), http://www.wales.nhs.uk/documents/wanless-summary-e.pdf (accessed 25 February 2010).
80. National Assembly for Wales, 2005a, Health Statistics Wales 2005, 6.1 Waiting Lists (a) (Cardiff: National Assembly for Wales), http://wales.gov.uk/topics/statistics/publications/publication-archive/ hsw2005/?lang=en (accessed 25 February 2010).
81. National Assembly for Wales, 2005b, NHS Wales Hospital Waiting Times September 2005 (Cardiff: National Assembly forWales), http://www.cynulliadcymru.org/05-035.pdf (accessed 25 February 2010).
82. National Audit Office, 2001, Inappropriate Adjustments to NHS Waiting Lists (HC 452) (London: The Stationery Office), http://www.nao.gov.uk/publications/nao_reports/01-02/0102452.pdf (accessed 25 February 2010).
83. National Audit Office, 2004, Improving Emergency Care in England (HC 1075) (London: The Stationery Office), http://www.nao.org.uk/publications/nao_reports/03-04/03041075.pdf (accessed 25 February 2010).
84. New York State Department of Health, 2006, Adult Cardiac Surgery in New York State 2002-2004 (New York: New York State Department of Health), http://www.health.state.ny.us/diseases/ cardiovascular/heart_disease/docs/cabg_2002-2004.pdf (accessed 25 February 2010).
85. Nightingale, Florence, 1863, Notes on Hospitals, 3rd edition (London: Longman, Green and co), http:// books.google.co.uk/books?id=k_w5uPm0D-cC&printsec=frontcover&dq="Notes{thorn}on{thorn}Hospitals{thorn}"& source=bl&ots=fwoX3QEkNB&sig=uMHPbdPtMXT3mWFaHgKdYFHjZR0&hl=en&ei=ebWGS7j FGY-RjAfu47nBDw&sa=X&oi=book_result&ct=result&resnum=1&ved=0CAYQ6AEwAA#v=one page&q=&f=false (accessed 25 February 2010).
86. Nove, Alec, 1958, The problem of success indicators in Soviet industry. Economica (New Series) 25(97), 1-13.
87. Powell, Enoch J., 1976, A New Look at Medicine and Politics (London: Pitman Medical).
88. Propper, Carol, Sutton, Matt, Whitnall, Carolyn, and Windmeijer, Frank, 2008, Did "targets and terror" reduce waiting times in England for hospital care? The B.E. Journal of Economic Analysis & Policy, 8(2), Article 5, http://www.bepress.com/bejeap/vol8/iss2/art5
89. Public Administration Select Committee, 2003, Fifth Report on Target? Government by Measurement (HC 62-I) (London: The Stationery Office), http://www.publications.parliament.uk/pa/cm200203/cmselect/ cmpubadm/62/62.pdf
90. Royal College of Physicians, 2006, National Sentinel Stroke Audit (London: Royal College of Physicians).
91. Scott, David, 2001, Waiting lists still being fiddled, says SNP. The Scotsman, December 24, http:// findarticles.com/p/news-articles/scotsman-edinburgh-scotland-the/mi_7951/is_2001_Dec_24/waiting-listsfiddled-snp/ai_n32998778/?tag=content;col1 (accessed 25 February 2010).
92. Scottish Executive Health Department, 2003, Performance Assessment Framework 2003/04, http:// www.show.scot.nhs.uk/sehd/mels/hdl2003_53.pdf (accessed 25 February 2010).
93. Secretaries of State for Health, Wales, Northern Ireland and Scotland, 1989, Working for Patients [CM 555] (London: HMSO).
94. Secretary of State for Health, 1997, The New NHS: Modern, Dependable [CM 3807] (London: The Stationery Office), http://www.dh.gov.uk/PublicationsAndStatistics/Publications/Publications PolicyAndGuidance/PublicationsPolicyAndGuidanceArticle/fs/en?CONTENT_ID=4008869&chk= VT3hrh
95. Secretary of State for Health, 2000, The NHS Plan [CM 4818-I] (London: The Stationery Office), http:// www.dh.gov.uk/PublicationsAndStatistics/Publications/PublicationsPolicyAndGuidance/Publications PolicyAndGuidanceArticle/fs/en?CONTENT_ID=4002960&chk=07GL5R
96. Smith, Peter, 1995, On the unintended consequences of publishing performance data in the public sector. International Journal of Public Administration, 18, 277-310.
97. Smith, Richard, 1998, All changed, changed utterly. British Medical Journal, 316, 1917-1918.
98. Spiegelhalter, David. J., 1999, Surgical audit: statistical lessons from Nightingale and Codman. Journal of the Royal Statistical Society A, 162(1), 45-58.
99. Spiegelhalter, David. J., 2005, The mystery of the lost star. Significance, 2, 150-153.
100. Timmins, Nick, 2006, How the mighty came to fall. British Medical Journal, 332, 628.
101. Tuohy, Carolyn, 1999a, Dynamics of a changing health sphere: the United States, Britain and Canada. Health Affairs, 18(3), 114-134.
102. Tuohy, Carolyn, 1999b, Accidental Logics. The Dynamics of Change in the Health Care Arena in the United States, Britain and Canada (New York: Oxford University Press).
103. UK Centre for the Measurement of Government Activity, 2006, Public service productivity: health. Economic Trends, 628, 26-57, http://www.statistics.gov.uk/downloads/theme_economy/ET628.pdf
104. West, Anne and Pennell, Hazel, 2000, Publishing school examination results in England: incentives and consequences. Educational Studies, 26(4), 423-436.