Hitting and missing targets by ambulance services for emergency calls: Effects of different systems of performance measurement within the UK

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 172, Issue 1, 2009, Pages 161-190

  Bevan, Gwyn ^a,c   Hamblin, Richard ^b  

^a LONDON SCHOOL OF ECONOMICS   (United Kingdom)

^b Healthcare Commission   (United Kingdom)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Ambulance response times; Performance measurement; Star ratings; Targets

Indexed keywords

EID: 57849115761     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2008.00557.x     Document Type: Article

References (153)

1. Abbasi, K. (1998) Butchers and gropers. Br. Med. J., 317, 1599.
2. Allender, S., Peto, V., Scarborough, P., Boxer, A. Rayner, M. (2006) Coronary Heart Disease Statistics. London : British Heart Foundation. (Available from http://www.heartstats.org/temp/Chaptersp1%281%29hs1hs.pdf.)
3. Alvarez-Rosete, A., Bevan, G., Mays, N. Dixon J. (2005) Effect of diverging policy across the NHS. Br. Med. J., 335, 946 950.
4. Audit Commission (2003) Waiting List Accuracy. London : Stationery Office. (Available from http://www.audit-commission.gov.uk/health/index.asp? catId=english^HEALTH.)
5. Audit Commission (2007) Response Times: Great Western Ambulance Service NHS Organisation in Respect of the Former Wiltshire Ambulance Service NHS Organisation. London : Audit Commission. (Available from http://www.audit- commission.gov.uk/pir/downloads/GWAT-PIR-Mar07.pdf.)
6. Auditor General for Scotland (2001) Review of the Management of Waiting Lists in Scotland. Edinburgh : Audit Scotland. (Available from http://www.audit-scotland.gov.uk/publications/pdf/2002/02pf03ag.pdf.)
7. Auditor General for Scotland (2006a) Tackling Waiting Times in the NHS in Scotland. Edinburgh : Audit Scotland. (Available from http://www.audit- scotland.gov.uk/index/05pf13ag.asp.)
8. Auditor General for Scotland (2006b) Scottish Ambulance Service: Report on the 2005/6 Audit. Edinburgh : Audit Scotland. (Available from http://www.audit-scotland.gov.uk/publications/pdf/auditreports/2006/health/ ambulanceservice.pdf.)
9. Auditor General for Wales (2005a) NHS Waiting Times in Wales, vol. 2, Tackling the Problem. Cardiff : Stationery Office. (Available from http://www.wao.gov.uk/reportsandpublications/2005.asp.)
10. Auditor General for Wales (2005b) NHS Waiting Times in Wales, vol. 1, The Scale of the Problem. Cardiff : Stationery Office. (Available from http://www.wao.gov.uk/reportsandpublications/2005.asp.)
11. Auditor General for Wales (2006) Ambulance Services in Wales. Cardiff : Stationery Office. (Available from http://www.wao.gov.uk/assets/ englishdocuments/Ambulance-Inquiry.pdf.)
12. Audit Scotland (2007) Scottish Ambulance Service - Report on the 2006/07 Audit. Edinburgh : Audit Scotland. (Available from http://audit-scotland.gov.uk/ docs/health/2007/fa-0607-ambulance-service.pdf.)
13. Barber, M. (2007) Instruction to Deliver: Tony Blair, the Public Services and the Challenge of Achieving Targets. London : Politico.
14. Berliner, J. S. (1988) Soviet Industry from Stalin to Gorbachev. Aldershot : Elgar.
15. Berwick, D. M., Brent, J. Coye, M. J. (2003) Connections between quality measurement and improvement. Med. Care, 41, I30 I38.
16. Bevan, G. (2006) Setting targets for health care performance: lessons from a case study of the English NHS. Natn. Inst. Econ. Rev., 197, 67 79.
17. Bevan, G. (2008a) Approaches and impacts of different systems of assessing hospital performance. J. Compar. Poly Anal., to be published.
18. Bevan, G. (2008b) Changing paradigms of governance and regulation of quality of healthcare in England. Hlth Risk Soc., 10, 1 17.
19. Bevan, G. Cornwell, J. (2006) Structure and logic of regulation and governance of quality of health care: was OFSTED a model for the Commission for Health Improvement Hlth Econ. Poly Law, 1, 343 370.
20. Bevan, G. Hood, C. (2004) Targets, inspections, and transparency. Br. Med. J., 328, 598.
21. Bevan, G. Hood, C. (2006a) Have targets improved performance in the English NHS Br. Med. J., 332, 419 422.
22. Bevan, G. Hood, C. (2006b) What's measured is what matters: targets and gaming in the English public health care system. Publ. Admin., 84, 517 538.
23. Bevan, G. Robinson, R. (2005) The interplay between economic and political logics: path dependency in health care in England. J. Hlth Polit. Poly Law, 30, 53 78.
24. Bevington, J., Halligan, A. Cullen, R. (2004) From zero to hero. Hlth Serv. J., 29, July, 26 27.
25. Bird, S. M., Cox, D., Farewell, V. T., Goldstein, H., Holt, T. Smith, P. C. (2005) Performance indicators: good, bad, and ugly, J. R. Statist. Soc. A, 168, 1 27.
26. Brown, C. Lilford, R. (2006) Cross sectional study of performance indicators for English Primary Care Trusts: testing construct validity and identifying explanatory variables. BMC Hlth Serv. Res., 6, 81.
27. Burgess, S., Gossage, D. Propper, C. (2003) Explaining differences in hospital performance: does the answer lie in the labour market Working Paper Series 03/091. University of Bristol, Bristol. (Available from http://www.bris.ac.uk/cmpo/workingpapers/wp91.pdf.)
28. Carroll, L. (1975) Alice's adventures in Wonderland. In The Annotated Alice (ed. M. Gardner). Harmondsworth : Penguin.
29. Carter, N., Klein, R. Day, P. (1995) How Organisations Measure Success: the Use of Performance Indicators in Government. London : Routledge.
30. Carvel, J. (2006) Ambulance organisations misreported 999 response times. Guardian Unlimited, Aug. 15th. (Available from http://www.guardian.co.uk/uk- news/story/0,1844679,00.html.)
31. Chassin, M. R. (2002) Achieving and sustaining improved quality: lessons from New York State and cardiac surgery. Hlth Aff., 21, no. 4, 40 51.
32. Clinical Resource and Audit Group (2002) Clinical Outcome Indicators: a Report from the Clinical Outcomes Working Group. Edinburgh: Scottish Executive. (Available from http://www.show.scot.nhs.uk/crag.)
33. Codman, E. A. (1917) Uniformity in hospital morbidity reports. Bost. Med. Surg. J., 177, 279.
34. Commission for Health Improvement (2003a) NHS Performance Ratings: Acute Organisations, Specialist Organisations, Ambulance Organisations 2002/03. London : Stationery Office. (Available from http://ratings2003.healthcarecommission. org.uk/ratings/.)
35. Commission for Health Improvement (2003b) NHS Performance Ratings: Primary Care Organisations, Mental Health Organisations, Learning Disability Organisations 2002/03. London : Stationery Office. (Available from http://ratings2003.healthcarecommission.org.uk/ratings/.)
36. Commission for Health Improvement (2003c) What CHI has Found in: Ambulance Organisations. London : Stationery Office. (Available from http://www.healthcarecommission.org.uk/nationalfindings/nationalthemedreports/ ambulance/ambulancereports.cfm?cit-id=324.)
37. Commission for Health Improvement (2003d) A Summary of the Methodology used for the Analysis of Organisation Response Time Data. London : Commission for Health Improvement. (Available from http://www.healthcarecommission.org.uk/ nationalfindings/nationalthemedreports/ambulance/ambulancereports.cfm?cit-id= 324.)
38. Commission for Health Improvement (2004a) A Commentary on Star Ratings 2002/2003. London : Commission for Health Improvement.
39. Commission for Health Improvement (2004b) What CHI has Found in: Acute Services. London : Stationery Office. (Available from http://www. healthcarecommission.org.uk/NationalFindings/NationalThemedReports/ AcuteAndSpecialist/fs/en.)
40. De Bruijn, H. (2007) Managing Performance in the Public Sector, 2nd edn. London : Routledge.
41. Department for Education and Skills (2004) DfES school and college achievement and attainment tables. Department for Education and Skills, London. (Available from http://www.dfes.gov.uk/performancetables/.)
42. Department of Health (1999a) Ambulance Services, England: 1998-99. London : Department of Health. (Available from http://www.dh.gov.uk/assetRoot/04/02/ 14/73/04021473.pdf.)
43. Department of Health (1999b) Modernisation of ambulance services. Health Service Circular HSC 1999/091. Department of Health, Wetherby.
44. Department of Health (2000) Ambulance Services, England: 1999-2000. London : Department of Health. (Available from http://www.dh.gov.uk/assetRoot/ 04/02/14/73/04021473.pdf.)
45. Department of Health (2001) Ambulance Services, England: 2000-01. London : Department of Health. (Available from http://www.dh.gov.uk/assetRoot/04/02/14/ 73/04021473.pdf.)
46. Department of Health (2002a) Raising Standards across the NHS. London : Department of Health. (Available from http://www.dh.gov.uk/En/ Publicationsandstatistics/Publications/PublicationsPolicyandGuidance/DH-4073513. )
47. Department of Health (2002b) Ambulance Services, England: 2001-02. London : Department of Health. (Available from http://www.dh.gov.uk/ PublicationsAndStatistics/Statistics/StatisticalWorkAreas/StatisticalHealthCare/ StatisticalHealthCareArticle/fs/en?CONTENT-ID=4086490&chk=6NOZfh.)
48. Department of Health (2004) Ambulance Services, England: 2003-04. London : Department of Health. (Available from http://www.dh.gov.uk/ PublicationsAndStatistics/Statistics/StatisticalWorkAreas/StatisticalHealthCare/ StatisticalHealthCareArticle/fs/en?CONTENT-ID=4086490&chk=6NOZfh.)
49. Department of Health (2005) Taking Healthcare to the Patient: Transforming NHS Ambulance Services. London : Department of Health. (Available from http://www.dh.gov.uk/PublicationsAndStatistics/Publications/ PublicationsPolicyAndGuidance/PublicationsPolicyAndGuidanceArticle/fs/en? CONTENT-ID=4114269&chk=bgRnxO.)
50. Department of Health and Social Security (1974) Organisation of ambulance services: standard measures of service and incentive schemes. Health Service Circular (Interim Services) HSC(IS)67. Department of Health and Social Security, London.
51. Donabedian, A. (2005) Evaluating the quality of medical care. Milbnk Q., 83, 691 729.
52. Dranove, D. K., McClellan, D. Satterthwaite, M. (2003) Is more information better?: the effects of 'Report Cards' on health care providers. J. Polit. Econ., 111, 555 588.
53. Enthoven, A. C. (1985) Reflections on the Management of the NHS. London : Nuffield Provincial Hospitals Trust.
54. Enthoven, A. (1999) In Pursuit of an Improving National Health Service. London : Nuffield Trust.
55. Farrar, S., Harris, F., Scott, T. McKee, L. (2004) The Performance Assessment Framework: Experiences and Perceptions of NHSScotland. Aberdeen: University of Aberdeen. (Available from http://www.scotland.gov.uk/library5/ health/pafr.pdf.)
56. Ferlie, E., Lynn, Jr., L. E. Pollitt, C. (eds) (2005) The Oxford Handbook of Public Management. New York : Oxford University Press.
57. Friedman, J. N. Kelman, S. (2007) Effort as investment: analyzing the response to incentives. Working Paper RWP07-024. (Available from http://ssrn.com/abstract=976545.)
58. Fung, C. H., Lim, Y.-W., Mattke, S., Damberg, C. Shekelle, P. G. (2008) Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann. Intern. Med., 148, 111 123.
59. Goldstein, H. Spiegelhalter, D. J. (1996) League tables and their limitations: statistical issues in comparisons of institutional performance (with discussion). J. R. Statist. Soc. A, 159, 385 443.
60. Goodhart, C. A. E. (1984) Monetary Theory and Practice: the UK Experience. London : Macmillan.
61. Green, J. Wintfield, N. (1995) Report cards on cardiac surgeons - assessing New York state's approach. New Engl. J. Med., 332, 1229 1233.
62. Greer, S. (2004) Four way bet: how devolution has led to four different models for the NHS. Constitution Unit, School of Public Policy, University College London, London.
63. Hauck, K. Street, A. (2007) Do targets matter?: a comparison of English and Welsh National Health priorities. Hlth Econ., 16, 275 290.
64. Healthcare Commission (2004) 2004 Performance Rating. London : Stationery Office. (Available from http://ratings2004.healthcarecommission.org.uk/.)
65. Healthcare Commission (2005a) NHS Performance Ratings 2004/2005. London : Healthcare Commission. (Available from http://ratings2005.healthcarecommission. org.uk/.)
66. Healthcare Commission (2005b) Performance Ratings Methodology for 2004/05 - Ambulance. London : Healthcare Commission. (Available from http://ratings2005.healthcarecommission.org.uk/methodology.asp.)
67. Healthcare Commission (2005c) Indicator Listings for Ambulance Organisations. London : Healthcare Commission. (Available from http://ratings2005.healthcarecommission.org.uk/Organisation/Indicator/ indicators.asp?organisationType=2.)
68. Healthcare Commission (2007) New National Target Indicators for Ambulance Trusts. London : Healthcare Commission. (Available from http://www. healthcarecommission.org.uk/nationaltargets2007 - 2008/newnationaltargets/ ambulancetrusts/indicators.cfm.)
69. Health and Social Care Information Centre (2005) Ambulance Services, England: 2004-05. London : Department of Health. (Available from http://www.dh.gov.uk/PublicationsAndStatistics/Statistics/StatisticalWorkAreas/ StatisticalHealthCare/StatisticalHealthCareArticle/fs/en?CONTENT-ID= 4086490&chk=6NOZfh.)
70. Heath, G. Radcliffe, J. (2007) Performance measurement and the English ambulance service. Publ. Mon. Mangmnt, 27, 223 228.
71. Hibbard, J. H. (2008) What can we say about the impact of public reporting?: inconsistent execution yields variable results. Ann. Intern. Med., 148, 160 161.
72. Hibbard, J. H. Jewett, J. J. (1997) Will quality report cards help consumers Hlth Aff., 16, 218 228.
73. Hibbard, J. Pawlson, L. G. (2004) Why not give consumers a framework for understanding quality Jt Commssn J. Qual. Patnt Safty, 30, 347 351.
74. Hibbard, J. H., Peters, E., Dixon, A. Tusler, M. (2007) Consumer competencies and the use of comparative quality information: it isn't just about literacy. Med. Care Res. Rev., 64, 379 394.
75. Hibbard, J. H., Peters, E., Slovic, P., Finucane, M. L. Tusler, M. (2001) Making health care quality reports easier to use. Jt Commssn J. Qual. Patnt Safty, 27, 591 604.
76. Hibbard, J. H., Slovic, P., Jacquelyn, J. Jewett, J. J. (1997) Informing consumer decisions in health care: implications from decision-making research. Milbnk Q., 75, 395 414.
77. Hibbard, J. H., Slovic, P., Peters, E. Finucane, M. L. (2002) Strategies for reporting health plan performance information to consumers: evidence from controlled studies. Hlth Serv. Res., 37, 291 313.
78. Hibbard, J. H., Sofaer, S. Jewett, J. J. (1996) Condition-specific performance information: assessing salience, comprehension, and approaches for communicating quality. Hlth Care Finan. Rev., 18, 95 109.
79. Hibbard, J. H., Stockard, J. Tusler, M. (2003) Does publicizing hospital performance stimulate quality improvement efforts Hlth Aff., 22, 84 94.
80. Hibbard, J. H., Stockard, J. Tusler, M. (2005a) It isn't just about choice: the potential of a public performance report to affect the public image of hospitals. Med. Care Res. Rev., 62, 358 371.
81. Hibbard, J. H., Stockard, J. Tusler, M. (2005b) Hospital performance reports: impact on quality, market share, and reputation. Hlth Aff., 24, 1150 1160.
82. Holmstrom, B. Milgrom, P. (1991) Multi-task principal-agent analyses: linear contracts, asset ownership and job design. J. Law Econ. Organisn, 7, 24 52.
83. Hood, C. (2006) Gaming in targetworld: the targets approach to managing British public services. Publ. Admin. Rev., 66, 515 521.
84. Hood, C. (2007) Public service management by numbers: why does it vary?; where has it come from?; what are the gaps and the puzzles Publ. Mon. Mangmnt, 27, 95 102.
85. Horton, R. (2004) Why is Ian Kennedy's Healthcare Commission damaging NHS care Lancet, 364, 401 402.
86. House of Commons Public Administration Select Committee (2002) Minutes of evidence for Thursday 21 November 2002: Staffordshire Ambulance Service; Local Government Association; Patients Association. Questions 142-230. (Available from http://www.publications.parliament.uk/pa/cm200203/cmselect/cmpubadm/62 -ii/2112101.htm.)
87. House of Commons Public Administration Select Committee (2003) Fifth Report: on Target?; Government by Measurement. London : Stationery Office. (Available from http://www.publications.parliament.uk/pa/cm200203/cmselect/ cmpubadm/62/62.pdf.)
88. Iezzoni, L. I. (1996) 100 apples divided by 15 red herrings: a cautionary tale from the mid-19th century on comparing hospital mortality rates. Ann. Intern. Med., 124, 1079 1085.
89. Information Centre (2007) Ambulance Services, England 2006-07. Leeds : Information Centre. (Available from http://www.ic.nhs.uk/statistics-and-data- collections/audits-and-performance/ambulance/ambulance-services-england-2006-07. )
90. Jacobs, R. Goddard, M. (2007) How do performance indicators add up?: an examination of composite indicators in public services. Publ. Mon. Mangmnt, 27, 103 110.
91. Jacobs, R., Martin, S., Goddard, M., Gravelle, H. Smith, P. (2006) Exploring the determinants of NHS performance ratings: lessons for performance assessment systems. J. Hlth Serv. Res. Poly, 11, 211 217.
92. Jacobs, R. Smith, P. (2004) A descriptive analysis of general acute Trust star ratings. Working Paper 189. Centre for Health Economics, University of York, York. (Available from http://www.york.ac.uk/inst/che/pdf/dp189.pdf.)
93. James, O. (2004) The UK core executive's use of Public Service Agreements as a tool of governance. Publ. Admin., 82, 397 419.
94. Kelman, S. (2006) Review of 'The Oxford Handbook of Public Management'. Acad. Mangmnt Rev., 31, 1094 1108.
95. Kelman, S. Friedman, J. N. (2007) Performance improvement and performance dysfunction: an empirical examination of impacts of the emergency room wait-time target in the English National Health Service. Working Paper RWP07-034. Kennedy School of Government, Cambridge. (Available from http://ssrn.com/abstract=976553.)
96. Klein, R. (2002) Mr Milburn's good hospital guide. Br. Med. J., 325, 230 231.
97. Kornai, J. (1994) Overcentralisation in Economic Administration. Oxford : Oxford University Press.
98. Le Grand, J. (2003) Motivation, Agency and Public Policy: of Knights and Knaves, Pawns and Queens. Oxford : Oxford University Press.
99. Mannion, R. Davies, H. T. O. (2002) Reporting health care performance: learning from the past, prospects for the future. J. Evaln Clin. Pract., 8, 215 228.
100. Mannion, R., Davies, H. Marshall, M. (2005a) Impact of star performance ratings in English acute hospital organisations. J. Hlth Serv. Res. Poly, 10, 18 24.
101. Mannion, R., Davies, H. Marshall, M. (2005b) Cultures for Performance in Health Care. Maidenhead : McGraw Hill.
102. Mannion, R. Goddard, M. (2001) Impact of published clinical outcomes data: case study in NHS hospital organisations. Br. Med. J., 323, 260 263.
103. Mannion, R. Goddard, M. (2002) Performance measurement and improvement in health care. Appl. Hlth Econ. Hlth Poly, 1, 13 23.
104. Mannion, R. Goddard, M. (2003) Public disclosure of comparative clinical performance data: lessons from the Scottish experience. J. Evaln Clin. Pract., 9, 277 286.
105. Mannion, R., Goddard, M., Kuhn, M. Bate, A. (2005c) Decentralisation strategies and provider incentives in healthcare: evidence from the English National Health Service. Appl. Hlth Econ. Hlth Poly, 4, 47 54.
106. Marshall, M., Shekelle, P., Brook, R. Leatherman, S. (2000) Dying to Know: Public Release of Information about Quality of Care. London : Nuffield Organisation.
107. Marshall, M., Shekelle, P., Davies, H. Smith, P. (2003) Public reporting on quality in the United States and the United Kingdom. Hlth Aff., 22, 134 148.
108. Marshall, M. N., Shekelle, P. G. Leatherman, S. Brook, R. H. (2000) The Public release of performance data: what do we expect to gain?; a review of the evidence. J. Am. Med. Ass., 283, 1866 1874.
109. Marshall, E. C. Spiegelhalter, D. J. (1998) Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates. Br. Med. J., 316, 1701 1704.
110. Mays, N. (2006) Use of targets to improve health system performance: should New Zealand follow the successful lead of the English NHS Publ. Sect., 29, no. 2, 7 15.
111. National Assembly for Wales (2001) General notes for chapter 12: patient transport services. Health Statistics Wales 2001. Cardiff : National Assembly for Wales. (Available from http://new.wales.gov.uk/legacy-en/ keypubstatisticsforwales/content/publication/health/2002/hsw2001/ hsw2001-intro-e.htm.)
112. National Assembly for Wales (2005) Patient Transport Services. In Health Statistics Wales 2006, ch. 13. Cardiff : National Assembly for Wales. (Available from http://new.wales.gov.uk/legacy-en/keypubstatisticsforwales/content/ publication/health/2005/hsw2006/hsw2006-ch13/hsw2006-ch13.htm.)
113. National Audit Office (1999) The Scottish Ambulance Service: a Service for Life. London : Stationery Office. (Available from http://www.nao.org.uk/ publications/nao-reports/se1999-54.pdf.)
114. National Audit Office (2001a) Inpatient and Outpatient Waiting in the NHS. London : Stationery Office. (Available from http://www.nao.org.uk/ publications/nao-reports/01-02/0102221.pdf.)
115. National Audit Office (2001b) Inappropriate Adjustments to NHS Waiting Lists. London : Stationery Office. (Available from http://www.nao.org.uk/ publications/nao-reports/01-02/0102452.pdf.)
116. National Audit Office (2004) Improving Emergency Care in England. London : Stationery Office. (Available from http://www.nao.org.uk/publications/nao- reports/03-04/03041075.pdf.)
117. National Health Service Executive (1996) Review of Ambulance Service Standards: Final Report of the Steering Group. Leeeds : National Health Service Executive.
118. New York State Department of Health (2006) Adult Cardiac Surgery in New York State 2002-2004. New York : New York State Department of Health. (Available from http://www.health.state.ny.us/diseases/cardiovascular/heart-disease/docs/ cabg-2002-2004.pdf.)
119. Nightingale, F. (1863) Notes on Hospitals, 3rd edn. London : Longman, Green.
120. Nove, A. (1958) The problem of success indicators in Soviet industry. Economica, new ser., 25, 1 13.
121. Office for National Statistics (2004) Table 7.15 ' NHS Hospital Waiting lists: by patients' region of residence, at 31 March 2003'. Regl Trends, no. 38. Office for National Statistics, London.
122. Patel, B., Chaussalet, T. Millard P. (2008) Balancing the NHS balanced scorecard Eur. J. Oper. Res., 185, 905 914.
123. Pell, J. P., Sirel, J. M., Marsden, A. K., Ford, I. Cobbe, S. M. (2001) Effect of reducing ambulance response times on deaths from out of hospital cardiac arrest: cohort study. Br. Med. J., 322, 1385 1388.
124. Peters, E., Dieckmann, N., Dixon, A., Hibbard, J. H. Mertz, C. K. (2007) Less is more in presenting quality information to consumers. Med. Care Res. Rev., 64, 169 190.
125. Propper, C., Sutton, M., Whitnall, C. Windmeijer, F. (2008) Did 'targets and terror' reduce waiting times in England for hospital care J. Econ. Anal. Poly, 8, no. 2, article 5. (Available from http://www.bepress.com/bejeap/vol8/ iss2/art5.)
126. Riddell, P. (2005) The Unfulfilled Prime Minister: Tony Blair's Quest for a Legacy. London : Politico.
127. Rooker, Lord (2006) Ambulance Service: Northern Ireland. Lords Hansard, Dec. 13th. (Available from http://www.publications.parliament.uk/pa/ld200607/ ldhansrd/text/61213w0001.htm.)
128. Rowan, K., Harrison, D., Brady, A. Black, N. (2004) Hospitals' star ratings and clinical outcomes: ecological study. Br. Med. J., 328, 924 925.
129. Royce, R. G. (1995) Observations on the NHS internal market: will the dodo get the last laugh Br. Med. J., 311, 431 433.
130. Schneider, E. C. Epstein, A. M. (1996) Influence of cardiac-surgery performance reports on referral practices and access to care - a survey of cardiovascular specialists. New Engl. J. Med., 335, 251 256.
131. Scottish Ambulance Service (2004) Your Story: 2003-2004 Annual Report. Edinburgh : Scottish Ambulance Service. (Available from http://www. scottishambulance.com/docs/Annual%20Report%202003-2004.pdf.)
132. Schulze, C. L. (1977) The Public Use of Private Interest. Washington DC : Brookings.
133. Secretary of State for Health (2000) The NHS plan. CM 4818-I. London : Stationery Office. (Available from http://www.dh.gov.uk/ PublicationsAndStatistics/Publications/PublicationsPolicyAndGuidance/ PublicationsPolicyAndGuidanceArticle/fs/en?CONTENT-ID=4002960&chk=07GL5R.)
134. Secretary of State for Health (2001) NHS Performance Ratings Acute Organisations 2000/01. London : Department of Health. (Available from http://www.dh.gov.uk/PublicationsAndStatistics/Publications/ PublicationsPolicyAndGuidance/PublicationsPolicyAndGuidanceArticle/fs/en? CONTENT-ID=4003181&chk=wU4Zop.)
135. Secretary of State for Health (2002) NHS Performance Ratings Acute Organisations, Specialist Organisations, Ambulance Organisations, Mental Health Organisations 2001/02. London : Department of Health. (Available from http://www.dh.gov.uk/PublicationsAndStatistics/Publications/ PublicationsPolicyAndGuidance/PublicationsPolicyAndGuidanceArticle/fs/en? CONTENT-ID=4002706&chk=dBD1wB.)
136. Smith, P. (1995) On the unintended consequences of publishing performance data in the public sector. Int. J. Publ. Admin., 18, 277 310.
137. Smith, P. C. (2002) Performance management in British Health Care: will it deliver Hlth Aff., 21, no. 3, 103 115.
138. Smith, P. C. (2005) Performance measurement in health care: history, challenges and prospects. Publ. Mon. Mangmnt, 25, 213 220.
139. Smith, R. (1998) All changed, changed utterly. Br. Med. J., 316, 1917 1918.
140. Snelling, I. (2003) Do star ratings really reflect hospital performance J. Hlth Organsn Mangmnt, 17, 210 223.
141. Spiegelhalter, D. J. (1999) Surgical audit: statistical lessons from Nightingale and Codman. J. R. Statist. Soc. A, 162, 45 58.
142. Spiegelhalter, D. (2005a) The mystery of the lost star: a statistical detective story. Significance, 2, 150 153.
143. Spiegelhalter, D. J. (2005b) Funnel plots for comparing institutional performance. Statist. Med., 24, 1185 1202.
144. Stevens, S. (2004) Reform strategies for the English NHS. Hlth Aff., 23, no. 3, 37 44.
145. Stevens, P. A., Stokes, L. O'Mahony, M. (2006) Metrics, targets and performance. Natn. Inst. Econ. Rev., 197, 80 92.
146. Sutherland, K. Leatherman, S. (2006) Regulation and Quality Improvement: a Review of the Evidence. London : Health Foundation. (Available from http://212.72.48.4/QQUIP/Sites/Files/0000021535-QEI-regulation-report.pdf.)
147. Tuohy, C. (1999) Accidental Logics: the Dynamics of Change in the Health Care Arena in the United States, Britain and Canada. New York : Oxford University Press.
148. Welsh Assembly Government (2007a) NHS Wales: Annual Operating Framework 2008/2009. Cardiff : Welsh Assembly Government. (Available from http://new.wales.gov.uk/topics/health/publications/whcs/2007/whc2007086?lang=en. )
149. Welsh Assembly Government (2007b) Ambulance Services in Wales: 1 January-31 March 2007 (revised). Cardiff : Welsh Assembly Government. (Available from http://new.wales.gov.uk/topics/statistics/headlines/health-2007/ hdw200705301/?lang=en.)
150. West, A. Pennell, H. (2000) Publishing school examination results in England: incentives and consequences. Educ. Stud., 26, 423 436.
151. Whitfield, L. (2004) DoH urged to get tough over Sun blast. Hlth Serv. J., Oct. 18th, 4. Tu, J. V. (2007) Measuring and reducing waiting times: a cross-national comparison of strategies. Hlth Aff., 26, 1078 1087.
152. Wolf, C. (1993) Markets or Governments. Cambridge : MIT Press.
153. Woodham-Smith, C. (1970) Florence Nightingale. London : Fontana.