Performance measurement and the UK emergency ambulance service: Unintended consequences of the ambulance response time targets

International Journal of Public Sector Management

Volumn 24, Issue 5, 2011, Pages 384-402

  Wankhade, Paresh ^a  

^a LIVERPOOL HOPE UNIVERSITY   (United Kingdom)

Author keywords

Ambulances; National Health Service; Performance measures; Perversity; Response time targets; Unintended consequences

Indexed keywords

EID: 79959778560     PISSN: 09513558     EISSN: None     Source Type: Journal    
DOI: 10.1108/09513551111147132     Document Type: Article

References (66)

1. Adcroft, A. and Willis, R. (2005), “The (un)intended outcome of public sector performance measurement”, International Journal of Public Sector Management, Vol. 18 No. 5, pp. 386–400.
2. Atkinson, A.A. and McCrindell, J.Q. (1997), “Strategic performance measurement”, C.M.A. Magazine, April, pp. 20–3.
3. Audit Commission (1998), A Life in the Fast Lane: Value for Money in Emergency Ambulance Services, Audit Commission, London.
4. Audit Commission (2000), On Target: The Practice of Performance Indicators, Audit Commission, London.
5. Bevan, G. and Hamblin, R. (2009), “Hitting and missing targets by ambulance services for emergency calls: effects of different systems of performance measurement within the UK”, Journal of the Royal Statistical Society, No. 172 Part 1, pp. 161–90.
6. Bevan, G. and Hood, C. (2006), “What's measured is what matters: targets and gaming in the English public health care system”, Public Administration, Vol. 84 No. 3, pp. 517–38.
7. Berman, E. (2002), “How useful is performance measurement?”, Public Performance & Management Review, Vol. 25 No. 4, pp. 348–51.
8. Bird, S., Cox, M.D., Farewell, V.T., Goldstein, H., Holt, T. and Smith, P.C. (2005), “Performance indicators: good, bad, and ugly”, Journal of the Royal Statistical Society, Series A, Vol. 168 No. 1, pp. 1–27.
9. Blackwell, T. and Kaufman, J. (2002), “Response tie effectiveness: comparison of response tie and survival in an emergency medical services system”, Academic Emergency Medicine, Vol. 9 No. 4, pp. 288–95.
10. Brown, L., Whitney, C., Hunt, R., Addario, M. and Hogue, T. (2000), “Do warning lights and sirens reduce ambulance response times?”, Prehospital Emergency Care, Vol. 4 No. 1, pp. 70–4.
11. Commission for Health Improvement (2003), “What CHI has found in ambulance trusts”, available at: www.healthcarecommission.org.uk/NationalFindings/NationalThemedReports/Ambulance/fs/en (accessed 15 June 2006).
12. Cooper, S. (2005), “Contemporary UK paramedical training and education. How do we train? How should we educate?”, Emergency Medicine Journal, Vol. 22 No. 5, pp. 375–9.
13. Currie, G., Waring, J. and Finn, R. (2008), “The limits of knowledge management for UK public services modernization: the case of patient safety and service quality”, Public Administration, Vol. 86 No. 2, pp. 363–85.
14. De Bruijn, H. (2002), “Performance measurement in the public sector: strategies to cope with the risks of performance management”, International Journal of Public Sector Management, Vol. 15 No. 7, pp. 578–94.
15. De Bruijn, H. (2007), Managing Performance in the Public Sector, Routledge, London.
16. Department of Health (2000), Coronary Heart Disease: National Service Framework – Modern Standards and Service Models, Department of Health, London.
17. Department of Health (2001), Reforming Emergency Care: First Steps to a New Approach, Department of Health, London.
18. Department of Health (2005), Taking Healthcare to the Patient; Transforming NHS Ambulance Services, Department of Health, London.
19. drFoster intelligence (2006), The Intelligent Ambulance Board, available at: www.drfosterintelligence.co.uk/library/localDocuments/ambulanceReport2006.pdf (accessed 16 March 2007).
20. Dyer, G.W. and Wilkins, A.Q.L. (1991), “Better stories. Not better constructs – to generate better theory: a rejoinder to Eisenhardt”, Acacdemy of Management Review, Vol. 16 No. 3, pp. 613–19.
21. Eisenhardt, K.M. (1989), “Building theories from case study research”, Academy of Management Review, Vol. 14 No. 4, pp. 532–50.
22. Fitch, J. (2005), “Response times: myths, measurement and management”, Journal of Emergency Medical Services, Vol. 30 No. 9, pp. 50–8, available at: www.jems.com/jems/30-9/13246/ (accessed 27 February 2007).
23. Goddard, M., Mannion, R. and Smith, P. (2000), “Enhancing performance in health care: a theoretical perspective on agency and role of information”, Health Economics, Vol. 9 No. 2, pp. 95–107.
24. Goldstein, H. and Spiegelhalter, D.J. (1996), “League tables and their limitations: statistical issues in comparisons of institutional performance (with discussion)”, Journal of Royal Statistical Society, Vol. A No. 159, pp. 385–443.
25. Greiling, D. (2006), “Performance measurement: a remedy for increasing the efficiency of public services?”, International Journal of Productivity and Performance Management, Vol. 55 No. 6, pp. 448–65.
26. Halter, M., Marlow, T., Tye, C. and Ellison, G.T.H. (2006), “Patients' experiences of care provided by emergency care practitioners and traditional practitioners: a survey from the London Ambulance Service”, Emergency Medicine Journal, Vol. 23, pp. 865–6.
27. Hauswald, M. (2002), “Can paramedics safely decide which patients do not need ambulance transport or emergency department care?”, Prehospital Emergency Care, Vol. 6 No. 4, pp. 383–6.
28. Heath, G. and Radcliffe, J. (2007), “Performance measurement and the English ambulance service”, Public Money and Management, Vol. 27 No. 3, pp. 223–7.
29. Hibbard, J.H., Stockard, J. and Tusler, M. (2003), “Does publicizing hospital performance stimulate quality improvement efforts?”, Health Affairs, Vol. 22 No. 2, pp. 84–94.
30. Holloway, J., Francis, G. and Hinton, M. (1999), “A vehicle for change? A case study of performance improvement in the ‘new’ public sector”, International Journal of Public Sector Management, Vol. 12 No. 4, pp. 351–65.
31. Jackson, P. (1988), “The management of performance in the public sector”, Public Money & Management, Vol. 8 No. 4, pp. 11–16.
32. Jacobs, R., Smith, P.C. and Street, A. (2006), Measuring Efficiency in Health Care, Cambridge University Press, Cambridge.
33. Johnsen, A. (2005), “What does 25 years of experience tell us about the state of performance measurement in public management and policy?”, Public Money and Management, Vol. 25 No. 1, pp. 9–17.
34. Kamper, M., Mahoney, B.D., Nelson, S. and Peterson, J. (2001), “Feasibility of paramedic treatment and referral of minor illness and injuries”, Prehospital Emergency Care, Vol. 5 No. 4, pp. 371–8.
35. Lapsley, I. (2008), “The NPM agenda: back to the future?”, Financial Accountability & Management, Vol. 24 No. 1, pp. 77–96.
36. Lapsley, I. and Mitchell, F. (Eds) (1996), Accounting and Performance Measurement. Issues in the Private and Public Sectors, Paul Chapman Publishing, London.
37. Lendrum, K., Wilson, S. and Cooke, M.W. (2000), “Does the training of ambulance personnel match the workload seen?”, Pre-hospital Immediate Care, Vol. 4 No. 1, pp. 7–10.
38. Likierman, A. (1993), “Performance indicators: 20 early lessons from managerial use”, Public Money & Management, Vol. 13 No. 4, pp. 15–22.
39. McNulty, T. and Ferlie, E. (2002), Re-engineering Health Care: The Complexities of Organizational Transformation, Oxford University Press, Oxford.
40. Mannion, R., Davies, H. and Marshall, M. (2005), Cultures for Performance in Health Care, Open University Press, Milton Keynes.
41. Marks, P., Daniel, T., Afolabi, O., Spiers, G. and Nguyen-Van-Tam, J. (2002), “Emergency (999) calls to the ambulance service that do not result in the patient being transported to hospital: an epidemiological study”, Emergency Medicine Journal, Vol. 19 No. 5, pp. 449–52.
42. Mason, S., O'Keeffe, C., Coleman, P., Edlin, R. and Nicholl, J. (2007), “Effectiveness of emergency care practitioners within existing emergency service models of care”, Emergency Medicine Journal, Vol. 24 No. 4, pp. 239–43.
43. Meyer, J.W. (2002), Rethinking Performance Measurement, Cambridge University Press, Cambridge.
44. Meyer, M.W. and Gupta, V. (1994), “The performance paradox”, Research in Organizational Behaviour, Vol. 16 No. 4, pp. 309–69.
45. Miles, M. and Huberman, M. (1994), Qualitative Data Analysis: An Expanded Sourcebook, Sage, Thousand Oaks, CA.
46. Modell, S. (2004), “Performance measurement myths in the public sector: a research note”, Financial Accountability & Management, Vol. 20 No. 1, pp. 39–56.
47. Nicholl, J., West, J., Goodacre, S. and Turner, J. (2007), “The relationship between distance to hospital and patient mortality in emergencies: an observational study”, Emergency Medicine Journal, Vol. 24 No. 9, pp. 665–8.
48. Osborne, D. and Gaebler, T. (1993), Reinventing Government: How the Entrepreneurial Spirit Is Transforming the Public Sector, Penguin Books, New York, NY.
49. Pell, J.P., Sirel, J.M., Marsden, A.K., Ford, I. and Stuart, M.C. (2001), “Effect of reducing ambulance response times on deaths from out of hospital cardiac arrest: cohort study”, British Medical Journal, Vol. 322 No. 7299, pp. 1385–8.
50. Pollitt, C. and Bouckaert, G. (2000), Public Management Reform: A Comparative Analysis, Oxford University Press, Oxford.
51. Pons, P.T. and Markovchick, V.J. (2002), “Eight minutes or less: does the ambulance response time guideline impact trauma patient outcome?”, Journal of Emergency Medicine, Vol. 23 No. 1, pp. 43–8.
52. Price, L. (2006), “Treating the clock and not the patient: ambulance response times and risk”, Quality & Safety in Health Care, Vol. 15 No. 2, pp. 127–30.
53. Radcliffe, J. and Heath, G. (2009), “Ambulance calls and cancellations: policy and implementation issues”, International Journal of Public Sector Management, Vol. 22 No. 5, pp. 410–22.
54. Smith, P.C. (1995), “On the unintended consequences of publishing performance data in the public sector”, International Journal of Public Administration, Vol. 18 Nos 2/3, pp. 277–310.
55. Smith, P.C. (2005), “Performance measurement in health care: history, challenges and prospects”, Public Money and Management, Vol. 26 No. 4, pp. 213–20.
56. Snooks, H., Williams, S., Crouch, R., Foster, T., Hartley-Sharpe, C. and Dale, J. (2002), “NHS emergency response to 999 calls: alternatives for cases that are neither life-threatening nor serious”, British Medical Journal, Vol. 325 No. 9359, pp. 330–3.
57. Snooks, H., Evans, A., Wells, B., Peconi, J., Thomas, M., Woollard, M., Guly, H., Jenkinson, E., Turner, J. and Hartley-Sharpe, C. (2009), “What are the highest priorities for research in emergency prehospital care?”, Emergency Medicine Journal, Vol. 26 No. 2, pp. 549–50.
58. Squires, J.P. and Mason, S. (2004), “Developing alternative ambulance response schemes: analysis of attitudes, barriers, and change”, Emergency Medicine Journal, Vol. 21 No. 6, pp. 724–7.
59. Strauss, A. and Corbin, J. (1998), Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, Sage, Thousand Oaks, CA.
60. Turner, J., O'Keeffe, C., Dixon, S., Warren, K. and Nicholl, J. (2006), The Costs and Benefits of Changing Ambulance Service Response Time Performance Standards: Final Report, Medical Care Research Unit, University of Sheffield, available at: www.shef.ac.uk/content/1/c6/07/96/92/MCRU%20ambrespperf%202006.pdf (accessed 20 July 2006).
61. Walshe, K. and Sheldon, T.A. (1998), “Dealing with clinical risk: implications of the rise of evidence-based health care”, Public Money and Management, Vol. 18 No. 4, pp. 15–20.
62. Wankhade, P. (2007a), “An exploration of the relationships and tensions between management and measurement of performance in an English NHS (Ambulance) Trust: a case study”, paper presented at the 11th International Research Symposium on Public Management (IRSPM XI), Potsdam University, Germany, 2-4 April.
63. Wankhade, P. (2007b), “Exploration of relationship between organisational culture and performance in emergency health services: an ethnographic perspective of an NHS ambulance service”, paper presented at the 2nd Symposium on Current Developments in Ethnographic Research in the Social and Management Sciences, Keele University, UK, 6-7 September 2007.
64. Wankhade, P. (2008), “Unintended performance paradox and dysfunctional behaviour in the public sector: evidence from NHS Ambulance service in England”, paper presented at the Performance Management Track, British Association of Management (BAM) Conference, Harrogate, 9-11 September.
65. Yin, R.K. (2003), Case Study Research: Design and Methods, Sage, Thousands Oaks, CA.
66. Ambulance Service Association (2000), The Future of Ambulance Services in the United Kingdom: A Strategic Review of Options for the Future of Ambulance Services, Medical Care Research Unit, The University of Sheffield, Sheffield (on behalf of the Ambulance Service Association).