Proposed standards for the design and conduct of a national clinical audit or quality improvement study

International Journal for Quality in Health Care

Volumn 25, Issue 4, 2013, Pages 357-365

  Dixon, Nancy ^a  

^a Healthcare Quality Quest Ltd   (United Kingdom)

Author keywords

Clinical audit; National clinical audit; National performance indicator measurement; National quality improvement study; National quality indicator monitoring

Indexed keywords

ARTICLE; GOOD CLINICAL PRACTICE; HEALTH CARE QUALITY; HEALTH CARE SYSTEM; HEALTH SERVICE; HUMAN; MEDICAL AUDIT; PATIENT CARE; PERFORMANCE; PRIORITY JOURNAL; STANDARD; TOTAL QUALITY MANAGEMENT;

CLINICAL AUDIT; NATIONAL CLINICAL AUDIT; NATIONAL PERFORMANCE INDICATOR MEASUREMENT; NATIONAL QUALITY IMPROVEMENT STUDY; NATIONAL QUALITY INDICATOR MONITORING;

CLINICAL AUDIT; HEALTH SERVICES RESEARCH; HUMANS; QUALITY IMPROVEMENT; QUALITY INDICATORS, HEALTH CARE; RESEARCH DESIGN;

EID: 84881092139     PISSN: 13534505     EISSN: 14643677     Source Type: Journal    
DOI: 10.1093/intqhc/mzt037     Document Type: Article

References (78)

1. National Institute for Clinical Excellence. Principles for best practice in clinical audit. Abingdon: Radcliffe Medical Press, 2002.
2. Amess M, Walshe K, Shaw C et al. The audit activities of the medical royal colleges and their faculties in England. London: CASPE Research, 1995.
3. National Clinical Audit and Patient Outcomes Programme. http://www.hqip.org.uk/national-clinical-audit-and-patient-outcomesprogramme (28 October 2012, date last accessed).
4. Gliklich RE, Dreyer NA, eds. Registries for Evaluating Patient Outcomes: A User's Guide, 2nd edn. (Prepared by Outcome DEcIDE Center [Outcome Sciences, Inc. d/b/a Outcome] under Contract No. HHSA29020050035I TO3) AHRQ Publication No.10-EHC049. Rockville, MD: Agency for Healthcare Research and Quality, 2010. www.effectivehealthcare.ahrq.gov (28 October 2012, date last accessed).
5. Australian Commission on Safety and Quality in Healthcare. Strategic principles for a national approach to clinical quality registries and operating principles for australian clinical quality registries. http://www.safetyandquality.gov.au/wp-content/uploads/2012/03/Strategic-Principles-for-a-National-Approach-to-Australian-Clinical-Quality-Registries.pdf (28 October 2012, date last accessed).
6. Ogrinc G, Mooney SE, Estrada C et al. The SQUIRE (Standards for Quality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration. Qual Saf Health Care 2008;17(Suppl. I):i13-32.
7. Casarett D, Fox E, Tulsky JA. Recommendations for the ethical conduct of quality improvement. A Report of the National Ethics Committee of the Veterans Health Administration. National Center for Ethics in Health Care, Veterans Health Administration, 2002.
8. Dixon N. Review of ethics issues related to clinical audit and quality improvement activities. London: Healthcare Quality Improvement Partnership, 2009. http://www.hqip.org.uk/assets/Downloads/Ethics-and-Clinical-Audit-and-Quality-Improvement-Literature-Review.pdf (28 October 2012, date last accessed).
9. Assessing and improving quality in national clinical audits. London: Healthcare Quality Improvement Partnership, 2011. http://www.hqip.org.uk/assets/Core-Team/HQIP-guide-to-Assessing-and-Improving-quality-in-National-Clinical-Audits.pdf (28 October 2012, date last accessed).
10. Department of Health. Criteria for selecting and prioritising topics for national clinical audits to be funded by DH NCAPOP, 2009. http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/@dh/@en/@ps/@sta/@perf/documents/digitalasset/dh_107461.pdf (28 October 2012, date last accessed).
11. Pearson M. Lessons from the management of acute myocardial infarction. Heart 2005;91(Suppl. 2):ii28-30. doi:10.1136/hrt.2005. 062075.
12. Cornish JA, Tilney HS, Tan E et al. The National Bowel Cancer Audit Project: what do trusts think of the National Bowel Cancer Audit and how can it be improved? Tech Coloprocto 2011;15:53-9.
13. Peterson ED, Roe MT, Rumsfeld JS et al. A Call to ACTION (acute coronary treatment and intervention outcomes network): a national effort to promote timely clinical feedback and support continuous quality improvement for acute myocardial infarction. Circ Cardiovasc Qual Outcomes 2009;2:491-9.
14. Harris AH, Reeder RN, Ellerbe LS et al. Validation of the treatment identification strategy of the HEDIS addiction quality measures: concordance with medical record review. BMC Health Serv Res 2011;11:73.
15. Jones RC, Dickson-Spillmann M, Mather MJ et al. Accuracy of diagnostic registers and management of chronic obstructive pulmonary disease: the Devon primary care audit. Respir Res 2008;9:62.
16. Remus D, Fraser I. Guidance for using the AHRQ quality indicators for hospital-level public reporting or payment. AHRQ Pub. No. 04-0086EF. Rockville, MD: Agency for Healthcare Research and Quality, 2004. http://www.leg.state.nv.us/74th/Interim_Agendas_Minutes_Exhibits/Exhibits/HealthCare/E030608J-6.pdf (28 October 2012, date last accessed).
17. Chassin MR, Loeb JM, Schmaltz SP et al. Accountability measures- using measurement to promote quality improvement. New Engl J Med 2010;363:683-8.
18. Criteria for Evaluation. Measure evaluation criteria. National Quality Forum, 2011. http://www.qualityforum.org/docs/measure_evaluation_criteria.aspx. (28 October 2012, date last accessed).
19. Kesmodel US, Jølving LR. Measuring and improving quality in obstetrics-the implementation of national indicators in Denmark. Acta Obstet Gynecol Scand 2011;90:295-304. Epub 4 March 2011. doi:10.1111/j/1600-0412.2011.01078.x.
20. Krumholz HM, Keenan PS, Brush JE, Jr et al. American Heart Association Interdisciplinary Council on Quality of Care and Outcomes Research, American College of Cardiology Foundation. Standards for measures used for public reporting of efficiency in health care: a scientific statement from the American Heart Association Interdisciplinary Council on Quality of Care and Outcomes Research and the American College of Cardiology Foundation. J Am Coll Cardiol 2008;52:1518-26.
21. Maggard MA, McGory ML, Ko CY. Development of quality indicators: Lessons learned in bariatric surgery. Am Surg 2006;72:870-4.
22. Mainz J. Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care 2003;15(Suppl. 1): i5-11.
23. Wollersheim H, Hermens R, Hulscher M et al. Clinical indicators: Development and applications. Neth J Med 2007;65:15-22.
24. van der Geer E, van Tuijl HF, Rutte CG. Performance management in healthcare: Performance indicator development, task uncertainty, and types of performance indicators. Soc Sci Med 2009;69:1523-30. Epub 24 September 2009.
25. Travaglia J, Debono D. Clinical audit: a comprehensive review of the literature. Sydney, Australia: Centre for Clinical Governance Research, University of New South Wales, 2009. http://www.health.vic.gov.au/clinicalengagement/downloads/pasp/literature_review_clinical_audit.pdf (28 October 2012, date last accessed).
26. Cryer C. Injury outcome indicators-validation matters. Int J Inj Contr Saf Promot 2005;12:219-24.
27. Ko DT, Wijeysundera HC, Zhu X et al. National Expert Panel. Canadian quality indicators for percutaneous coronary interventions. Can J Cardiol 2008;24:899-903.
28. Lee DS, Tran C, Flintoft V et al. Canadian Cardiovascular Outcomes Research Team/Canadian Cardiovascular Society Heart Failure Quality Indicator Panel. CCORT/CCS quality indicators for congestive heart failure. Can J Cardiol 2003;19:357-64.
29. Mian S, Wagg A, Irwin P et al. National audit of continence care: laying the foundation. J Eval Clin Pract 2005;11:533-43.
30. Hearnshaw H, Harker R, Cheater F et al. A study of the methods used to select review criteria for clinical audit. Health Technol Assess 2002;6:1-78.
31. Campbell SM, Hann M, Hacker J et al. Quality assessment for three common conditions in primary care: validity and reliability of review criteria developed by expert panels for angina, asthma and type 2 diabetes. Qual Saf Health Care 2002;11: 125-30.
32. Dixon N, Pearce M. Guide to ensuring data quality in clinical audits. London: Healthcare Improvement Partnership, 2010. http://www.hqip.org.uk/assets/LQIT-uploads/Guide-to-ensuringdata-quality-in-clinical-audits-8-Sep-10.pdf (28 October 2012, date last accessed).
33. Wagg A, Mian S, Lowe D et al. Continence Programme Working Party. National audit of continence care for older people: results of a pilot study. J Eval Clin Pract 2005;11:525-32.
34. Persell SD, Dolan NC, Friesema EM et al. Frequency of inappropriate medical exceptions to quality measures. Ann Intern Med 2010;152:225-31.
35. Davies S, McDonald KM, Schmidt E et al. Expanding the uses of AHRQ's prevention quality indicators: validity from the clinician perspective. Med Care 2011;49:679-85.
36. Harboe KM, Anthonsen K, Bardram L. Validation of data and indicators in the Danish Cholecystectomy Database. Int J Qual Health Care 2009;21:160-8. Epub 21 March 2009.
37. Head BJ, Aquilino ML, Johnson M et al. Content validity and nursing sensitivity of community-level outcomes from the Nursing Outcomes Classification (NOC). J Nurs Scholarsh 2004;36:251-9.
38. Idvall E, Hamrin E, Siöström B et al. Quality indicators in postoperative pain management: a validation study. Scand J Caring Sci 2001;15:331-8.
39. Maas M, Johnson M, Moorhead S et al. Evaluation of the reliability and validity of nursing outcomes classification patient outcomes and measures. J Nurs Meas 2003;11:97-117.
40. Borzecki AM, Cevasco M, Chen Q et al. How valid is the AHRQ Patient Safety Indicator 'postoperative physiologic and metabolic derangement?' J Am Coll Surg 2011;212:968-76.e1-2. Epub 13 April 2011.
41. Borzecki AM, Kaafarani H, Cevasco M et al. How valid is the AHRQ Patient Safety Indicator 'postoperative hemorrhage or hematoma?' J Am Coll Surg 2011;212:946-53.e1-2. Epub 7 April 2011.
42. Borzecki AM, Kaafarani HM, Utter GH et al. How valid is the AHRQ Patient Safety Indicator 'postoperative respiratory failure?' J Am Coll Surg 2011;212:935-45. Epub 7 April 2011.
43. Cevasco M, Borzecki AM, Chen Q et al. Positive predictive value of the AHRQ Patient Safety Indicator 'postoperative sepsis': implications for practice and policy. J Am Coll Surg 2011; 212:954-61. Epub 7 April 2011.
44. Cevasco M, Borzecki AM, McClusky DA, III et al. Positive predictive value of the AHRQ Patient Safety Indicator 'postoperative wound dehiscence'. J Am Coll Surg 2011;212:962-7. Epub 13 April 2011.
45. Cevasco M, Borzecki AM, O'Brien QJ et al. Validity of the AHRQ Patient Safety Indicator 'central venous catheter-related blood stream infections'. J Am Coll Surg 2011;212:984-90. Epub 13 April 2011.
46. Chen Q, Rosen AK, Cevasco M et al. Detecting patient safety indicators: how valid is 'foreign body left during procedure' in the Veterans Health Administration? J Am Coll Surg 2011;212: 977-83. Epub 13 April 2011.
47. Scanlon MC, Harris JM, II, Levy F et al. Evaluation of the Agency for Healthcare Research and Quality pediatric quality indicators. Pediatrics 2008;121:e1723-31. Epub 12 May 2008.
48. Clarke RT, Warnick J, Stretton K et al. Improving the immediate management of neutropenic sepsis in the UK: lessons from a national audit. Br J Haematol 2011;153:773-9.
49. Sketcher-Baker KM, Kamp MC, Connors JA et al. Using the quality improvement cycle on clinical indicators-improve or remove? Med J Aust 2010;193(Suppl.):S104-6.
50. Kelly M, Lamah M. Evaluating the accuracy of data entry in a regional colorectal cancer database: implications for national audit. Colorectal Dis 2007;9:337-9.
51. Dixon N. Ethics and clinical audit. In: Burgess R (ed.). New Principles of Best Practice in Clinical Audit. Oxford: Radcliffe Publishing, 2011.
52. Dixon N. Ethics and Clinical Audit and Quality Improvement (QI)- A Guide for NHS Organisations. London: Healthcare Quality Improvement Partnership, 2009. http://www.hqip.org.uk/assets/LQIT-uploads/Guidance-0212/HQIP-CA-PD-021fii-190312-Ethics-and-clinical-audit-and-QI-a-guide-for-NHSorganizations. pdf (28 October 2012, date last accessed).
53. Indicators. International quality indicator project. http://www.internationalqip.com/indicators.aspx (28 October 2012, date last accessed).
54. Bridgewater B, Keogh B, Kinsman R et al. Sixth National Adult Cardiac Surgical Database Report 2008, Demonstrating Quality. The Society for Cardiothoracic Surgery in Great Britain and Ireland and Dendrite Clinical Systems Ltd, 2009. http://www.e-dendrite.com (28 October 2012, date last accessed).
55. Shiloach M, Frencher SK, Jr, Steeger JE et al. Toward robust information: Data quality and inter-rater reliability in the American College of Surgeons National Surgical Quality Improvement Program. JAm Coll Surg 2010;210:6-16.
56. Roberts CM, Lowe D, Barnes S et al. A prospective study of the practical issues of local involvement in national audit of COPD. J Eval Clin Pract 2004;10:281-90.
57. Gompertz PH, Irwin P, Morris R et al. Reliability and validity of the Intercollegiate Stroke Audit Package. J Eval Clin Pract 2001;7:1-11.
58. Harrison DA, Brady AR, Rowan K. Case mix, outcome and length of stay for admissions to adult, general critical care units in England, Wales and Northern Ireland: the Intensive Care National Audit and Research Centre Case Mix Programme Database. Crit Care 2004;8:R99-111.
59. Hart S, Berqquist S, Gajewski B et al. Reliability testing of the National Database of Nursing Quality Indicators pressure ulcer indicator. J Nurs Care Qual 2006;21:256-65.
60. Herrett E, Smeeth L, Walker L et al. MINAP Academic Group. The Myocardial Ischaemia National Audit Project (MINAP). Heart 2010;96:1264-7.
61. Willis CD, Jolley DJ, McNeil JJ et al. Identifying and improving unreliable items in registries through data auditing. Int J Qual Health Care 2011;23:317-23. Epub 25 March 2011.
62. To T, Estrabillo E, Wang C et al. Examining intra-rater and inter-rater response agreement: a medical chart abstraction study of a community-based asthma care program. BMC Med Res Methodol 2008;8:29. doi:10.1186/1471-2288-8-29. http://www.biomedcentral.com/1471-2288/8/29 (28 October 2012, date last accessed).
63. Kragsterman B, Pärsson H, Lindbäck J et al. Swedish Vascular Registry (Swedvasc). Outcomes of carotid endarterectomy for asymptomatic stenosis in Sweden are improving: results from a population-based registry. J Vasc Surg 2006;44: 79-85.
64. Mainz J, Krog BR, Bjørnshave B et al. Nationwide continuous quality improvement using clinical indicators: the Danish National Indicator Project. Int J Qual Health Care 2004;16 (Suppl. 1):i45-50.
65. Wightman R, Fielding J, Green S. Audit of antipsychotic prescribing in dementia: Cambridgeshire results and lessons learnt. Psychiatr Danub 2011;23(Suppl. 1):S126-9.
66. Seddon M, Buchanan J, EPIQ. Quality improvement in New Zealand healthcare. Part 3: achieving effective care through clinical audit. N Z Med J 2006;119:U2108.
67. Gale CP, Roberts AP, Batin PD et al. Funnel plots, performance variation and the Myocardial Infarction National Audit Project 2003-2004. BMC Cardiovas Disord 2006;6:34.
68. Qvist P, Rasmussen L, Bonnevie B et al. Repeated measurement of generic indicators: a Danish national program to benchmark and improve quality of care. Int J Qual Health Care 2004;16:141-8.
69. Barter S, Drinkwater K, Remedios D. National audit of provision of MRI services 2006/07. Clin Radiol 2009;64:2384-90.
70. Tawn DJ, Squire CJ, Mohammed MA et al. National audit of the sensitivity of double-contrast barium enema for colorectal carcinoma, using control charts for the Royal College of Radiologists Clinical Radiology Audit Sub-Committee. Clin Radiol 2005;60: 558-64.
71. Dixon N. Getting clinical audit right to benefit patients. Romsey, Hampshire UK: Healthcare Quality Quest, 2011.
72. Massoud MR, Nielsen GA, Nolan K et al. A framework for spread: from local improvements to system-wide change. IHI Innovation Series White Paper. Cambridge, MA: Institute for Healthcare Improvement, 2006. http://www. IHI.org/knowledge/Pages/IHIWhitePapers/AFrameworkforSpreadWhitePaper.aspx (28 October 2012, date last accessed).
73. Nolan K, Schall MQ, Erb F et al. Using a framework for spread: the case of patient access in the Veterans Health Administration. Jt Comm J Qual Patient Saf 2005;31:339-47.
74. Rudd AG, Lowe D, Irwin P et al. Intercollegiate Stroke Working Party. National stroke audit: a tool for change? Qual Health Care 2001;10:141-51.
75. Grant RL, Batty GM, Aggarwal R et al. National sentinel clinical audit of evidence-based prescribing for older people: methodology and development. J Eval Clin Pract 2002;8:189-98.
76. Husk J. Achieving changes in practice from national audit: national audit of the organization of services for falls and bone health in older people. J Eval Clin Pract 2008;14:974-8.
77. Williams SC, Watt A, Schmaltz SP et al. Assessing the reliability of standardized performance indicators. Int J Qual Health Care 2006;18:246-55.
78. Ivers N, Jamtvedt G, Flottorp S et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012, Issue 6. Art. No.: CD000259. doi:10.1002/14651858.CD000259.pub3.