Methods for the guideline-based development of quality indicators--a systematic review

Implementation Science

Volumn 7, Issue 1, 2012, Pages

  Kötter, Thomas ^a,b   Blozik, Eva ^a   Scherer, Martin ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^b UNIVERSITY OF LÜBECK   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPARATIVE STUDY; HEALTH CARE PLANNING; HEALTH CARE QUALITY; ORGANIZATION AND MANAGEMENT; PRACTICE GUIDELINE; PUBLIC HEALTH; REVIEW;

HEALTH PLAN IMPLEMENTATION; PRACTICE GUIDELINES AS TOPIC; PROGRAM EVALUATION; PUBLIC HEALTH; QUALITY INDICATORS, HEALTH CARE;

EID: 84861877306     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/1748-5908-7-21     Document Type: Review

References (71)

1. Baker R, Fraser RC. Development of review criteria: linking guidelines and assessment of quality. BMJ 1995, 311:370-373. 10.1136/bmj.311.7001.370, 2550434, 7640546.
2. Lohr KN. Medicare: a strategy for quality assurance 1990, Washington, D.C.: National Academy Press.
3. Brook RH, McGlynn EA, Cleary PD. Quality of health care. Part 2: measuring quality of care. N Eng J Med 1996, 335:966-970.
4. Donabedian A. Evaluating the quality of medical care (1966). Milbank Q 2005, 83:691-729. 10.1111/j.1468-0009.2005.00397.x, 16279964.
5. Mainz J. Quality indicators: essential for quality improvement. Int J Qual Health Care 2004, 16:i1-i2.
6. McGlynn EA, Asch SM. Developing a clinical performance measure. Am J Prev Med 1998, 14:14-21. 10.1016/S0749-3797(97)00032-9, 9566932.
7. Campbell SM, Braspenning J, Hutchinson A, Marshall M. Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care 2002, 11:358-364. 10.1136/qhc.11.4.358, 1758017, 12468698.
8. Sens B, Fischer B, Bastek A, Eckard J, Kaczmarek D, Paschen U, Pietsch B, Rath S, Ruprecht T, Thomeczek C, et al. Begriffe und Konzepte des Qualitätsmanagements. GMS Med Inform Biom Epidemiol 2007, 3:Doc05.
9. McGlynn EA. Selecting common measures of quality and system performance. Medical Care 2003, 41:I-39-I-47.
10. Wollersheim H, Hermens R, Hulscher M, Braspenning J, Ouwens M, Schouten J, Marres H, Dijkstra R, Grol R. Clinical indicators: development and applications. Neth J Med 2007, 65:15-22.
11. Scinto JD, Galusha DH, Krumholz HM, Meehan TP. The case for comprehensive quality indicator reliability assessment. J Clin Epidemiol 2001, 54:1103-1111. 10.1016/S0895-4356(01)00381-X, 11675161.
12. Brook RH, McGlynn EA, Shekelle PG. Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care 2000, 12:281-295. 10.1093/intqhc/12.4.281, 10985266.
13. Hearnshaw HM, Harker RM, Cheater FM, Baker RH, Grimshaw GM. Expert consensus on the desirable characteristics of review criteria for improvement of health care quality. Qual Health Care 2001, 10:173-178. 10.1136/qhc.0100173, 1743436, 11533425.
14. Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care 2003, 15:523-530. 10.1093/intqhc/mzg081, 14660535.
15. Mainz J. Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care 2003, 15:i5-i11. 10.1093/intqhc/mzg084, 14660518.
16. Campbell SM, Shield T, Rogers A, Gask L. How do stakeholder groups vary in a Delphi technique about primary mental health care and what factors influence their ratings?. Qual Saf Health Care 2004, 13:428-434. 10.1136/qshc.2003.007815, 1743904, 15576704.
17. Marshall MN, Shekelle PG, McGlynn EA, Campbell SM, Brook RH, Roland MO. Can health care quality indicators be transferred between countries?. Qual Saf Health Care 2010, 12:8-12.
18. Frijling BD, Spies TH, Lobo CM, Hulscher MEJL, Van D, Braspenning JCC, Prins A, Van Der Wouden JC, Grol RPTM. Blood pressure control in treated hypertensive patients: clinical performance of general practitioners. Br J Gen Pract 2001, 51:9-14. 1313918, 11271892.
19. Hutchinson A, McIntosh A, Anderson JL, Gilbert C, Field R. Developing primary care review criteria from evidence-based guidelines: coronary heart disease as a model. Br J Gen Pract 2003, 53:690-696. 1314691, 15103876.
20. Blozik E, Nothacker M, Bunk T, Szecsenyi J, Ollenschläger G, Scherer M. Simultaneous Development of Guidelines and Quality Indicators--How Do Guideline Groups Act? A Worldwide Survey. International Journal of Health Care Quality Assurance 2010,
21. Kötter T, Schaefer F, Blozik E, Scherer M. Developing quality indicators: background, methods and problems. Z Evid Fortbild Qual Gesundh wesen (ZEFQ) 2011, 105:7-12.
22. Light K. How to find research before publication. J Health Serv Res Policy 2009, 14:62-64.
23. AHCPR Designing and implementing guidelines-based performance measures. Agency for Health Care Policy and Research. Qual Lett Healthc Lead 1995, 7:21-23. AHCPR.
24. AHRQ Using clinical practice guidelines to evaluate the quality of care--Volume 2: Methods 1995, Rockville: US Dept. of Health and Human Sciences, AHRQ.
25. AQUA-Institut Allgemeine Methoden im Rahmen der sektorenübergreifenden Qualitätssicherung im Gesundheitswesen nach §137a SGB V. 2010, Version 2.0, AQUA-Institut.
26. ÄZQ (Ärztliches Zentrum für Qualität in der Medizin) Qualitätsindikatoren--Manual für Autoren 2009, Neukirchen: Make a book, ÄZQ (Ärztliches Zentrum für Qualität in der Medizin).
27. Bergman DA. Evidence-based guidelines and critical pathways for quality improvement. Pediatrics 1999, 103:225-232.
28. Califf RM, Peterson ED, Gibbons RJ, Garson A, Brindis RG, Beller GA, Smith SC, . American College of Cardiology, American Heart Association Integrating quality into the cycle of therapeutic development. J Am Coll Cardiol 2002, 40:1895-1901. 10.1016/S0735-1097(02)02537-8, 12475447, American College of Cardiology, American Heart Association.
29. Graham WJ. Criterion-based clinical audit in obstetrics: bridging the quality gap?. Best Pract Res Clin Obstet Gynaecol 2009, 23:375-388. 10.1016/j.bpobgyn.2009.01.017, 19299203.
30. Spertus JA, Eagle KA, Krumholz HM, Mitchell KR, Normand SL. American College of Cardiology and American Heart Association methodology for the selection and creation of performance measures for quantifying the quality of cardiovascular care. Circulation 2005, 111:1703-1712. 10.1161/01.CIR.0000157096.95223.D7, 15811870.
31. Bonow RO, Bennett S, Casey DE, Ganiats TG, Hlatky MA, Konstam MA, Lambrew CT, Normand SL, Pina IL, Radford MJ, et al. ACC/AHA clinical performance measures for adults with chronic heart failure: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Heart Failure Clinical Performance Measures) endorsed by the Heart Failure Society of America. J Am Coll Cardiol 2005, 46:1144-1178. 10.1016/j.jacc.2005.07.012, 16168305.
32. Burge FI, Bower K, Putnam W, Cox JL. Quality indicators for cardiovascular primary care. Can J Cardiol 2007, 23:383-388. 10.1016/S0828-282X(07)70772-9, 2649189, 17440644.
33. Campbell SM, Roland MO, Shekelle PG, Cantrill JA, Buetow SA, Cragg DK. Development of review criteria for assessing the quality of management of stable angina, adult asthma, and non-insulin dependent diabetes mellitus in general practice. Qual Health Care 1999, 8:6-15. 10.1136/qshc.8.1.6, 2483627, 10557672.
34. Desch CE, McNiff KK, Schneider EC, Schrag D, McClure J, Lepisto E, Donaldson MS, Kahn KL, Weeks JC, Ko CY, et al. American Society of Clinical Oncology/National Comprehensive Cancer Network quality measures. J Clin Oncol 2008, 26:3631-3637. 10.1200/JCO.2008.16.5068, 18640941.
35. Draskovic I, Vernooij-Dassen M, Verhey F, Scheltens P, Rikkert MO. Development of quality indicators for memory clinics. Int J Geriatr Psychiatry 2008, 23:119-128. 10.1002/gps.1848, 17582827.
36. Estes NA, Halperin JL, Calkins H, Ezekowitz MD, Gitman P, Go AS, McNamara RL, Messer JV, Ritchie JL, Romeo SJ, et al. ACC/AHA/Physician Consortium 2008 Clinical Performance Measures for Adults with Nonvalvular Atrial Fibrillation or Atrial Flutter: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures and the Physician Consortium for Performance Improvement (Writing Committee to Develop Clinical Performance Measures for Atrial Fibrillation) Developed in Collaboration with the Heart Rhythm Society. J Am Coll Cardiol 2008, 51:865-884. 10.1016/j.jacc.2008.01.006, 18294574.
37. Forbes SA, Duncan PW, Zimmerman MK. Review criteria for stroke rehabilitation outcomes. Arch Phys Med Rehabil 1997, 78:1112-1116. 10.1016/S0003-9993(97)90137-4, 9339162.
38. Giesen P, Willekens M, Mokkink H, Braspenning J, Van den Bosch W, Grol R. Out-of-hours primary care: development of indicators for prescribing and referring. Int J Qual Health Care 2007, 19:289-295. 10.1093/intqhc/mzm027, 17602203.
39. Hadorn DC, Baker DW, Kamberg CJ, Brooks RH. Phase II of the AHCPR-sponsored heart failure guideline: translating practice recommendations into review criteria. Jt Comm J Qual Improv 1996, 22:265-276.
40. Hardy AM, Hadley RA. CCQE (Center for Clinical Quality Evaluation) develops quality measures for AHCPR pain guideline. QRC Advis 1995, 11:1-8.
41. Hermanides HS, Hulscher ME, Schouten JA, Prins JM, Geerlings SE. Development of quality indicators for the antibiotic treatment of complicated urinary tract infections: a first step to measure and improve care. Clin Infect Dis 2008, 46:703-711. 10.1086/527384, 18230045.
42. Hermens RPMG, Ouwens MMTJ, Vonk-Okhuijsen SY, van der Wel Y, Tjan-Heijnen VCG, van den Broek LD, Ho VKY, Janssen-Heijnen MLG, Groen HJM, Grol RPTM, Wollersheim HCH. Development of quality indicators for diagnosis and treatment of patients with non-small cell lung cancer: a first step toward implementing a multidisciplinary, evidence-based guideline. Lung Cancer 2006, 54:117-124. 10.1016/j.lungcan.2006.07.001, 16920220.
43. James PA, Cowan TM, Graham RP, Majeroni BA, Fox CH, Jaen CR. Using a clinical practice guideline to measure physician practice: translating a guideline for the management of heart failure. J Am Board Fam Pract 1997, 10:206-212.
44. Kongnyuy EJ, van den Broek N. Criteria for clinical audit of women friendly care and providers' perception in Malawi. BMC Pregnancy Childbirth 2008, 8:28. 10.1186/1471-2393-8-28, 2492838, 18647388.
45. Krumholz HM, Anderson JL, Brooks NH, Fesmire FM, Lambrew CT, Landrum MB, Weaver WD, Whyte J, Bonow RO, Bennett SJ, et al. ACC/AHA clinical performance measures for adults with ST-elevation and non-ST-elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Performance Measures on ST-Elevation and Non-ST-Elevation Myocardial Infarction). Circulation 2006, 113:732-761. 10.1161/CIRCULATIONAHA.106.172860, 16391153.
46. Lee DS, Tran C, Flintoft V, Grant FC, Liu PP, Tu JV, . Canadian Cardiovascular Outcomes Research Team/Canadian Cardiovascular Society CCORT/CCS quality indicators for congestive heart failure care. Can J Cardiol 2003, 19:357-364. Canadian Cardiovascular Outcomes Research Team/Canadian Cardiovascular Society.
47. MacLean CH, Saag KG, Solomon DH, Morton SC, Sampsel S, Klippel JH. Measuring quality in arthritis care: methods for developing the arthritis foundation's quality indicator set. Arthritis Care Res 2004, 51:193-202.
48. Martirosyan L, Braspenning J, Denig P, de Grauw WJ, Bouma M, Storms F, Haaijer-Ruskamp FM. Prescribing quality indicators of type 2 diabetes mellitus ambulatory care. Qual Saf Health Care 2008, 17:318-323. 10.1136/qshc.2007.024224, 18842968.
49. Mourad SM, Hermens RPMG, Nelen WLDM, Braat DDM, Grol RPTM, Kremer JAM. Guideline-based development of quality indicators for subfertility care. Hum Reprod 2007, 22:2665-2672. 10.1093/humrep/dem215, 17664242.
50. Nijkrake MJ, Keus SH, Ewalds H, Overeem S, Braspenning JC, Oostendorp RA, Hendriks EJ, Bloem BR, Munneke M. Quality indicators for physiotherapy in Parkinson's disease. Eur J Phys Rehabil Med 2009, 45:239-245.
51. Ouwens M, Hermens R, Hulscher M, Vonk-Okhuijsen S, Tjan-Heijnen V, Termeer R, Marres H, Wollersheim H, Grol R. Development of indicators for patient-centred cancer care. Support Care Cancer 2010, 18:121-130.
52. Ouwens MM, Marres HA, Hermens RR, Hulscher MM, van den Hoogen FJ, Grol RP, Wollersheim HC. Quality of integrated care for patients with head and neck cancer: development and measurement of clinical indicators. Head Neck 2007, 29:378-386. 10.1002/hed.20532, 17123308.
53. Radtke MA, Reich K, Blome C, Kopp I, Rustenbach SJ, Schafer I, Augustin M. Evaluation of quality of care and guideline-compliant treatment in psoriasis. Development of a new system of quality indicators. Dermatology 2009, 219:54-58. 10.1159/000218161, 19420901.
54. Redberg RF, Benjamin EJ, Braun LT, Goff DC, Havas S, Labarthe DR, Limacher MC, Lloyd-Jones DM, Mora S, Pearson TA, Radford MJ, Smetana GW, Spertus JA, Swegler EW, . American Academy of Family Physicians, American Association of Cardiovascular and Pulmonary Rehabilitation, Preventive Cardiovascular Nurses Society for Women's Health Research ACCF/AHA 2009 performance measures for primary prevention of cardiovascular disease in adults: A report of the american college of cardiology foundation/american heart association task force on performance measures (writing committee to develop performance measures for primary prevention of cardiovascular disease): Developed in collaboration with the american academy of family physicians. Circulation 2009, 120:1296-1336. American Academy of Family Physicians, American Association of Cardiovascular and Pulmonary Rehabilitation, Preventive Cardiovascular Nurses Society for Women's Health Research.
55. Schouten JA, Hulscher ME, Wollersheim H, Braspennning J, Kullberg BJ, van der Meer JW, Grol RP. Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it?. Clin Infect Dis 2005, 41:450-460. 10.1086/431983, 16028151.
56. Sugarman JR, Frederick PR, Frankenfield DL, Owen WF, McClellan WM. Dialysis outcomes quality initiative clinical practice guidelines: Developing clinical performance measures based on the dialysis outcomes quality initiative clinical practice guidelines: process, outcomes, and implications. Am J Kidney Dis 2003, 42:806-812. 10.1016/S0272-6386(03)00867-9, 14520632.
57. Thomas RJ, King M, Lui K, Oldridge N, Pina IL, Spertus J. AACVPR/ACC/AHA 2007 performance measures on cardiac rehabilitation for referral to and delivery of cardiac rehabilitation/secondary prevention services. Circulation 2007, 116:1611-1642.
58. Tu JV, Khalid L, Donovan LR, Ko DT. Indicators of quality of care for patients with acute myocardial infarction. Can Med Assoc J 2008, 179:909-915.
59. Van Den Boogaard E, Goddijn M, Leschot NJ, van der Veen F, Kremer JAM, Hermens RPMG. Development of guideline-based quality indicators for recurrent miscarriage. Reprod Biomed Online 2010, 20:267-273. 10.1016/j.rbmo.2009.11.016, 20113965.
60. van Hulst LT, Fransen J, den Broeder AA, Grol R, van Riel PL, Hulscher ME. Development of quality indicators for monitoring of the disease course in rheumatoid arthritis. Ann Rheum Dis 2009, 68:1805-1810. 10.1136/ard.2009.108555, 19447827.
61. Wang CJ, McGlynn EA, Brook RH, Leonard CH, Piecuch RE, Hsueh SI, Schuster MA. Quality-of-care indicators for the neurodevelopmental follow-up of very low birth weight children: results of an expert panel process. Pediatrics 2006, 117:2080-2092. 10.1542/peds.2005-1904, 16740851.
62. Yazdany J, Panopalis P, Gillis JZ, Schmajuk G, MacLean CH, Wofsy D, Yelin E. A quality indicator set for systemic lupus erythematosus. Arthritis Rheum 2009, 61:370-377. 10.1002/art.24356, 2748348, 19248127.
63. Advani A, Goldstein M, Shahar Y, Musen MA. Developing quality indicators and auditing protocols from formal guideline models: knowledge representation and transformations. AMIA Annual Symposium Proceedings 2003, 11-15.
64. Duffy FF, Narrow W, West JC, Fochtmann LJ, Kahn DA, Suppes T, Oldham JM, McIntyre JS, Manderscheid RW, Sirovatka P, Regier D. Quality of care measures for the treatment of bipolar disorder. Psychiatr Q 2005, 76:213-230. 10.1007/s11126-005-2975-4, 16080418.
65. Golden WE, Hermann RC, Jewell M, Brewster C. Development of evidence-based performance measures for bipolar disorder: overview of methodology. J Psychiatr Pract 2008, 14(Suppl 2):18-30.
66. LaClair BJ, Reker DM, Duncan PW, Horner RD, Hoenig H. Stroke care: a method for measuring compliance with AHCPR guidelines. Am J Phys Med Rehabil 2001, 80:235-242. 10.1097/00002060-200103000-00017, 11237279.
67. The AGREE Instrument. , http://www.agreetrust.org/resource-centre/the-original-agree-instrument/
68. Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care 1986, 2:53-63. 10.1017/S0266462300002774, 10300718.
69. Brook RH. Assessing the appropriateness of care - its time has come. JAMA 2009, 302:997-998. 10.1001/jama.2009.1279, 19724048.
70. Kopp IB, Selbmann HK, Koller M. Consensus development in evidence-based guidelines: from myths to rational strategies. Z ärztl Fortbild Qual Gesundh wes 2007, 101:89-95.
71. Center for Reviews and Dissemination Systematic Reviews CRD's Guidance for Undertaking Systematic Reviews in Health Care 2009, York: CRD, University of York, Center for Reviews and Dissemination.