Measuring quality of care: Considering conceptual approaches to quality indicator development and evaluation

Journal of Clinical Epidemiology

Volumn 66, Issue 12, 2013, Pages 1328-1337

  Stelfox, Henry T ^a,b   Straus, Sharon E ^c  

^a UNIVERSITY OF CALGARY   (Canada)

^b UNIVERSITY OF CALGARY   (Canada)

^c ST MICHAEL'S HOSPITAL   (Canada)

Author keywords

Consensus; Health care; Models; Quality indicators; Quality of health care; Reproducibility of results; Theoretical

Indexed keywords

ARTICLE; CLINICAL DECISION MAKING; CLINICAL INDICATOR; CLINICAL PRACTICE; CONCEPTUAL FRAMEWORK; CONCURRENT VALIDITY; CONSENSUS DEVELOPMENT; CRITERION RELATED VALIDITY; DELPHI STUDY; EVIDENCE BASED PRACTICE; HEALTH CARE QUALITY; HUMAN; MEDICAL RECORD REVIEW; METHODOLOGY; NEEDS ASSESSMENT; PATIENT ATTITUDE; PRACTICE GUIDELINE; PRIORITY JOURNAL; PSYCHOMETRY; QUALITY CONTROL; RATING SCALE; TOTAL QUALITY MANAGEMENT;

EID: 84886950344     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2013.05.017     Document Type: Note

References (57)

1. Canadian Institute for Health Information Pan-Canadian primary health care indicators 2006 Canadian Institute for Health Information Ottawa, Ontario
2. Canadian Association for Health Policy and Services Research Updating Pan-Canadian primary health care indicators - what we've learned 2012 Canadian Institute for Health Information Ottawa, Ontario
3. Agency for Healthcare Research and Quality. AHRQ quality indicators. 2012; Available at http://www.qualityindicators.ahrq.gov/. Accessed April 25, 2013.
4. H.M. Krumholz, J.L. Anderson, N.H. Brooks, F.M. Fesmire, C.T. Lambrew, and M.B. Landrum ACC/AHA clinical performance measures for adults with ST-elevation and non-ST-elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Performance Measures on ST-Elevation and Non-ST-Elevation Myocardial Infarction) Circulation 113 2006 732 761
5. Centers for Medicare and Medicaid Services Hospitals Compare. Centers for Medicare and Medicaid Services; 2012; Available at http://www.cms.gov/Medicare/ Quality-Initiatives-Patient-Assessment-Instruments/HospitalQualityInits/ Downloads/HospitalOverviewOfSpecs200512.pdf. Accessed August 3, 2012.
6. J.G. Jollis, M.L. Roettig, A.O. Aluko, K.J. Anstrom, R.J. Applegate, and J.D. Babb Implementation of a statewide system for coronary reperfusion for ST-segment elevation myocardial infarction JAMA 298 2007 2371 2380
7. C.G. Morris, and E. McCoy Clearing the cervical spine in unconscious polytrauma victims, balancing risks and effective screening Anaesthesia 59 5 2004 464 482
8. Santana MJ, Stelfox HT. Development and evaluation of evidence-informed indicators for adult injury care. Ann Surg. 2013. Epub ahead of print.
9. H.T. Stelfox, G.C. Velmahos, E. Gettings, L.M. Bigatello, and U. Schmidt Computed tomography for early and safe discontinuation of cervical spine immobilization in obtunded multiply injured patients J Trauma 63 2007 630 636
10. H.T. Stelfox, S.E. Straus, A. Nathens, R.L. Gruen, S.M. Hameed, and A. Kirkpatrick Trauma center quality improvement programs in the United States, Canada, and Australasia Ann Surg 256 1 2012 163 169
11. R.P. Pasic, M. Kantardzie, C. Templeman, and R.L. Levine Insufflation techniques in gynecologic laparoscopy Surg Laparosc Endosc Percutan Tech 16 1 2006 18 23
12. M. Osler Kliniske databaser i social epidemiologisk forskning Clinical databases in social epidemiological research Ugeskr Laeger 171 22 2009 1843 1846
13. A.R. Jones Data mining can support quality assurance J R Soc Med 102 9 2009 358 359
14. W. Putnam, K.N. Bower, J. Cox, P. Twohig, K. Pottie, and L. Jackson Quality indicators for cardiac care: national standards in a community context J Health Serv Res Policy 11 2006 5 12
15. S.M. Davies, J. Geppert, M. McClellan, K.M. McDonald, P.S. Romano, and K.G. Shojania Refinement of the HCUP quality indicators Rockville, MD; Agency for Healthcare Research and Quality; 2001
16. J. Jones, and D. Hunter Consensus methods for medical and health services research BMJ 311 1995 376 380
17. N. Black, M. Murphy, D. Lamping, M. McKee, C. Sanderson, and J. Askham Consensus development methods: a review of best practice in creating clinical guidelines J Health Serv Res Policy 4 1999 236 248
18. J.P. Kahan, R.E. Park, L.L. Leape, S.J. Bernstein, L.H. Hilborne, and L. Parker Variations by specialty in physician ratings of the appropriateness and necessity of indications for procedures Med Care 34 1996 512 523
19. I. Coulter, A. Adams, and P. Shekelle Impact of varying panel membership on ratings of appropriateness in consensus panels: a comparison of a multi- and single disciplinary panel Health Serv Res 30 1995 577 591
20. L.L. Leape, R.E. Park, J.P. Kahan, and R.H. Brook Group judgments of appropriateness: the effect of panel composition Qual Assur Health Care 4 2 1992 151 159
21. S.M. Campbell, M. Hann, M.O. Roland, J.A. Quayle, and P.G. Shekelle The effect of panel membership and feedback on ratings in a two-round Delphi survey: results of a randomized controlled trial Med Care 37 1999 964 968
22. E.S. Nilsen, H.T. Myrhaug, M. Johansen, S. Oliver, and A.D. Oxman Methods of consumer involvement in developing healthcare policy and research, clinical practice guidelines and patient information material Cochrane Database Syst Rev 3 2006 CD004563
23. A. Boivin, P. Lehoux, R. Lacombe, A. Lacasse, J. Burgers, and R. Grol Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol) Implement Sci 6 2011 45
24. E.A. McGlynn Selecting common measures of quality and system performance Med Care 41 2003 I39 I47
25. The Joint Commission Attributes of core performance measures and associated evaluation criteria 2008 The Joint Commission Available at http://www.jointcommission.org/Attributes-of-Core-Performance-Measures-and- Associated-Evaluation-Criteria/ Accessed August 3, 2012
26. National Quality Measures Clearinghouse Domain framework and inclusion criteria 2012 Agency for Healthcare Research and quality Rockville, MD Available at http://www.qualitymeasures.ahrq.gov/about/inclusion-criteria.aspx Accessed August 3, 2012
27. T. Kotter, E. Blozik, and M. Scherer Methods for the guideline-based development of quality indicators - a systematic review Implement Sci 7 2012 21
28. M. Farquhar AHRQ quality indicators R. Hughes, Patient safety and quality: an evidence-based handbook for nurses 2008 Agency for Healthcare Research and Quality Rockville, MD 341 367
29. S.M. Campbell, J. Braspenning, A. Hutchinson, and M. Marshall Research methods used in developing and applying quality indicators in primary care Qual Saf Health Care 11 2002 358 364
30. I. McDowell Measuring health: a guide to rating scales and questionnaires 3rd ed. 2006 Oxford University Press New York
31. H. Quan, V. Sundararajan, P. Halfon, A. Fong, B. Burnand, and J.C. Luthi Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data Med Care 43 2005 1130 1139
32. N. Bobrovitz, J.S. Parrilla, M.J. Santana, S.E. Straus, and H.T. Stelfox A qualitative analysis of a consensus process to develop quality indicators of injury care Implement Sci 8 2013 45
33. National Quality Measures Clearinghouse Validity of clinical quality measures 2012 Agency for Healthcare Research and quality Rockville, MD Available at http://www.qualitymeasures.ahrq.gov/tutorial/validity.aspx Accessed August 3, 2012
34. E.A. McGlynn, and S.M. Asch Developing a clinical performance measure Am J Prev Med 14 3 suppl 1998 14 21
35. D.L. Streiner, and G.R. Norma Health measurement scales: a practical guide to their development and use 1989 Oxford University Press Oxford, UK
36. E.D. Huff Comprehensive reliability assessment and comparison of quality indicators and their components J Clin Epidemiol 50 1997 1395 1404
37. J.D. Scinto, D.H. Galusha, H.M. Krumholz, and T.P. Meehan The case for comprehensive quality indicator reliability assessment J Clin Epidemiol 54 2001 1103 1111
38. J.J. Bartko The intraclass correlation coefficient as a measure of reliability Psychol Rep 19 1 1966 3 11
39. R.A. Deyo, P. Diehr, and D.L. Patrick Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation Control Clin Trials 12 4 suppl 1991 142S 158S
40. B.J. McNeil, E. Keller, and S.J. Adelstein Primer on certain elements of medical decision making N Engl J Med 293 1975 211 215
41. K. Iron, and D.G. Manuel Quality assessment of administrative data (QuAAD): an opportunity for enhancing Ontario's health data 2007 Institute for Clinical Evaluative Sciences Toronto, Canada
42. D. Juurlink, C. Preyra, R. Croxford, A. Chong, P. Austin, and J. Tu Canadian institute for health information discharge abstract database: a validation study 2006 Institute for Clinical Evaluative Sciences Toronto, Canada
43. J.M. Murphy, D.M. Berwick, M.C. Weinstein, J.F. Borus, S.H. Budman, and G.L. Klerman Performance of screening and diagnostic tests. Application of receiver operating characteristic analysis Arch Gen Psychiatry 44 1987 550 555
44. J.A. Swets Measuring the accuracy of diagnostic systems Science 240 1988 1285 1293
45. J.R. Landis, and G.G. Koch The measurement of observer agreement for categorical data Biometrics 33 1977 159 174
46. L.I. Iezzoni Risk adjustment for measuring health care outcomes 3rd ed. 2003 Health Administration Press Chicago, IL
47. J.V. Tu, L.R. Donovan, D.S. Lee, J.T. Wang, P.C. Austin, and D.A. Alter Effectiveness of public report cards for improving the quality of cardiac care: the EFFECT study: a randomized trial JAMA 302 2009 2330 2337
48. J.H. Hibbard, J. Stockard, and M. Tusler Hospital performance reports: Impact on quality, market share, and reputation Health Aff (Millwood) 24 4 2005 1150 1160
49. National Guideline Clearinghouse Inclusion criteria 2012 Agency for Healthcare Research and Quality Rockville, MD http://www.guideline.gov/about/ inclusion-criteria.aspx. Accessed August 3, 2012.
50. P.G. Shekelle, E. Ortiz, S. Rhodes, S.C. Morton, M.P. Eccles, and J.M. Grimshaw Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA 286 2001 1461 1467
51. K.G. Shojania, M. Sampson, M.T. Ansari, J. Ji, C. Garritty, and T. Rader Updating systematic reviews Rockville, MD; Agency for Healthcare Research and Quality; 2007
52. S. Mattke When should measures be updated? Development of a conceptual framework for maintenance of quality-of-care measures Qual Saf Health Care 17 2008 182 186
53. P. Shekelle, M.P. Eccles, J.M. Grimshaw, and S.H. Woolf When should clinical guidelines be updated? BMJ 323 2001 155 157
54. G. Gartlehner, S.L. West, K.N. Lohr, L. Kahwati, J.G. Johnson, and R.P. Harris Assessing the need to update prevention guidelines: a comparison of two methods Int J Qual Health Care 16 5 2004 399 406
55. S.E. Straus, J. Tetroe, and I.A. Graham Introduction to knowledge translation S.E. Straus, J. Tetroe, I.A. Graham, Knowledge translation in health care: moving from evidence to practice 2009 Wiley/Blackwell/BMJ Oxford, UK
56. American College of Cardiology. Guidelines & quality standard. 2012; Available at http://www.cardiosource.org/Science-And-Quality/Practice- Guidelines-and-Quality-Standards.aspx. Accessed August 3, 2012.
57. K. Fitch, S.J. Bernstein, M.D. Aguilar, B. Burnand, J.R. LaCalle, and P. Lazaro The RAND/UCLA appropriateness method user's manual 2001 RAND Santa Monica, CA