Exploring and comparing the characteristics of nonlatent and latent composite scores: Implications for pay-for-performance incentive design

Medical Decision Making

Volumn 32, Issue 1, 2012, Pages 132-144

  Chen, Tsung Tai ^a,b   Lai, Mei Shu ^b   Lin, I Chin ^b   Chung, Kuo Piao ^b  

^a MING CHUAN UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

composite score; diabetes mellitus; hospital ranking; pay for performance

Indexed keywords

ALGORITHM; ARTICLE; DIABETES MELLITUS; FEMALE; HEALTH CARE QUALITY; HUMAN; MALE; METHODOLOGY; MIDDLE AGED; ORGANIZATION AND MANAGEMENT; REIMBURSEMENT; STATISTICAL MODEL; STATISTICS; TAIWAN;

ALGORITHMS; DIABETES MELLITUS; FEMALE; HUMANS; MALE; MIDDLE AGED; MODELS, STATISTICAL; QUALITY ASSURANCE, HEALTH CARE; QUALITY INDICATORS, HEALTH CARE; REIMBURSEMENT, INCENTIVE; TAIWAN;

EID: 84856611899     PISSN: 0272989X     EISSN: 1552681X     Source Type: Journal    
DOI: 10.1177/0272989X10395596     Document Type: Conference Paper

References (60)

1. Christopher H. Public service management by numbers: why does it vary? where has it come from? what are the gaps and the puzzles?. Public Money & Management. 2007 ; 27 (2). 95-102
2. Teixeira-Pinto A, Normand SL. Statistical methodology for classifying units on the basis of multiple-related measures. Stat Med. 2008 ; 27 (9). 1329-50 (Pubitemid 351524106)
3. Rowena J, Maria G. How do performance indicators add up? An examination of composite indicators in public services. Public Money & Management. 2007 ; 27 (2). 103
4. Hurtado MP, Swift EK, Corrigan J United States. Agency for Healthcare Research and Quality. Envisioning the National Health Care Quality Report. Washington, DC: National Academy Press ; 2001 :
5. Agency for Healthcare Research and Quality. Quality Indicators Patient Safety Indicators (PSI) Composite Measure (cited30May2009). Available from: URL: http://www.qualityindicators.ahrq.gov/news/AHRQ-PSI-Composite-Draft.pdf.
6. Reeves D, Campbell SM, Adams J, Shekelle PG, Kontopantelis E, Roland MO. Combining multiple indicators of clinical quality: an evaluation of different analytic approaches. Med Care. 2007 ; 45 (6). 489-96
7. Timbie JW, Normand SL. A comparison of methods for combining quality and efficiency performance measures: profiling the value of hospital care following acute myocardial infarction. Stat Med. 2008 ; 27 (9). 1351-70 (Pubitemid 351524107)
8. Aron D, Rajan M, Pogach LM. Summary measures of quality of diabetes care: comparison of continuous weighted performance measurement and dichotomous thresholds. Int J Qual Health Care. 2007 ; 19 (1). 29-36 (Pubitemid 46237988)
9. Scholle SH, Roski J, Adams JL, Dunn DL, Kerr EA, Dugan DP, et al. Benchmarking physician performance: reliability of individual and composite measures. Am J Manag Care. 2008 ; 14 (12). 833-8
10. Lin CC, Lai MS, Syu CY, Chang SC, Tseng FY. Accuracy of diabetes diagnosis in health insurance claims data in Taiwan. J Formos Med Assoc. 2005 ; 104 (3). 157-63 (Pubitemid 44524953)
11. Pham HH, Schrag D, O'Malley AS, Wu B, Bach PB. Care patterns in Medicare and their implications for pay for performance. N Engl J Med. 2007 ; 356 (11). 1130-9 (Pubitemid 46425597)
12. British Medical Association. Revisions to the GMS contract 2006/07 (cited26June2006). Available from: URL: http://www.bma.org.uk/ap.nsf/Content/ revisionnGMSFeb20062.
13. Kaplan SH, Griffith JL, Price LL, Pawlson LG, Greenfield S. Improving the reliability of physician performance assessment: identifying the "physician effect" on quality and creating composite measures. Med Care. 2009 ; 47 (4). 378-87
14. Bainbridge KE, Cowie CC, Rust KF, Fradkin JE. Mitigating case mix factors by choice of glycemic control performance measure threshold. Diabetes Care. 2008 ; 31 (9). 1754-60
15. O'Brien SM, Shahian DM, DeLong ER, Normand SL, Edwards FH, Ferraris VA, et al. Quality measurement in adult cardiac surgery, part 2: statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg. 2007 ; 83 (4 Suppl). S13-26
16. Hermansa E, Bosscheb FVd, Wets G. Combining road safety information in a performance index. Accid Anal Prev. 2008 ; 40 (4). 1337-44
17. Shwartz M, Ren J, Pekoz EA, Wang X, Cohen AB, Restuccia JD. Estimating a composite measure of hospital quality from the Hospital Compare database: differences when using a Bayesian hierarchical latent variable model versus denominator-based weights. Med Care. 2008 ; 46 (8). 778-85
18. O'Brien SM, DeLong ER, Dokholyan RS, Edwards FH, Peterson ED. Exploring the behavior of hospital composite performance measures: an example from coronary artery bypass surgery. Circulation. 2007 ; 116 (25). 2969-75 (Pubitemid 350291204)
19. Nolan T, Berwick DM. All-or-none measurement raises the bar on performance. JAMA. 2006 ; 295 (10). 1168-70 (Pubitemid 43352347)
20. Peterson ED, Delong ER, Masoudi FA, O'Brien SM, Peterson PN, Rumsfeld JS, et al. ACCF/AHA 2010 Position Statement on Composite Measures for Healthcare Performance Assessment: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Performance Measures (Writing Committee to develop a position statement on composite measures). Circulation. 2010 ; 121 (15). 1780-91
21. Normand SL, Wolf RE, McNeil BJ. Discriminating quality of hospital care in the United States. Med Decis Making. 2008 ; 28 (3). 308-22 (Pubitemid 351713295)
22. Feinstein AR. Clinimetric perspectives. J Chronic Dis. 1987 ; 40 (6). 635-40 (Pubitemid 17084812)
23. Fayers PM, Hand DJ. Causal variables, indicator variables and measurement scales: an example from quality of life. J Roy Stat Soc. 2002 ; 165: 233-61
24. Landrum MB, Bronskill SE, Normand S-L. Analytic methods for constructing cross-sectional profiles of health care providers. Heal Serv Out Res Meth. 2000 ; 1 (1). 23-47 (Pubitemid 32798839)
25. Bross IDJ. How to Use Ridit Analysis. Biometrics. 1958 ; 14 (1). 18-38
26. Lieberthal RD. Hospital quality: a PRIDIT approach. Health Serv Res. 2008 ; 43 (3). 988-1005 (Pubitemid 351623965)
27. Glickman SW, Boulding W, Roos JM, Staelin R, Peterson ED, Schulman KA. Alternative pay-for-performance scoring methods: implications for quality improvement and patient outcomes. Med Care. 2009 ; 47 (10). 1062-8
28. Reise SP, Widaman KF, Pugh RH. Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. Psychol Bull. 1993 ; 114 (3). 552-66
29. Spiegelhalter DJ, Best NG, Carlin BP, van der Linde A. Bayesian measures of model complexity and fit. J Roy Stat Soc Series B. 2002 ; 64 (4). 583-639
30. Caldis T. Composite health plan quality scales. Health Care Financ Rev. 2007 ; 28 (3). 95-107 (Pubitemid 46870141)
31. Sharma SC Applied Multivariate Techniques. New York, Chichester, UK: Wiley ; 1996 :
32. Centers for Medicare & Medicaid Services. Hospital Quality Incentive Demonstration (cited4March2007). Available from: URL: http://www.premierinc.com/ quality-safety/tools-services/p4p/hqi/index.jsp.
33. Rosner B Fundamentals of Biostatistics. 6 th ed.Belmont, CA: Thomson-Brooks/Cole; 2006. Belmont, CA: Thomson-Brooks/Cole ; 2006 :
34. Efron B, Tibshirani R An Introduction to the Bootstrap. New York: Chapman & Hall ; 1993 :
35. O'Brien RM. Estimating the reliability of aggregate-level variables based on individual-level characteristics. Sociol Methods Res. 1990 ; 18: 473-504
36. Murphy KR, Davidshofer CO Psychological Testing: Principles and Applications. 6 th ed.Upper Saddle River, NJ: Pearson/Prentice Hall; 2005. Upper Saddle River, NJ: Pearson/Prentice Hall ; 2005 :
37. Zhang Z, McArdle J, Wang L, Hamagami F. A SAS interlace for Bayesian analysis with winBUGS. Struct Equ Modeling. 2008 ; 15: 705-28
38. Loeb JM. The current state of performance measurement in health care. Int J Qual Health Care. 2004 ; 16 (Suppl 1). i5-9
39. Patrick LB, Richard AD, Linda LG, Arnold L, Mark A. Fraud classification using principal component analysis of RIDITs. J Risk Insur. 2002 ; 69 (3). 341-71
40. Kelley E. All or none measurement: why we know so little about the comprehensiveness of care. Int J Qual Health Care. 2007 ; 19 (1). 1-3 (Pubitemid 46237984)
41. Vogeli C, Kang R, Landrum MB, Hasnain-Wynia R, Weissman JS. Quality of care provided to individual patients in US hospitals: results from an analysis of national Hospital Quality Alliance data. Med Care. 2009 ; 47 (5). 591-9
42. Staiger DO, Dimick JB, Baser O, Fan Z, Birkmeyer JD. Empirically derived composite measures of surgical performance. Med Care. 2009 ; 47 (2). 226-33
43. CMS. U.S. Department of Health and Human Services Medicare Hospital Value-Based purchasing:Options paper (cited4November2007). Available from: URL: http://www.cms.hhs.gov/AcuteInpatientPPS/downloads/HospitalVBPOptions.pdf.
44. Reeves D, Doran T, Valderas JM, Kontopantelis E, Trueman P, Sutton M, et al. How to identify when a performance indicator has run its course. BMJ. 2010 ; 340: c1717
45. Lester H, Schmittdiel J, Selby J, Fireman B, Campbell S, Lee J, et al. The impact of removing financial incentives from clinical quality indicators: longitudinal analysis of 4 Kaiser Permanente indicators. BMJ. 2010 ; 340: c1898
46. Voorham J, Denig P, Wolffenbuttel BH, Haaijer-Ruskamp FM. Cross-sectional versus sequential quality indicators of risk factor management in patients with type 2 diabetes. Med Care. 2008 ; 46 (2). 133-41
47. Thompson W, Wang H, Xie M, Kolassa J, Rajan M, Tseng CL, et al. Assessing quality of diabetes care by measuring longitudinal changes in hemoglobin A1c in the Veterans Health Administration. Health Serv Res. 2005 ; 40 (6 Pt 1). 1818-35 (Pubitemid 41818944)
48. Pogach LM, Rajan M, Aron DC. Comparison of weighted performance measurement and dichotomous thresholds for glycemic control in the Veterans Health Administration. Diabetes Care. 2006 ; 29 (2). 241-6 (Pubitemid 44106499)
49. Pogach L, Engelgau M, Aron D. Measuring progress toward achieving hemoglobin A1c goals in diabetes care: pass/fail or partial credit. JAMA. 2007 ; 297 (5). 520-3 (Pubitemid 46220807)
50. Hayward RA. All-or-nothing treatment targets make bad performance measures. Am J Manag Care. 2007 ; 13 (3). 126-8 (Pubitemid 46435370)
51. Chung KP, Lai MS, Cheng SH, Tang ST, Huang CC, Cheng AL, et al. Organization-based performance measures of cancer care quality: core measure development for breast cancer in Taiwan. Eur J Cancer Care. 2008 ; 17 (1). 5-18
52. McGlynn EA. Selecting common measures of quality and system performance. Med Care. 2003 ; 41 (Suppl 1). I39-47
53. Mainz J. Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care. 2003 ; 15 (Suppl 1). i5-11
54. Jacobs R, Goddard M, Smith PC. How robust are hospital ranks based on composite performance measures?. Med Care. 2005 ; 43 (12). 1177-84 (Pubitemid 43012174)
55. Sachdeva A, Cannon CP, Deedwania PC, Labresh KA, Smith SC, Dai D, et al. Lipid levels in patients hospitalized with coronary artery disease: an analysis of 136,905 hospitalizations in Get With The Guidelines. Am Heart J. 2009 ; 157 (1). 111 e2-7
56. Pasisz D, Hurtz G. Testing for between-group differences in within-group interrater agreement. Organizational Research Methods. 2009 ; 12 (3). 590
57. Hanley JA, Negassa A, Edwardes MD, Forrester JE. Statistical analysis of correlated data using generalized estimating equations: an orientation. Am J Epidemiol. 2003 ; 157 (4). 364-75 (Pubitemid 36196757)
58. Meduru P, Helmer D, Rajan M, Tseng CL, Pogach L, Sambamoorthi U. Chronic illness with complexity: implications for performance measurement of optimal glycemic control. J Gen Intern Med. 2007 ; 22 (Suppl 3). 408-18 (Pubitemid 350172455)
59. Young BA, Lin E, Von Korff M, Simon G, Ciechanowski P, Ludman EJ, et al. Diabetes complications severity index and risk of mortality, hospitalization, and healthcare utilization. Am J Manag Care. 2008 ; 14 (1). 15-23
60. McLean G, Sutton M, Guthrie B. Deprivation and quality of primary care services: evidence for persistence of the inverse care law from the UK Quality and Outcomes Framework. J Epidemiol Community Health. 2006 ; 60 (11). 917-22 (Pubitemid 44690078)