Profiling Individual Surgeon Performance Using Information from a High-Quality Clinical Registry: Opportunities and Limitations

Journal of the American College of Surgeons

Volumn 221, Issue 5, 2015, Pages 901-913

  Hall, Bruce Lee ^a,b,c   Huffman, Kristopher M ^c   Hamilton, Barton H ^b   Paruch, Jennifer L ^c,d   Zhou, Lynn ^c   Richards, Karen E ^c   Cohen, Mark E ^c   Ko, Clifford Y ^c,e  

^a BJC HEALTHCARE   (United States)

^b WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^c AMERICAN COLLEGE OF SURGEONS   (United States)

^d UNIVERSITY OF CHICAGO   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; DATA ANALYSIS; HUMAN; MODEL; MORBIDITY; MORTALITY; NORMAL HUMAN; OUTCOME ASSESSMENT; PERFORMANCE MEASUREMENT SYSTEM; POSTOPERATIVE PERIOD; PRIORITY JOURNAL; REGISTER; RELIABILITY; RISK ASSESSMENT; STANDARDIZATION; SURGEON; SURGEON PERFORMANCE; SURGEON PROFILE; SURGICAL INFECTION; EVALUATION STUDY; HEALTH CARE QUALITY; POSTOPERATIVE COMPLICATIONS; PROCEDURES; QUALITY CONTROL; REPRODUCIBILITY; STANDARDS; STATISTICAL MODEL; TOTAL QUALITY MANAGEMENT; UNITED STATES;

BENCHMARKING; CLINICAL COMPETENCE; HUMANS; MODELS, STATISTICAL; POSTOPERATIVE COMPLICATIONS; QUALITY IMPROVEMENT; QUALITY INDICATORS, HEALTH CARE; REGISTRIES; REPRODUCIBILITY OF RESULTS; RISK ADJUSTMENT; SURGEONS; UNITED STATES;

EID: 84945440988     PISSN: 10727515     EISSN: 18791190     Source Type: Journal    
DOI: 10.1016/j.jamcollsurg.2015.07.454     Document Type: Article

References (20)

1. J.L. Adams, A. Mehrotra, J.W. Thomas, and E.A. McGlynn Physician cost profiling-reliability and risk of misclassification N Engl J Med 362 2010 1014 1021
2. J.L. Adams The reliability of provider profiling: a tutorial 2009 RAND Corporation Available at: http://www.rand.org/pubs/technical-reports/TR653.html. Accessed July 30, 2015
3. Deutsch A, Smith L, Gage B, et al. Patient-Reported Outcomes in Performance Measurement: Commissioned Paper on PRO-Based Performance Measures for Healthcare Accountable Entities. Prepared for NQF by RTI International and the Brookings Institution; 2012. Available at: http://www.qualityforum.org/Projects/n-r/Patient-Reported-Outcomes/Patient-Reported-Outcomes.aspx#t=2&s=&p=2%7C. Accessed July 30, 2015.
4. K.M. Huffman, M.E. Cohen, C.Y. Ko, and B.L. Hall A comprehensive evaluation of statistical reliability in ACS NSQIP profiling models Ann Surg 261 2015 1108 1113
5. L.S. Kao, A.A. Ghaferi, C.Y. Ko, and et al. Reliability of superficial surgical site infections as a hospital quality measure J Am Coll Surg 213 2011 231 235
6. E.H. Lawson, C.Y. Ko, J.L. Adams, and et al. Reliability of evaluating hospital quality by colorectal surgical site infection type Ann Surg 258 2013 994 1000
7. R.P. Merkow, B.L. Hall, M.E. Cohen, and et al. Validity and feasibility of the American College of Surgeons colectomy composite outcome quality measure Ann Surg 257 2013 483 489
8. J.L. Fleiss Statistical Methods for Rates and Proportions 2nd ed. 1981 John Wiley & Sons, Inc New York, NY
9. J.R. Landis, and G.G. Koch The measurement of observer agreement for categorical data Biometrics 33 1977 159 174
10. T. Shih, and J.B. Dimick Reliability of readmission rates as a hospital quality measure in cardiac surgery Ann Thorac Surg 97 2014 1214 1218
11. M.E. Cohen, C.Y. Ko, K.Y. Bilimoria, and et al. Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: Patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus J Am Coll Surg 217 2013 336 346
12. Dai J, Li Z, Rocke D. Hierarchical logistic regression modeling with SAS GLIMMIX. Available at: http://www.lexjansen.com/wuss/2006/Analytics/ANL-Dai.pdf. Accessed November 14, 2014.
13. A.H. Leyland, and H.E. Goldstein Multilevel Modeling of Health Statistics 2001 John Wiley & Sons, Ltd Chichester
14. H. Brown, and R. Prescott Applied Mixed Models in Medicine 1999 John Wiley & Sons, Ltd Chichester
15. J.M. Saito, L.E. Chen, B.L. Hall, and et al. Risk-adjusted hospital outcomes for children's surgery Pediatrics 132 2013 677 688
16. K. Walker, J. Neuburger, O. Groene, and et al. Public reporting of surgeon outcomes: low numbers of procedures lead to false complacency Lancet 382 2013 1674 1677
17. A. Khajuria Public reporting of surgeon outcomes in the United Kingdom: Potential caveats Int J Surg 12 2014 369 370
18. National Quality Forum. #0697 Risk adjusted case mix adjusted elderly surgery outcomes measure. Available at: http://www.qualityforum.org/QPS/QPSTool.aspx#qpsPageState=%7B%22TabType%22%3A1,%22TabContentType%22%3A2,%22SearchCriteriaForStandard%22%3A%7B%22TaxonomyIDs%22%3A%5B%5D,%22SelectedTypeAheadFilterOption%22%3A%7B%22ID%22%3A11,%22FilterOptionLabel%22%3A%220697%22,%22TypeOfTypeAheadFilterOption%22%3A4,%22TaxonomyId%22%3A0%7D,%22Keyword%22%3A%220697%22,%22PageSize%22%3A%2225%22,%22OrderType%22%3A3,%22OrderBy%22%3A%22ASC%22,%22PageNo%22%3A1,%22IsExactMatch%22%3Afalse,%22QueryStringType%22%3A%22%22,%22ProjectActivityId%22%3A%220%22,%22FederalProgramYear%22%3A%220%22,%22FederalFiscalYear%22%3A%220%22,%22FilterTypes%22%3A2%7D,%22SearchCriteriaForForPortfolio%22%3A%7B%22Tags%22%3A%5B%5D,%22FilterTypes%22%3A0,%22PageStartIndex%22%3A1,%22PageEndIndex%22%3A25,%22PageNumber%22%3Anull,%22PageSize%22%3A%2225%22,%22SortBy%22%3A%22Title%22,%22SortOrder%22%3A%22ASC%22,%22SearchTerm%22%3A%22%22%7D,%22ItemsToCompare%22%3A%5B%5D,%22SelectedStandardIdList%22%3A%5B%5D,%22StandardID%22%3A11,%22EntityTypeID%22%3A1%7D. Accessed July 30, 2015.
19. National Quality Forum. #0706 Risk adjusted colon surgery outcome measure. Available at: http://www.qualityforum.org/QPS/QPSTool.aspx#qpsPageState=%7B%22TabType%22%3A1,%22TabContentType%22%3A2,%22SearchCriteriaForStandard%22%3A%7B%22TaxonomyIDs%22%3A%5B%5D,%22SelectedTypeAheadFilterOption%22%3A%7B%22ID%22%3A0,%22FilterOptionLabel%22%3A%22706%22,%22TypeOfTypeAheadFilterOption%22%3A1,%22TaxonomyId%22%3A0,%22FilterOptionLabe%22%3A%22706%22%7D,%22Keyword%22%3A%220706%22,%22PageSize%22%3A%2225%22,%22OrderType%22%3A3,%22OrderBy%22%3A%22ASC%22,%22PageNo%22%3A1,%22IsExactMatch%22%3Afalse,%22QueryStringType%22%3A%22%22,%22ProjectActivityId%22%3A%220%22,%22FederalProgramYear%22%3A%220%22,%22FederalFiscalYear%22%3A%220%22,%22FilterTypes%22%3A2%7D,%22SearchCriteriaForForPortfolio%22%3A%7B%22Tags%22%3A%5B%5D,%22FilterTypes%22%3A0,%22PageStartIndex%22%3A1,%22PageEndIndex%22%3A25,%22PageNumber%22%3Anull,%22PageSize%22%3A%2225%22,%22SortBy%22%3A%22Title%22,%22SortOrder%22%3A%22ASC%22,%22SearchTerm%22%3A%22%22%7D,%22ItemsToCompare%22%3A%5B%5D,%22SelectedStandardIdList%22%3A%5B%5D,%22StandardID%22%3A2,%22EntityTypeID%22%3A1%7D. Accessed July 30, 2015.
20. National Quality Forum. #0751 Risk adjusted urinary tract infection outcome measure after surgery. Available at: http://www.qualityforum.org/QPS/QPSTool.aspx#qpsPageState=%7B%22TabType%22%3A1,%22TabContentType%22%3A2,%22SearchCriteriaForStandard%22%3A%7B%22TaxonomyIDs%22%3A%5B%5D,%22SelectedTypeAheadFilterOption%22%3A%7B%22ID%22%3A16,%22FilterOptionLabel%22%3A%220751%22,%22TypeOfTypeAheadFilterOption%22%3A4,%22TaxonomyId%22%3A0%7D,%22Keyword%22%3A%220751%22,%22PageSize%22%3A%2225%22,%22OrderType%22%3A3,%22OrderBy%22%3A%22ASC%22,%22PageNo%22%3A1,%22IsExactMatch%22%3Afalse,%22QueryStringType%22%3A%22%22,%22ProjectActivityId%22%3A%220%22,%22FederalProgramYear%22%3A%220%22,%22FederalFiscalYear%22%3A%220%22,%22FilterTypes%22%3A2%7D,%22SearchCriteriaForForPortfolio%22%3A%7B%22Tags%22%3A%5B%5D,%22FilterTypes%22%3A0,%22PageStartIndex%22%3A1,%22PageEndIndex%22%3A25,%22PageNumber%22%3Anull,%22PageSize%22%3A%2225%22,%22SortBy%22%3A%22Title%22,%22SortOrder%22%3A%22ASC%22,%22SearchTerm%22%3A%22%22%7D,%22ItemsToCompare%22%3A%5B%5D,%22SelectedStandardIdList%22%3A%5B%5D,%22StandardID%22%3A16,%22EntityTypeID%22%3A1%7D. Accessed July 30, 2015.