Physician inter-annotator agreement in the quality oncology practice initiative manual abstraction task

Journal of Oncology Practice

Volumn 9, Issue 3, 2013, Pages

  Warner, Jeremy L ^a   Anick, Peter ^a   Drews, Reed E ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BREAST CANCER; CANCER PATIENT; CLINICAL ARTICLE; COHORT ANALYSIS; COLORECTAL CANCER; DATA PROCESSING; DOCUMENTATION; ELECTRONIC MEDICAL RECORD; HUMAN; NONHODGKIN LYMPHOMA; PHYSICIAN; QUALITY ONCOLOGY PRACTICE INITIATIVE;

ACADEMIC MEDICAL CENTERS; ELECTRONIC HEALTH RECORDS; HUMANS; MEDICAL INFORMATICS; MEDICAL ONCOLOGY; PHYSICIANS; QUALITY OF HEALTH CARE;

EID: 84883298858     PISSN: 15547477     EISSN: 1935469X     Source Type: Journal    
DOI: 10.1200/JOP.2013.000931     Document Type: Article

References (20)

1. Berwick DM, Winickoff DE: The truth about doctors' handwriting: A prospective study. BMJ 313:1657-1658, 1996 (Pubitemid 27010679)
2. Campion FX, Larson LR, Kadlubek PJ, et al: Advancing performance measurement in oncology: Quality Oncology Practice Initiative participation and quality outcomes. J Oncol Pract 7:31s-35s, 2011 (suppl)
3. Neuss M, Gilmore TR, Kadlubek P: Tools for measuring and improving the quality of oncology care: The Quality Oncology Practice Initiative (QOPI) and the QOPI certification program. Oncology 25:880,883, 886-887, 2011
4. Neuss MN, Desch CE, McNiff KK, et al: A process for measuring the quality of cancer care: The Quality Oncology Practice Initiative. J Clin Oncol 23:6233-6239, 2005
5. Hewitt ME, Simone JV: Ensuring Quality Cancer Care. Washington, DC, National Academies Press, 1999
6. American Society of Clinical Oncology: Quality Oncology Practice Initiative. http://qopi.asco.org
7. Hripcsak G, Rothschild AS: Agreement, the f-measure, and reliability in information retrieval. J Am Med Inform Assoc 12:296-298, 2005 (Pubitemid 40602981)
8. Uzuner O, Solti I, Xia F, et al: Community annotation experiment for ground truth generation for the i2b2 medication challenge J Am Med Inform Assoc 17:519-523, 2010
9. Pustejovsky J, Stubbs A: Natural Language Annotation for Machine Learning. Sebastopol, CA, O'Reilly, 2012
10. Fort K, Nazarenko A, Rosset S: Modeling the complexity of manual annotation tasks: A grid of analysis. International Conference on Computational Linguistics, 895-910, 2012
11. Campbell EM, Sittig DF, Chapman WW, et al: Understanding inter-rater disagreement: A mixed methods approach. AMIA Ann Symp Proc 2010:81-85, 2010
12. Kottner J, Audige L, Brorson S, et al: Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol 64:96-106, 2011
13. Fleiss JL: Statistical Methods for Rates and Proportions (ed 2), New York, NY, Wiley, 1981
14. Davis CL, Pierce JR, Henderson W, et al: Assessment of the reliability of data collected for the Department of Veterans Affairs National Surgical Quality Improvement Program. J Am Coll Surg 204:550-560, 2007 (Pubitemid 46428566)
15. Powell SG, Baker KR, Lawson B: A critical review of the literature on spreadsheet errors. Decision Supp Syst 46:128-138, 2008
16. Rosenbloom ST, Crow AN, Blackford JU, et al: Cognitive factors influencing perceptions of clinical documentation tools. J Biomed Inform 40:106-113, 2007 (Pubitemid 46357042)
17. Rosenbloom ST, Denny JC, Xu H, et al: Data from clinical notes: A perspective on the tension between structure and flexible documentation. J Am Med Inform Assoc 18:181-186, 2011
18. Kern LM, Malhotra S, Barron Y, et al: Accuracy of electronically reported "meaningful use" clinical quality measures: A cross-sectional study. Ann Intern Med 158:77-83, 2013
19. Abernethy AP, Etheredge LM, Ganz PA, et al: Rapid-learning system for cancer care. J Clin Oncol 28:4268-4274, 2010
20. Roth BJ, Krilov L, Adams S, et al: Clinical cancer advances 2012: Annual report on progress against cancer from the American Society of Clinical Oncology. J Clin Oncol 31:131-161, 2013