A classification of errors in lay comprehension of medical documents

Journal of Biomedical Informatics

Volumn 45, Issue 6, 2012, Pages 1151-1163

  Keselman, Alla ^a   Smith, Catherine Arnott ^b  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b University of Wisconsin Madison   (United States)

Author keywords

Classification; Clinical documentation; Consumer health; Content analysis; Information literacy; Patients

Indexed keywords

BRAND NAMES; CLASSIFICATION SCHEME; CLINICAL DOCUMENTATION; CLINICAL RESEARCH; CLINICAL TERMS; CLINICAL TRIAL; CONTENT ANALYSIS; HEALTH CARE PROVIDERS; HEALTH EDUCATION; HIERARCHICAL CLASSIFICATION; IN-DEPTH UNDERSTANDING; INFORMATICS; INFORMATION LITERACY; MEDICAL DOCUMENTS; MEDICAL INFORMATION; PATIENT-PROVIDER COMMUNICATION; PATIENTS; PERSONAL HEALTH RECORD;

CLASSIFICATION (OF INFORMATION); ERRORS; HEALTH CARE; INFORMATION SCIENCE; TEXT PROCESSING;

INFORMATION RETRIEVAL SYSTEMS;

ADULT; AGED; ARTICLE; CLINICAL CLASSIFICATION; CLINICAL TRIAL (TOPIC); CODING; COMPREHENSION; FEMALE; HUMAN; INFORMATION PROCESSING; MALE; MEDICAL DOCUMENTATION; MEDICAL ERROR; MEDICAL TERMINOLOGY; MEDICATION ERROR; PRESCRIPTION; PRIORITY JOURNAL; TAXONOMY;

ADULT; AGED; COMPREHENSION; FEMALE; HEALTH RECORDS, PERSONAL; HUMANS; MALE; MEDICAL ERRORS; MIDDLE AGED; OFFICE VISITS;

EID: 84869884108     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2012.07.012     Document Type: Article

References (74)

1. U.S. Department of Health and Human Services, National Cancer Institute, and National Committee on Vital and Health Statistics (2006, February). Personal health records and personal health record systems. Bethesda, MD: U.S. Department of Health and Human Services. <> [accessed 06.11.11]. http://www.himss.org/asp/contentredirector.asp?contentid=78505.
2. Brennan PF, Downs S, Casper G, Kenron D. Project HealthDesign: stimulating the next generation of personal health records. In: AMIA annu symp proc; 2007 October 11. p. 70-4. [PubMed PMID: 18693800; PubMed Central PMCID: PMC2655909].
3. Brennan P.F., Casper G., Downs S., Aulahk V. Project HealthDesign: enhancing action through information. Stud Health Technol Inform 2009, 146:214-218. [PubMed PMID:19592837].
4. Hampton T. Groups push physicians and patients to embrace electronic health records. JAMA 2008, 299(5):507-509. [PubMed PMID: 18252875].
5. Stevens M.M. " Shuttle sheet" : a patient-held medical record for pediatric oncology families. Med Pediatr Oncol 1992, 20(4):330-335. [PubMed PMID: 1608356].
6. Kaelber D.C., Jha A.K., Johnston D., Middleton B., Bates D.W. A research agenda for personal health records (PHRs). J Am Med Inform Assoc 2008, 15(6):729-736. [PubMed PMID: 18756002].
7. Health Information Management Systems Society. HIMSS personal health records definition and position statement (2007, September 28). <> [accessed 06.11.11]. http://www.himss.org/content/files/PHRDefinition071707.pdf.
8. Marshall P. Keeping tabs. How personal health records are changing the face of healthcare. Mark Health Serv 2009, 29(4):20-25. [PubMed PMID: 20043413].
9. Wynia M.K., Torres G.W., Lemieux J. Many physicians are willing to use patients' electronic personal health records, but doctors differ by location, gender, and practice. Health Aff (Millwood) 2011, 30(2):266-273. [Erratum in: Health Aff (Millwood). 2011 Jun;30(6):1217. PubMed PMID: 21289348].
10. Wuerdeman L., Volk L., Pizziferri L., Tsurikova R., Harris C., Feygin R., et al. How accurate is information that patients contribute to their Electronic Health Record?. AMIA Annu Symp Proc 2005, 834-838. [PubMed PMID: 16779157].
11. Kim M.I., Johnson K.B. Patient entry of information: evaluation of user interfaces. J Med Internet Res 2004, 6(2):e13. [PubMed PMID: 15249262; PubMed Central PMCID: PMC1550597].
12. Kim E.H., Stolyar A., Lober W.B., Herbaugh A.L., Shinstrom S.E., Zierler B.K., et al. Challenges to using an electronic personal health record by a low-income elderly population. J Med Internet Res 2009, 11(4):e44.
13. Tran D.T., Zhang X., Stolyar A., Lober W.B. Patient-centered design for a personal health record system. AMIA Annu Symp Proc 2005, 1140. [PubMed PMID: 16779426; PubMed Central PMCID: PMC1560647].
14. Lober W.B., Zierler B., Herbaugh A., Shinstrom S.E., Stolyar A., Kim E.H., et al. Barriers to the use of a personal health record by an elderly population. AMIA Annu Symp Proc 2006, 1:514-518. [PubMed PMID: 17238394; PubMed Central PMCID: PMC1839577].
15. Britto M.T., Jimison H.B., Munafo J.K., Wissman J., Rogers M.L., Hersh W. Usability testing finds problems for novice users of pediatric portals. J Am Med Inform Assoc 2009, 16(5):660-669. [Epub 2009 June 30. PubMed PMID: 19567793; PubMed Central PMCID: PMC2744717].
16. Ming M.E., Levy R.M., Hoffstad O.J., Filip J., Gimotty P.A., Margolis D.J. Validity of patient self-reported history of skin cancer. Arch Dermatol 2004, 140(6):730-735. [PubMed PMID: 15210466].
17. Khoja S., McGregor S.E., Hilsden R.J. Validation of self-reported history of colorectal cancer screening. Can Fam Physician 2007, 53(7):1192-1197. [PubMed PMID: 17872816].
18. Porter S.C., Fleisher G.R., Kohane I.S., Mandl K.D. The value of parental report for diagnosis and management of dehydration in the emergency department. Ann Emerg Med 2003, 41(2):196-205. [PubMed PMID: 12548269].
19. Ross S.E., Lin C.T. The effects of promoting patient access to medical records: a review. J Am Med Inform Assoc 2003, 10(2):129-138. [PubMed PMID:12595402].
20. Businger A., Buckel L., Gandhi T., Grant R., Poon E., Schnipper J., et al. Patient review of selected electronic health record data improves visit experience. AMIA Annu Symp Proc 2007, 11(October):887. [PubMed PMID: 18693988].
21. Keselman A., Slaughter L., Smith C.A., Kim H., Divita G., Browne A., et al. Towards consumer-friendly PHRs: patients' experience with reviewing their health records. AMIA Annu Symp Proc 2007, 11(October):399-403. [PubMed PMID: 18693866].
22. Archer N., Fevrier-Thomas U., Lokker C., McKibbon K.A., Straus S.E. Personal health records: a scoping review. J Am Med Inform Assoc 2011, 18:515-522. [PubMed PMID: 21672914].
23. Lee M., Delaney C., Moorhead S. Building a personal health record from a nursing perspective. Int J Med Inform 2007, 76(Suppl. 2):S308-S316. [Epub 2007 July 5. PubMed PMID: 17616432].
24. Marchionini G, Rimer BK, Wildemuth B. Evidence base for personal health record usability: final report to the National Cancer Institute; 2007. <>. [accessed 06.11.11]. http://ils.unc.edu/phr/files/final%20report%20010307.pdf.
25. Maloney F.L., Wright A. USB-based Personal Health Records: an analysis of features and functionality. Int J Med Inform 2010, 79(2):97-111. [Epub 2010 January 6. PubMed PMID: 20053582].
26. Baorto D., Li L., Cimino J.J. Practical experience with the maintenance and auditing of a large medical ontology. J Biomed Inform 2009, 42(3):494-503. [Epub 2009 March 12. PubMed PMID: 19285569].
27. Zeng-Treitler Q., Goryachev S., Kim H., Keselman A., Rosendale D. Making texts in electronic health records comprehensible to consumers: a prototype translator. AMIA Annu Symp Proc 2007, 11(October):846-850. [PubMed PMID: 18693956].
28. Cardillo E., Tamilin A., Serafini L. A methodology for knowledge acquisition in consumer-oriented healthcare. Commun Comput Inf Sci 2011, 128(3):249-261.
29. Brennan P.F., Downs S., Casper G. Project HealthDesign: rethinking the power and potential of personal health records. J Biomed Inform 2010, 43(5 Suppl.):S3-S5. [PubMed PMID: 20937482].
30. Adnan M., Warren J., Orr M. Enhancing patient readability of discharge summaries with automatically generated hyperlinks. Health Care Inform Rev Online 2009, 13(4).
31. Paasche-Orlow M.K., Taylor H.A., Brancati F.L. Readability standards for informed-consent forms as compared with actual readability. N Engl J Med 2003, 348(8):721-726. ***[PubMed PMID: 12594317].
32. Joffe S., Cook E.F., Cleary P.D., Clark J.W., Weeks J.C. Quality of informed consent in cancer clinical trials: a cross-sectional survey. Lancet 2001, 358(9295):1772-1777. [PubMed PMID: 11734235].
33. Olver I.N., Whitford H.S., Denson L.A., Peterson M.J., Olver S.I. Improving informed consent to chemotherapy: a randomized controlled trial of written information versus an interactive multimedia CD-ROM. Patient Educ Couns 2009, 74(2):197-204. [Epub 2008 October 21. PubMed PMID: 18945572].
34. Flory J., Emanuel E. Interventions to improve research participants' understanding in informed consent for research: a systematic review. JAMA 2004, 292(13):1593-1601. [PubMed PMID: 15467062].
35. Kang E.Y., Fields H.W., Kiyak A., Beck F.M., Firestone A.R. Informed consent recall and comprehension in orthodontics: traditional vs improved readability and processability methods. Am J Orthod Dentofacial Orthop 2009, 136(4):488.e1-488.e13. [discussion 488-9. PubMed PMID: 19815144].
36. Dovey S.M., Meyers D.S., Phillips R.L., Green L.A., Fryer G.E., Galliher J.M., et al. A preliminary taxonomy of medical errors in family practice. Qual Saf Health Care 2002, 11:233-238. [PubMed PMID: 12486987].
37. Benner P., Sheets V., Uris P., Malloch K., Schwed K., Jamison D. Individual, practice, and system causes of errors in nursing. A taxonomy. J Nurs Adm 2002, 32:509-523.
38. Ely J.W., Levinson W., Elder N.C., Mainous A.G., Vinson D.C. Perceived causes of family physicians' errors. J Fam Pract 1995, 40:337-344. [PubMed PMID: 7699346].
39. Davis T. Paediatric prescribing errors. Arch Dis Child 2011, 96:489-491. [PubMed PMID: 21109509].
40. Chang A., Schyve P.M., Croteau R.J., O'Leary D.S., Loeb J.M. The JCAHO patient safety event taxonomy: a standardized terminology and classification schema for near misses and adverse events. Int J Qual Health Care 2005, 17(2):93-94. [PubMed PMID: 15723817].
41. Zhang J., Patel V.L., Johnson T.R., Shortliffe E.H. A cognitive taxonomy of medical errors. J Biomed Inform 2004, 37(3):193-204. [PubMed PMID: 15196483].
42. Chan CV, Matthews LA, Kaufman DR. A taxonomy characterizing complexity of consumer eHealth Literacy. In: AMIA annu symp proc, November 14; 2009. p. 86-90 [PubMed PMID: 20351828].
43. Ancker J.S., Kaufman D. Rethinking health numeracy: a multidisciplinary literature review. J Am Med Inform Assoc 2007, 14(6):713-721. [Epub 2007 August 21. PubMed PMID: 17712082].
44. Dictionary of the social sciences 2002, Oxford University Press, USA, Cary, NC, 584 p. C. Craig (Ed.).
45. Tang PC, Black W, Young CY. Proposed criteria for reimbursing eVisits: content analysis of secure patient messages in a personal health record system. In: AMIA annu symp proc; 2006. p. 764-8 [PubMed PMID: 17238444].
46. Lovasz N., Clarke J. Life beyond depression: the experience of gays and lesbians who self-identify as depressed. J LGBT Health Res 2007, 3(4):53-73. [PubMed PMID: 19042910].
47. Dukes R.L., Borega K.N., Clayton S.L., Dukes C.K., Fox C., McCombs J., et al. Tainted love: content analysis of documents written by accused spousal abusers to their victims. Psychol Rep 2002, 90(2):679-684. [PubMed PMID: 12061614].
48. McGinn C.A., Grenier S., Duplantie J., Shaw N., Sicotte C., Mathieu L., et al. Comparison of user groups' perspectives of barriers and facilitators to implementing electronic health records: a systematic review. BMC Med 2011, 9:46. [PubMed PMID: 21524315].
49. Appiah-Poku J., Newton S., Kass N. Participants' perceptions of research benefits in an African genetic epidemiology study. Dev World Bioeth 2011, 11(3):128-135. [PubMed PMID: 22103636].
50. Falk G., Brynhildsen J., Ivarsson A.B. Contraceptive counseling to teenagers at abortion visits - a qualitative content analysis. Eur J Contracept Reprod Health Care 2009, 14(5):357-364. [PubMed PMID: 19916762].
51. Gebru K., Ahsberg E., Willman A. Nursing and medical documentation on patients' cultural background. J Clin Nurs 2007, 16(11):2056-2065. [Epub 2007 March 1. PubMed PMID: 17331097].
52. Clarke E.B., Luce J.M., Curtis J.R., Danis M., Levy M., Nelson J. Robert Wood Johnson Foundation Critical Care End-of-Life Peer Workgroup. A content analysis of forms, guidelines, and other materials documenting end-of-life care in intensive care units. J Crit Care 2004, 19(2):108-117. [PubMed PMID: 15236144].
53. Haas J, Bakken S, Bright TJ, Melton GB, Stetson P, Johnson SB. Clinicians' perceptions of usability of eNote. In: AMIA annu symp proc; 2005. p. 973 [PubMed PMID: 16779260].
54. Arar N., Seo J., Abboud H.E., Parchman M., Noel P. Veterans' experience in using the online Surgeon General's family health history tool. Per Med 2011, 8(5):523-532. [PubMed PMID: 22076122].
55. Ayana M., Pound P., Ebrahim S. The views of therapists on the use of a patient-held record in the care of stroke patients. Clin Rehabil 1998, 12(4):328-337. [PubMed PMID: 9744668].
56. Wibe T., Hellesø R., Slaughter L., Ekstedt M. Lay people's experiences with reading their medical record. Soc Sci Med 2011, 72(9):1570-1573. [Epub 2011 March 24. PubMed PMID: 21497971].
57. Bhavnani V., Fisher B., Winfield M., Seed P. How patients use access to their electronic GP record - a quantitative study. Fam Pract 2011, 28(2):188-194. [Epub 2010 November 17. PubMed PMID: 21084568].
58. Rassin M., Zilcha L., Berger M., Silner D. Personal medical documents management - how patients perceive, keep and manage their medical documents: a qualitative study. Int J Nurs Stud 2007, 44(6):862-868. [Epub 2006 May 5. PubMed PMID: 16678180].
59. Saboor S., Ammenwerth E. Developing a model for the adequate description of electronic communication in hospitals. Stud Health Technol Inform 2011, 169:522-526. [PubMed PMID: 21893804].
60. Whitson H.E., Steinhauser K., Ammarell N., Whitaker D., Cousins S.W., Ansah D., et al. Categorizing the effect of comorbidity: a qualitative study of individuals' experiences in a low-vision rehabilitation program. J Am Geriatr Soc 2011, 59(10):1802-1809. [Epub 2011 September 13. PubMed PMID: 22091493]. 10.1111/j.1532-5415.2011.03602.x.
61. Smith C.A., Hetzel S., Dalrymple P., Keselman A. Beyond readability: investigating coherence of clinical text for consumers. J Med Internet Res 2011, 13(4):e104. [PubMed PMID:22138127].
62. Do N.V., Barnhill R., Heermann-Do K.A., Salzman K.L., Gimbel R.W. The military health system's personal health record pilot with Microsoft HealthVault and Google Health. J Am Med Inform Assoc 2011, 18(2):118-124. [Epub 2011 February 2].
63. Smith, CA. The clinical document architecture: XML semantic markup for enhanced clinical information retrieval. Doctoral dissertation, University of Pittsburgh; 2002.
64. Strauss A., Corbin J. Basics of qualitative research: grounded theory procedures and techniques 1990, Sage Publications, Thousand Oaks, CA, 288p.
65. Neuendorf K.A. The content analysis guidebook 2002, Sage Publications, Thousand Oaks, CA, 320p.
66. Potter J.W., Deborah Levine-Donnerstein D. Rethinking validity and reliability in content analysis. J Appl Commun Res 1999, 27(3):258-284.
67. Lowe H.J., Antipov I., Hersh W., Smith C.A., Mailhot M. Automated semantic indexing of imaging reports to support retrieval of medical images in the multimedia electronic medical record. Methods Inf Med 1999, 8:303-307.
68. Patel V.L., Arocha J.F., Kushniruk A.W. Patients' and physicians' understanding of health and biomedical concepts: relationship to the design of EMR systems. J Biomed Inform 2002, 35(1):8-16. [PubMed PMID: 12415722].
69. Lambert B.L., Chang K.Y., Gupta P. Effects of frequency and similarity neighborhoods on pharmacists' visual perception of drug names. Soc Sci Med 2003, 57(10):1939-1955. [PubMed PMID: 14499517].
70. Koczmara C., Hyland S. Drug name alert: potential for confusion between Pradax and plavix. Dynamics [serial online] 2011, 22(3):25-26. Available from: CINAHL Plus with Full Text, Ipswich, MA. [Accessed 02.11. 11].
71. Senger C., Kaltschmidt J., Schmitt S.P., Pruszydlo M.G., Haefeli W.E. Misspellings in drug information system queries: characteristics of drug name spelling errors and strategies for their prevention. Int J Med Inform 2010, 79(12):832-839. [Epub 2010 October 15. Pubmed PMID: 20951634].
72. Basco W.T., Ebeling M., Hulsey T.C., Simpson K. Using pharmacy data to screen for look-alike, sound-alike substitution errors in pediatric prescriptions. Acad Pediatr 2010, 10(4):233-237. [Epub 2010 June 11. Pubmed PMID: 20541485].
73. Keselman A., Kaufman D.R., Patel V.L. " You can exercise your way out of HIV" and other stories: the role of biological knowledge in adolescents' evaluation of myths. Sci Educ 2004, 88(4):548-573.
74. Keselman A., Browne A.C., Kaufman D.R. Consumer health information seeking as hypothesis testing. J Am Med Inform Assoc 2008, 15(4):484-495. [Epub 2008 April 24. PubMed PMID: 18436912].