A user-study measuring the effects of lexical simplification and coherence enhancement on perceived and actual text difficulty

International Journal of Medical Informatics

Volumn 82, Issue 8, 2013, Pages 717-730

  Leroy, Gondy ^a   Kauchak, David ^b   Mouradi, Obay ^a  

^a CLAREMONT GRADUATE UNIVERSITY   (United States)

^b MIDDLEBURY COLLEGE   (United States)

Author keywords

Comprehension; Consumer health information; Health literacy; Information systems; Medical informatics computing; Patient education; Readability

Indexed keywords

COMPREHENSION; CONSUMER HEALTH INFORMATION; HEALTH LITERACY; MEDICAL INFORMATICS COMPUTING; PATIENT EDUCATION; READABILITY;

ANALYSIS OF VARIANCE (ANOVA); HEALTH; INFORMATION SYSTEMS; MEDICAL COMPUTING;

ABSTRACTING;

ADULT; AGED; ARTICLE; COHERENCE ENHANCEMENT; DATA PROCESSING; EDUCATIONAL STATUS; FEMALE; FOLLOW UP; HEALTH LITERACY; HUMAN; LANGUAGE; LEARNING; LEXICAL SIMPLIFICATION; LIKERT SCALE; MAJOR CLINICAL STUDY; MALE; MEDICAL INFORMATION; MULTIPLE CHOICE TEST; PERCEPTION; PRIORITY JOURNAL; READING; SKILL; SMOKING CESSATION; STIMULATION; STUDY DESIGN;

COMPREHENSION; CONSUMER HEALTH INFORMATION; HEALTH LITERACY; INFORMATION SYSTEMS; MEDICAL INFORMATICS COMPUTING; PATIENT EDUCATION; READABILITY;

ADULT; AGED; COMPREHENSION; CONSUMER HEALTH INFORMATION; FEMALE; HEALTH LITERACY; HUMANS; LANGUAGE TESTS; MALE; MIDDLE AGED; PATIENT EDUCATION AS TOPIC; PERCEPTION; SENSE OF COHERENCE; VOCABULARY; YOUNG ADULT;

EID: 84880042228     PISSN: 13865056     EISSN: 18728243     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2013.03.001     Document Type: Article

References (55)

1. Weis B.D. Health Literacy and Patient Safety: Help Patients Understand. Manual for Clinicians 2007, AMA and AMA Foundation. second ed.
2. Committee on Health Literacy - Institute of Medicine of the National Academies Health Literacy: A Prescription to End Confusion, Book Health Literacy: A Prescription to End Confusion 2004, The National Academies Press.
3. Garbers S., Chiasson M.A. Inadequate functional health literacy in Spanish as a barrier to cervical cancer screening among immigrant Latinas in New York City. Prev. Chronic Dis. 2004, 1(4):1-10.
4. Powell C.K., Hill E.G., Clancy D.E. The relationship between health literacy and diabetes knowledge and readiness to take health actions. Diabetes Educator 2007, 33(1):144-151.
5. Singh A.N. Readability of behavioral treatment programs in mental health. J. Child Fam. Stud. 1999, 8(4):369-375.
6. Bernstam E., Sagaram S., Walji M., Johnson C., Meric-Bernstam F. Usability of quality measures for online health information: can commonly used technical quality criteria be reliably assessed?. Int. J. Med. Inf. 2005, 74(7-8):675-683.
7. Bernstam E.V., Shelton D.M., Walji M., Meric-Bernstam F. Instruments to assess the quality of health information on the World Wide Web: what can our patients actually use?. Int. J. Med. Inf. 2005, 74(1):13-19.
8. Wang Y., Liu Z. Automatic detecting indicators for quality of health information on the web. Int. J. Med. Inf. 2007, 76:575-582.
9. Choi J., Bakken S. Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int. J. Med. Inf. 2010, 79(8):565-575.
10. Janz N.K., Becker M.H. The Health Belief Model: a decade later. Health Educ. Q. 1984, 11:1-47.
11. Davis T.C., Dolan N.C., Ferreira M.R., Tomori C., Green K.W., Sipler A.M., Bennett C.L. The role of inadequate health literacy skills in colorectal cancer screening. Cancer Invest. 2001, 19(2):193-200.
12. Mouradi O., Leroy G., Kauchak D., Endicott J.E. Influence of text and participant characteristics on perceived and actual text difficulty. Proc. Hawaii International Conference on System Sciences 2013.
13. Boscolo P., Mason L. Topic knowledge, text coherence, and interest: how they interact in learning from instructional texts. J. Exp. Educ. 2003, 7(2):126-148.
14. Mullan J., Crookes P.A., Yeatman H. Rain, fog, smog and printed educational material. J. Pharm. Pract. Res. 2003, 33(4):284-286.
15. McLaughlin G.H. SMOG grading: a new readability formula. J. Reading 1969, 12:636-646.
16. Adkins A.D., Singh N.N. Reading level and readability of patient education materials in mental health. J. Child Fam. Stud. 2001, 10(1):1-8.
17. Rathbun A., Thornton L.A., Fox J.E. Are our investments paying off? A study of reading level and bereavement materials. Am. J. Hosp. Palliat. Med. 2008, [Epub ahead of print].
18. Brandt H., McCree D., Lindley L., Sharpe P., Hutto B. An evaluation of printed HPV educational materials. Cancer Control 2005, (Suppl. 2):103-106.
19. Brainard J. Study finds research consent forms difficult to comprehend. The Chronicle of Higher Education 2003, 49(19):A21-A22.
20. Maples P., Franks A., Ray S., Stevens A., Wallace L. Development and validation of a low-literacy Chronic Obstructive Pulmonary Disease knowledge Questionnaire (COPD-Q). Patient Educ. Couns. 2009, 81(1):19-22.
21. Friedman D.B., Corwin S.J., Dominick G.M., Rose I.D. African American men's understanding and perceptions about prostate cancer: why multiple dimensions of health literacy are important in cancer communication. J. Community Health 2009, 34:449-460.
22. Wubben S., van den Bosch A., Krahmer E. Sentence simplification by monolingual machine translation. Proceedings of the Annual Meeting of the Association for Computational Linguistics 2012.
23. Specia L., Jauhar S.K., Mihalcea R. SemEval-2012 Task 1: English lexical simplification. Proc. Joint Conference on Lexical and Computational Semantics (*SEM) 2012.
24. Biran O., Brody S., Elhadad N. Putting it simply: a context-aware approach to lexical simplification. Proceedings of Association of Computational Linguistics 2011.
25. Kandula S., Curtis D., Zeng-Treitler Q. A semantic and syntactic text simplification tool for health content. Proc. AMIA Annu Symp Proc 2010.
26. O'Donnell M.E. Finding middle ground in second language reading: pedagogic modifications that increase comprehensibility and vocabulary acquisition while preserving authentic text features. Mod. Lang. J. 2009, 93:512-533.
27. McNamara D.S., Kintsch E., Songer N.B., Kintsch W. Are good texts always better? Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cognition Instruct. 1996, 14(1):1-43.
28. Adkins A.D., Elkins E.N., Singh N.N. Readability of NIMH easy-to-read patient education materials. J. Child Fam. Stud. 2001, 10(3):279.
29. Kirkpatrick M.A.F., Mohler C.P. Using the Readability Assessment Instrument to evaluate patient medication leaflets. Drug Inf. J. 1999, 33:557-563.
30. Norvig P. 'Inference in text understanding. Proc. National Conference on Artificial Intelligence AAAI-87 1987.
31. Goldman S.R., Murray J.D. Knowledge of connectors as cohesion devices in text: a comparative stud of native-English and English-as-a-second-language speakers. J. Educ. Psychol. 1992, 84(4):504-519.
32. Van Servellen G., Brown J.S., Lombardi E., Herrera G. Health literacy in low-income Latino men and women receiving antiretroviral therapy in community-based treatment centers. Aids Patient Care STDS 2003, 17(6):283-298.
33. Potelle H., Rouet J.-F. Effects of content representation and readers' prior knowledge on the comprehension of hypertext. Int. J. Hum.-Comput. Stud. 2003, 58:327-345.
34. Davis T., Long S., Jackson R., Mayeaux E., George R., Murphy P., Crouch M. Rapid estimate of adult literacy in medicine: a shortened screening instrument. Fam. Med. 1993, 25(6):391-395.
35. McWhirter J., Todd L., Hoffman-Goetz L. Comparing written and oral measures of comprehension of cancer information by English-as-a-second-language Chinese immigrant women. J. Cancer Educ. 2011, 26:484-489.
36. Gazmararian J.A., Kripalani S., Miller M.J., Echt K.V., Ren J., Rask K. Factors associated with medication refill adherence in cardiovascular-related diseases: a focus on health literacy. J. Gen. Intern. Med. 2006, 21(12):1215-1221.
37. Cohen S., Kamarck T., Mermelstein R. A global measure of perceived stress. J. Health Soc. Behav. 1983, 24(4):385-396.
38. Leroy G., Miller T. Perils of providing visual health information overviews for consumers with low health literacy or high stress. J. Am. Med. Inform. Assoc. 2010, 17:220-223.
39. Taylor W.L. Cloze procedure: a new tool for measuring readability. Journalism Quarterly 1953, 30:415-433.
40. Seligman H.K., Wallace A.S., DeWalt D.A., Schillinger D., Arnold C.L., Shilliday B.B., Delgadillo A., Bengal N., Davis T.C. Facilitating behavior change with low-literacy patient education materials. Am. J. Health Behav. 2007, 31(Suppl. 1):S69-S78.
41. Klein D., Manning C.D. Accurate unlexicalized parsing. Proc. 41st Meeting of the Association for Computational Linguistics 2003.
42. Leroy G., Endicott J.E. Term familiarity to indicate perceived and actual difficulty of text in medical digital libraries. Proc. International Conference on Asia-Pacific Digital Libraries (ICADL 2011) - Digital Libraries - for Culture Heritage, Knowledge Dissemination, and Future Creation 2011.
43. Leroy G., Endicott J.E. Combining NLP with evidence-based methods to find text metrics related to perceived and actual text difficulty. Proc. 2nd ACM SIGHIT International Health Informatics Symposium (ACM IHI 2012) 2012.
44. Zarcadoolas C. The simplicity complex: exploring simplified health messages in a complex world. Health Promot. Int. 2010, 26(3):338-350.
45. Ledoux K., Gordon P.C., Camblin C.C., Swaab T.Y. Coreference and lexical repetition: mechanisms of discourse integration. Mem. Cognit. 2007, 35(4):801-815.
46. Ellis W.D. A Source Book of Gestalt Psychology 1938, Trubner & Co., Paul, Trench.
47. Stothers M., Klein P.D. Perceptual organization, phnological awareness, and reading comprehension in adults with and without learning disabilities. Ann. Dyslexia 2010, 60(2):209-237.
48. Paolacci G., Changler J., Ipeirotis P.G. Running experiments on Amazon Mechanical Turk. Running Experiments on Amazon Mechanical Turk 2010, 5(5):411-419.
49. Buhrmester M., Kwang T., Gosling S.D. Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data?. Perspect. Psychol. Sci. 2011, 6(1).
50. Novotney S., Callison-Burch C. Cheap, fast and good enough: automatic speech recognition with non-expert transcription. Proceedings of North American Association for Computational Linguistics 2010.
51. D'Alessandro D., Kingsley P., Johnson-West J. The readability of pediatric patient education materials on the World Wide Web. Arch. Pediatr. Adolesc. Med. 2001, 155:807-812.
52. Kasabwal a.K., Agarwal N., Hansberry D., Baredes S., Eloy J. Readability assessment of patient education materials from the American Academy of Otolaryngology-Head and Neck Surgery Foundation. Otolaryngol. Head Neck Surg. 2012, 147(3):466-471.
53. Schmitt P., Prestigiacomo C. Readability of neurosurgery-related patient education materials provided by the American Association of Neurological Surgeons and the National Library of Medicine and National Institutes of Health. World Neurosurg. 2011.
54. Leroy G., Helmreich S., Cowie J. The influence of text characteristics on perceived and actual difficulty of health information. Int. J. Med. Inf. 2010, 79(6):438-449.
55. Leroy G., Helmreich S., Cowie J.R. The effects of linguistic features and evaluation perspective on perceived difficulty of medical text. Proc. Hawaii International Conference on System Sciences (HICSS) 2010.