Designing Visual AIDS That Promote Risk Literacy: A Systematic Review of Health Research and Evidence-Based Design Heuristics

Human Factors

Volumn 59, Issue 4, 2017, Pages 582-627

  Garcia Retamero, Rocio ^a   Cokely, Edward T ^b  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF OKLAHOMA   (United States)

Author keywords

data visualization; graph literacy; graphic usability; heuristic evaluation; numeracy; risk communication; risk literacy; shared decision making; visual AIDS

Indexed keywords

BEHAVIORAL RESEARCH; DATA VISUALIZATION; DECISION MAKING; HEALTH; RISK ASSESSMENT; STATISTICS;

GRAPH LITERACY; GRAPHIC USABILITY; HEURISTIC EVALUATION; NUMERACY; RISK COMMUNICATION; SHARED DECISION MAKINGS; VISUAL AIDS;

HEALTH RISKS;

AUDIOVISUAL AID; DECISION MAKING; DECISION SUPPORT SYSTEM; HEALTH BEHAVIOR; HEALTH LITERACY; HUMAN; MEDICAL RESEARCH; RISK ASSESSMENT;

AUDIOVISUAL AIDS; BIOMEDICAL RESEARCH; DECISION MAKING; DECISION SUPPORT TECHNIQUES; HEALTH BEHAVIOR; HEALTH LITERACY; HUMANS; RISK ASSESSMENT;

EID: 85017002580     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720817690634     Document Type: Review

References (177)

1. Abdel-Kader K., Dew M. A., Bhatnagar M., Argyropoulos C., Karpov I., Switzer G., Unruh M. L., (2010). Numeracy skills in CKD: Correlates and outcomes. Clinical Journal of the American Society of Nephrology, 5, 1566-1573.
2. Ancker J. S., Kaufman D., (2007). Rethinking health numeracy: A multidisciplinary literature review. Journal of the American Medical Informatics Association, 14, 713-721.
3. Ancker J. S., Senathirajah Y., Kukafka R., Starren J. B., (2006). Design features of graphs in health risk communication: A systematic review. Journal of the American Medical Informatics Association, 13, 608-618.
4. Ancker J. S., Weber E. U., Kukafka R., (2011 a). Effect of arrangement of stick figures on estimates of proportion in risk graphics. Medical Decision Making, 31, 143-150.
5. Ancker J. S., Weber E. U., Kukafka R., (2011 b). Effects of game-like interactive graphics on risk perceptions and decisions. Medical Decision Making, 31, 130-142.
6. Anderson B. L., Obrecht N. A., Chapman G. B., Driscoll D. A., Schulkin J., (2011). Physicians' communication of Down syndrome screening test results: The influence of physician numeracy. Genetics in Medicine, 13, 744-749.
7. Anderson B. L., Schulkin J., (2014 a). Numerical reasoning in judgments and decision making about health. Cambridge, UK: Cambridge University Press.
8. Anderson B. L., Schulkin J., (2014 b). Physicians' understanding and use of numeric information. In Anderson B. L., Schulkin J., (Eds.), Numerical reasoning in judgments and decision making about health (pp. 59-79). Cambridge, UK: Cambridge University Press.
9. Apter A. J., Cheng J., Small D., Bennett I. M., Albert C., Fein D. G.,. Van Horne S., (2006). Asthma numeracy skill and health literacy. Journal of Asthma, 43, 705-710.
10. Apter A. J., Wang X., Bogen D., Bennett I. M., Jennings R. M., Garcia L.,. Ten Have T., (2009). Linking numeracy and asthma-related quality of life. Patient Education and Counseling, 75, 386-391.
11. Arunachalam V., Pei B. K., Steinbart P. J., (2002). Impression management with graphs: Effects on choices. Journal of Information Systems, 16, 183-202.
12. Beattie V., Jones M. J., (1992). The use and abuse of graphs in annual reports: Theoretical framework and empirical study. Accounting and Business Research, 22, 291-303.
13. Beattie V., Jones M. J., (2002). Measurement distortion of graphs in corporate reports: An experimental study. Accounting, Auditing & Accountability Journal, 15, 546-564.
14. Brewer N. T., Chapman G. B., Gibbons F. X., Gerrard M., McCaul K. D., Weinstein N. D., (2007). Meta-analysis of the relationship between risk perception and health behavior: The example of vaccination. Health Psychology, 26, 136-145.
15. Brown S. M., Culver J. O., Osann K. E., MacDonald D. J., Sand S., Thornton A. A.,. Burke H. B., (2011). Health literacy, numeracy, and interpretation of graphical breast cancer risk estimates. Patient Education and Counseling, 83, 92-98.
16. Bruine de Bruin W., Parker A. M., Fischhoff B., (2007). Individual differences in adult decision-making competence. Journal of Personality and Social Psychology, 92, 938-956.
17. Bruine de Bruin W., Stone E. R., Gibson J. M., Fischbeck P. S., Shoraka M. B., (2013). The effect of communication design and recipients' numeracy on responses to UXO risk. Journal of Risk Research, 16, 981-1004.
18. Brundage M., Feldman-Stewart D., Leis A., Bezjak A., Degner L., Velji K.,. Pater J., (2005). Communicating quality of life information to cancer patients: A study of six presentation formats. Journal of Clinical Oncology, 23, 6949-6956.
19. Carpenter P. A., Shah P., (1998). A model of the perceptual and conceptual processes in graph comprehension. Journal of Experimental Psychology: Applied, 4, 75-100.
20. Cavanaugh K., Huizinga M. M., Wallston K. A., Gebretsadik T., Shintani A., Davis D.,. Cherrington A., (2008). Association of numeracy and diabetes control. Annals of Internal Medicine, 148, 737-746.
21. Cavanaugh K., Wallston K. A., Gebretsadik T., Shintani A., Huizinga M. M., Davis D.,. Rothman R. L., (2009). Addressing literacy and numeracy to improve diabetes care: Two randomized controlled trials. Diabetes Care, 32, 2149-2155.
22. Chen Y., Yang Z. J., (2015). Message formats, numeracy, risk perceptions of alcohol-attributable cancer, and intentions for binge drinking among college students. Journal of Drug Education, 45, 37-55.
23. Cokely E. T., Feltz A., Ghazal S., Allan J. N., Petrova D., Garcia-Retamero R., (in press). Decision making skill: From intelligence to numeracy and expertise. In Ericsson K. A., Hoffman R. R., Kozbelt A., Williams A. M., (Eds.), Cambridge handbook of expertise and expert performance (2nd ed.). New York, NY: Cambridge University Press.
24. Cokely E. T., Galesic M., Schulz E., Ghazal S., Garcia-Retamero R., (2012). Measuring risk literacy: The Berlin numeracy test. Judgment and Decision Making, 7, 25-47.
25. Cokely E. T., Ghazal S., Garcia-Retamero R., (2014). Measuring numeracy. In Anderson B. L., Schulkin J., (Eds.), Numerical reasoning in judgments and decision making about health (pp. 11-38). Cambridge, UK: Cambridge University Press.
26. Cokely E. T., Kelley C. M., (2009). Cognitive abilities and superior decision making under risk: A protocol analysis and process model evaluation. Judgment and Decision Making, 4, 20-33.
27. Cokely E. T., Kelley C. M., Gilchrist A. L., (2006). Sources of individual differences in working memory: Contributions of strategy to capacity. Psychonomic Bulletin & Review, 13, 991-997.
28. Cooper R. J., Schriger D. L., Wallace R. C., Mikulich V. J., Wilkes M. S., (2003). The quantity and quality of scientific graphs in pharmaceutical advertisements. Journal of General Internal Medicine, 18, 294-297.
29. Cox D. S., Cox A. D., Sturm L., Zimet G., (2010). Behavioral interventions to increase HPV vaccination acceptability among mothers of young girls. Health Psychology, 29, 29-39.
30. Davids S. L., Schapira M. M., McAuliffe T. L., Nattinger A. B., (2004). Predictors of pessimistic breast cancer risk perceptions in a primary care population. Journal of General Internal Medicine, 19, 310-315.
31. Denes-Raj V., Epstein S., Cole J., (1995). The generality of the ratio-bias phenomenon. Personality and Social Psychology Bulletin, 21, 1083-1092.
32. Dowse R., Ehlers M., (2005). Medicine labels incorporating pictograms: Do they influence understanding and adherence? Patient Education and Counseling, 58, 63-70.
33. Edward T., (2001). The visual display of quantitative information. Cheshire, CT: Graphics Press.
34. Edwards A., Elwyn G., Mulley A., (2002). Explaining risks: Turning numerical data into meaningful pictures. British Medical Journal, 324, 827-830.
35. Estrada C. A., Barnes V., Collins C., Byrd J. C., (1999). Health literacy and numeracy. Journal of the American Medical Association, 282, 527-527.
36. Estrada C. A., Martin-Hryniewicz M., Peek B. T., Collins C., Byrd J. C., (2004). Literacy and numeracy skills and anticoagulation control. American Journal of the Medical Sciences, 328, 88-93.
37. Fagerlin A., Ubel P. A., Smith D. M., Zikmund-Fisher B. J., (2007). Making numbers matter: Present and future research in risk communication. American Journal of Health Behavior, 31 (Suppl. 1), S47-S56.
38. Fagerlin A., Wang C., Ubel P. A., (2005). Reducing the influence of anecdotal reasoning on people's health care decisions: Is a picture worth a thousand statistics. ? Medical Decision Making, 25, 398-405.
39. Fagerlin A., Zikmund-Fisher B. J., Ubel P. A., Jankovic A., Derry H. A., Smith D. M., (2007). Measuring numeracy without a math test: Development of the subjective numeracy scale. Medical Decision Making, 27, 672-680.
40. Feldman-Stewart D., Brundage M. D., Zotov V., (2007). Further insight into the perception of quantitative information: Judgments of gist in treatment decisions. Medical Decision Making, 27, 34-43.
41. Feldman-Stewart D., Kocovski N., McConnell B. A., Brundage M. D., Mackillop W. J., (2000). Perception of quantitative information for treatment decisions. Medical Decision Making, 20, 228-238.
42. Fischhoff B., Brewer N. T., Downs J. S., (2012). Communicating risks and benefits: An evidence based user's guide. Washington, DC: Government Printing Office.
43. Gaissmaier W., Wegwarth O., Skopec D., Müller A., Broschinski S., Politi M. C., (2012). Numbers can be worth a thousand pictures: Individual differences in understanding graphical and numerical representations of health-related information. Health Psychology, 31, 286-296.
44. Galesic M., Garcia-Retamero R., (2010). Statistical numeracy for health: A cross-cultural comparison with probabilistic national samples. Archives of Internal Medicine, 170, 462-468.
45. Galesic M., Garcia-Retamero R., (2011 a). Communicating consequences of risky behaviors: Life expectancy versus risk of disease. Patient Education and Counseling, 82, 30-35.
46. Galesic M., Garcia-Retamero R., (2011 b). Do low-numeracy people avoid shared decision making. ? Health Psychology, 30, 336-341.
47. Galesic M., Garcia-Retamero R., (2011 c). Graph literacy: A cross-cultural comparison. Medical Decision Making, 31, 444-457.
48. Galesic M., Garcia-Retamero R., (2013). Using analogies to communicate information about health risks. Applied Cognitive Psychology, 27, 33-42.
49. Galesic M., Garcia-Retamero R., Gigerenzer G., (2009). Using icon arrays to communicate medical risks: Overcoming low numeracy. Health Psychology, 28, 210-216.
50. Garcia-Retamero R., Andrade A., Sharit J., Ruiz J. G., (2015). Is patient's numeracy related to physical and mental health. ? Medical Decision Making, 35, 501-511.
51. Garcia-Retamero R., Cokely E. T., (2011). Effective communication of risks to young adults: Using message framing and visual aids to increase condom use and STD screening. Journal of Experimental Psychology: Applied, 17, 270-287.
52. Garcia-Retamero R., Cokely E. T., (2013). Communicating health risks with visual aids. Current Directions in Psychological Science, 22, 392-399.
53. Garcia-Retamero R., Cokely E. T., (2014 a). The influence of skills, message frame, and visual aids on prevention of sexually transmitted diseases. Journal of Behavioral Decision Making, 27, 179-189.
54. Garcia-Retamero R., Cokely E. T., (2014 b). Using visual aids to help people with low numeracy make better decisions. In Anderson B. L., Schulkin J., (Eds.), Numerical reasoning in judgments and decision making about health (pp. 153-174). Cambridge, UK: Cambridge University Press.
55. Garcia-Retamero R., Cokely E. T., (2015 a). Brief messages to promote prevention and detection of sexually transmitted diseases. Current HIV Research, 13, 408-420.
56. Garcia-Retamero R., Cokely E. T., (2015 b). Simple but powerful health messages for increasing condom use in young adults. Journal of Sex Research, 52, 30-42.
57. Garcia-Retamero R., Cokely E. T., (2016). Promoting shared medical decision making in doctors and their patients. Manuscript in preparation.
58. Garcia-Retamero R., Cokely E. T., Ghazal S., (2016). Comparing risk literacy in 30 countries: New results from Berlin numeracy test. Manuscript in preparation.
59. Garcia-Retamero R., Cokely E. T., Ghazal S., Joeris A., (2016). Measuring graph literacy without a test: A brief subjective assessment. Medical Decision Making, 36, 854-867.
60. Garcia-Retamero R., Cokely E. T., Hoffrage U., (2015). Visual aids improve diagnostic inferences and metacognitive judgment calibration. Frontiers in Psychology, 6, 932.
61. Garcia-Retamero R., Cokely E. T., Wicki B., Joeris A., (2016). Improving surgeons' risk literacy with visual aids. Patient Education and Counseling, 99, 1156-1161.
62. Garcia-Retamero R., Dhami M. K., (2011). Pictures speak louder than numbers: On communicating medical risks to immigrants with limited non-native language proficiency. Health Expectations, 14 (s1), 46-57.
63. Garcia-Retamero R., Dhami M. K., (2013). On avoiding framing effects in experienced decision makers. Quarterly Journal of Experimental Psychology, 66, 829-842.
64. Garcia-Retamero R., Galesic M., (2009). Communicating treatment risk reduction to people with low numeracy skills: A cross-cultural comparison. American Journal of Public Health, 99, 2196-2202.
65. Garcia-Retamero R., Galesic M., (2010 a). How to reduce the effect of framing on messages about health. Journal of General Internal Medicine, 25, 1323-1329.
66. Garcia-Retamero R., Galesic M., (2010 b). Who profits from visual aids: Overcoming challenges in people's understanding of risks. Social Science & Medicine, 70, 1019-1025.
67. Garcia-Retamero R., Galesic M., (2011). Using plausible group sizes to communicate information about medical risks. Patient Education and Counseling, 84, 245-250.
68. Garcia-Retamero R., Galesic M., (2013). Transparent communication of health risks: Overcoming cultural differences. New York, NY: Springer.
69. Garcia-Retamero R., Galesic M., Gigerenzer G., (2010). Do icon arrays help reduce denominator neglect. ? Medical Decision Making, 30, 672-684.
70. Garcia-Retamero R., Hoffrage U., (2013). Visual representation of statistical information improves diagnostic inferences in doctors and their patients. Social Science & Medicine, 83, 27-33.
71. Garcia-Retamero R., Muñoz R., (2013). How to improve comprehension of medical risks in older adults. Revista Latinoamericana De Psicología, 45, 253-264.
72. Garcia-Retamero R., Petrova D., Feltz A., Cokely E. T., (in press). Measuring graph literacy: A systematic review. In Parrot R., (Ed.), The Oxford encyclopedia of health and risk message design and processing. Oxford, UK: Oxford University Press.
73. Garcia-Retamero R., Wicki B., Cokely E. T., Hanson B., (2014). Factors predicting surgeons' preferred and actual roles in interactions with their patients. Health Psychology, 33, 920-928.
74. Gardner P. H., McMillan B., Raynor D. K., Woolf E., Knapp P., (2011). The effect of numeracy on the comprehension of information about medicines in users of a patient information website. Patient Education and Counseling, 83, 398-403.
75. Ghazal S., Cokely E. T., Garcia-Retamero R., (2014). Predicting biases in very highly educated samples: Numeracy and metacognition. Judgment and Decision Making, 9, 15-34.
76. Gigerenzer G., Gaissmaier W., Kurz-Milcke E., Schwartz L. M., Woloshin S., (2007). Helping doctors and patients make sense of health statistics. Psychological Science in the Public Interest, 8, 53-96.
77. Gillan D. J., Wickens C. D., Hollands J. G., Carswell C. M., (1998). Guidelines for presenting quantitative data in HFES publications. Human Factors, 40, 28-41.
78. Ginde A. A., Clark S., Goldstein J. N., Camargo C. A. Jr., (2008). Demographic disparities in numeracy among emergency department patients: Evidence from two multicenter studies. Patient Education and Counseling, 72, 350-356.
79. Goodyear-Smith F., Arroll B., Chan L., Jackson R., Wells S., Kenealy T., (2008). Patients prefer pictures to numbers to express cardiovascular benefit from treatment. Annals of Family Medicine, 6, 213-217.
80. Gurmankin A. D., Baron J., Armstrong K., (2004). Intended message versus message received in hypothetical physician risk communications: Exploring the gap. Risk Analysis, 24, 1337-1347.
81. Hamstra D. A., Johnson S. B., Daignault S., Zikmund-Fisher B. J., Taylor J. M., Larkin K.,. Fagerlin A., (2015). The impact of numeracy on verbatim knowledge of the longitudinal risk for prostate cancer recurrence following radiation therapy. Medical Decision Making, 35, 27-36.
82. Hanoch Y., Miron-Shatz T., Cole H., Himmelstein M., Federman A. D., (2010). Choice, numeracy, and physicians-in-training performance: The case of Medicare part D. Health Psychology, 29, 454-459.
83. Hawley S. T., Zikmund-Fisher B., Ubel P., Jancovic A., Lucas T., Fagerlin A., (2008). The impact of the format of graphical presentation on health-related knowledge and treatment choices. Patient Education and Counseling, 73, 448-455.
84. Hess R., Visschers V. H., Siegrist M., (2011 a). Risk communication with pictographs: The role of numeracy and graph processing. Judgment and Decision Making, 6, 263-274.
85. Hess R., Visschers V. H., Siegrist M., Keller C., (2011 b). How do people perceive graphical risk communication? The role of subjective numeracy. Journal of Risk Research, 14, 47-61.
86. Hesse B. W., Shneiderman B., (2007). eHealth research from the user's perspective. American Journal of Preventive Medicine, 32, S97-S103.
87. Hibbard J. H., Peters E., Dixon A., Tusler M., (2007). Consumer competencies and the use of comparative quality information: It isn't just about literacy. Medical Care Research and Review, 64, 379-394.
88. Higgins J. P., Green S., (2008). Cochrane handbook for systematic reviews of interventions. Chichester, UK: Wiley.
89. Hildon Z., Allwood D., Black N., (2012). Impact of format and content of visual display of data on comprehension, choice and preference: A systematic review. International Journal for Quality in Health Care, 24, 55-64.
90. Hoffrage U., Gigerenzer G., Krauss S., Martignon L., (2002). Representation facilitates reasoning: What natural frequencies are and what they are not. Cognition, 84, 343-352.
91. Honda H., Ogawa M., Murakoshi T., Masuda T., Utsumi K., Park S.,. Wada Y., (2015). Effect of visual aids and individual differences of cognitive traits in judgments on food safety. Food Policy, 55, 33-40.
92. Huestegge L., Philipp A. M., (2011). Effects of spatial compatibility on integration processes in graph comprehension. Attention, Perception, & Psychophysics, 73, 1903-1915.
93. Huizinga M. M., Beech B. M., Cavanaugh K. L., Elasy T. A., Rothman R. L., (2008). Low numeracy skills are associated with higher BMI. Obesity, 16, 1966-1968.
94. Kakkilaya V., Groome L. J., Platt D., Kurepa D., Pramanik A., Caldito G.,. Davis T. C., (2011). Use of a visual aid to improve counseling at the threshold of viability. Pediatrics, 128, e1511-e1519.
95. Kaplan R. M., Frosch D. L., (2005). Decision making in medicine and health care. Annual Review of Clinical Psychology, 1, 525-556.
96. Keller C., Siegrist M., (2009). Effect of risk communication formats on risk perception depending on numeracy. Medical Decision Making, 29, 483-490.
97. Kleemans T., Segers E., Verhoeven L., (2011). Cognitive and linguistic precursors to numeracy in kindergarten: Evidence from first and second language learners. Learning and Individual Differences, 21, 555-561.
98. Kosslyn S. M., (2006). Graph design for the eye and mind. New York, NY: Oxford University Press.
99. Kutner M., Greenburg E., Jin Y., Paulsen C., (2006). The health literacy of America's adults: Results from the 2003 national assessment of adult literacy (NCES 2006-483). Washington, DC: National Center for Education Statistics.
100. Lindau S. T., Basu A., Leitsch S. A., (2006). Health literacy as a predictor of follow-up after an abnormal pap smear: A prospective study. Journal of General Internal Medicine, 21, 829-834.
101. Lipkus I. M., (2007). Numeric, verbal, and visual formats of conveying health risks: Suggested best practices and future recommendations. Medical Decision Making, 27, 696-713.
102. Lipkus I. M., Hollands J. G., (1999). The visual communication of risk. Journal of the National Cancer Institute. Monographs, 25, 149-163.
103. Lipkus I. M., Samsa G., Rimer B. K., (2001). General performance on a numeracy scale among highly educated samples. Medical Decision Making, 21, 37-44.
104. Lopez K. D., Wilkie D. J., Yao Y., Sousa V., Febretti A., Stifter J.,. Keenan G. M., (2016). Nurses' numeracy and graphical literacy: Informing studies of clinical decision support interfaces. Journal of Nursing Care Quality, 31, 124-130.
105. Machtinger E. L., Wang F., Chen L., Rodriguez M., Wu S., Schillinger D., (2007). A visual medication schedule to improve anticoagulation control: A randomized, controlled trial. Joint Commission Journal on Quality and Patient Safety, 33, 625-635.
106. Manganello J. A., Clayman M. L., (2011). The association of understanding of medical statistics with health information seeking and health provider interaction in a national sample of young adults. Journal of Health Communication, 16 (Suppl. 3), 163-176.
107. Martin L. T., Haas A., Schonlau M., Derose K. P., Rosenfeld L., Rudd R., Buka S. L., (2012). Which literacy skills are associated with smoking. ? Journal of Epidemiology and Community Health, 66, 189-192.
108. Mason D., Boase S., Marteau T., Kinmonth A. L., Dahm T., Minorikawa N., Sutton S., (2014). One-week recall of health risk information and individual differences in attention to bar charts. Health, Risk & Society, 16, 136-153.
109. McCaffery K. J., Dixon A., Hayen A., Jansen J., Smith S., Simpson J. M., (2012). The influence of graphic display format on the interpretations of quantitative risk information among adults with lower education and literacy: A randomized experimental study. Medical Decision Making, 32, 532-544.
110. McCaffery K. J., Smith S. K., Wolf M., (2010). The challenge of shared decision making among patients with lower literacy: A framework for research and development. Medical Decision Making, 30, 35-44.
111. Micallef L., Dragicevic P., Fekete J., (2012). Assessing the effect of visualizations on Bayesian reasoning through crowdsourcing. IEEE Transactions on Visualization and Computer Graphics, 18, 2536-2545.
112. Moles A. A., (1966). Information theory and esthetic perception. Urbana: University of Illinois Press.
113. Natter H. M., Berry D. C., (2005). Effects of active information processing on the understanding of risk information. Applied Cognitive Psychology, 19, 123-135.
114. Nayak J. G., Hartzler A. L., Macleod L. C., Izard J. P., Dalkin B. M., Gore J. L., (2016). Relevance of graph literacy in the development of patient-centered communication tools. Patient Education and Counseling, 99, 448-454.
115. Nelson W., Reyna V. F., Fagerlin A., Lipkus I., Peters E., (2008). Clinical implications of numeracy: Theory and practice. Annals of Behavioral Medicine, 35, 261-274.
116. Okan Y., Galesic M., Garcia-Retamero R., (2016). How people with low and high graph literacy process health graphs: Evidence from eye-tracking. Journal of Behavioral Decision Making, 29, 271-294.
117. Okan Y., Garcia-Retamero R., Cokely E. T., Maldonado A., (2012). Individual differences in graph literacy: Overcoming denominator neglect in risk comprehension. Journal of Behavioral Decision Making, 25, 390-401.
118. Okan Y., Garcia-Retamero R., Cokely E. T., Maldonado A., (2015). Improving risk understanding across ability levels: Encouraging active processing with dynamic icon arrays. Journal of Experimental Psychology: Applied, 21, 178-194.
119. Okan Y., Garcia-Retamero R., Galesic M., Cokely E. T., (2012). When higher bars are not larger quantities: On individual differences in the use of spatial information in graph comprehension. Spatial Cognition & Computation, 12, 195-218.
120. Organisation for Economic Co-operation and Development. (2012). PISA 2009 technical report. Paris, France: OECD Publishing.
121. Osborn C. Y., Cavanaugh K., Wallston K. A., Rothman R. L., (2010). Self-efficacy links health literacy and numeracy to glycemic control. Journal of Health Communication, 15, 146-158.
122. Oudhoff J. P., Timmermans D. R., (2015). The effect of different graphical and numerical likelihood formats on perception of likelihood and choice. Medical Decision Making, 35, 487-500.
123. Paasche-Orlow M. K., Wolf M. S., (2007). The causal pathways linking health literacy to health outcomes. American Journal of Health Behavior, 31 (Suppl. 1), S19-S26.
124. Paling J., (2003). Strategies to help patients understand risks. British Medical Journal, 327, 745-748.
125. Peters E., (2012). Beyond comprehension: The role of numeracy in judgments and decisions. Current Directions in Psychological Science, 21, 31-35.
126. Peters E., Bjalkebring P., (2015). Multiple numeric competencies: When a number is not just a number. Journal of Personality and Social Psychology, 108, 802-822.
127. Peters E., Dieckmann N., Dixon A., Hibbard J. H., Mertz C. K., (2007). Less is more in presenting quality information to consumers. Medical Care Research and Review, 64, 169-190.
128. Peters E., Levin I. P., (2008). Dissecting the risky-choice framing effect: Numeracy as an individual-difference factor in weighting risky and riskless options. Judgment and Decision Making, 3, 435-448.
129. Peters E., Meilleur L., Tompkins M. K., (2014). Numeracy and the Affordable Care Act: Opportunities and challenges. Appendix A. IOM (Institute of Medicine). In Health literacy and numeracy: Workshop summary (pp. 1-33). Washington, DC: National Academies Press.
130. Peters E., Vastfjall D., Slovic P., Mertz C. K., Mazzocco K., Dickert S., (2006). Numeracy and decision making. Psychological Science, 17, 407-413.
131. Petrova D., Garcia-Retamero R., Catena A., Cokely E. T., Heredia A., Arrebola A., Ramirez-Hernández J. A., (in press). Numeracy predicts risk of pre-hospital decision delay: A retrospective study of acute coronary syndrome survival. Annals of Behavioral Medicine.
132. Petrova D., Garcia-Retamero R., Catena A., van der Pligt J., (2016). To screen or not to screen: What factors influence complex screening decisions. ? Journal of Experimental Psychology: Applied, 22, 247-260.
133. Petrova D. G., Garcia-Retamero R., Cokely E. T., (2015). Understanding harms and benefits of cancer screening: A model of factors that shape informed decision making. Medical Decision Making, 35, 847-858.
134. Petrova D. G., van der Pligt J., Garcia-Retamero R., (2014). Feeling the numbers: On the interplay between risk, affect, and numeracy. Journal of Behavioral Decision Making, 27, 191-199.
135. Portnoy D. B., Roter D., Erby L. H., (2010). The role of numeracy on client knowledge in BRCA genetic counseling. Patient Education and Counseling, 81, 131-136.
136. Price M., Cameron R., Butow P., (2007). Communicating risk information: The influence of graphical display format on quantitative information perception: Accuracy, comprehension and preferences. Patient Education and Counseling, 69, 121-128.
137. Purpura D. J., Hume L. E., Sims D. M., Lonigan C. J., (2011). Early literacy and early numeracy: The value of including early literacy skills in the prediction of numeracy development. Journal of Experimental Child Psychology, 110, 647-658.
138. Reyna V. F., (2004). How people make decisions that involve risk: A dual-processes approach. Current Directions in Psychological Science, 13, 60-66.
139. Reyna V. F., (2008). A theory of medical decision making and health: Fuzzy trace theory. Medical Decision Making, 28, 850-865.
140. Reyna V. F., Brainerd C. J., (2008). Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learning and Individual Differences, 18, 89-107.
141. Reyna V. F., Nelson W. L., Han P. K., Dieckmann N. F., (2009). How numeracy influences risk comprehension and medical decision making. Psychological Bulletin, 135, 943-973.
142. Rodríguez V., Andrade A. D., Garcia-Retamero R., Anam R., Rodríguez R., Lisigurski M.,. Ruiz J. G., (2013). Health literacy, numeracy, and graphical literacy among veterans in primary care and their effect on shared decision making and trust in physicians. Journal of Health Communication, 18 (Suppl. 1), 273-289.
143. Roter D. L., (2005). Health literacy and the patient-provider relationship. In Schwartzberg J. G., Van Geest J., Wang C. C., (Eds.), Understanding health literacy: Implications for medicine and public health (pp. 87-100). Chicago, IL: AMA Press.
144. Rothman A. J., Martino S. C., Bedell B. T., Detweiler J. B., Salovey P., (1999). The systematic influence of gain- and loss-framed messages on interest in and use of different types of health behavior. Personality and Social Psychology Bulletin, 25, 1355-1369.
145. Ruiz J. G., Andrade A. D., Garcia-Retamero R., Anam R., Rodriguez R., Sharit J., (2013). Communicating global cardiovascular risk: Are icon arrays better than numerical estimates in improving understanding, recall and perception of risk. ? Patient Education and Counseling, 93, 394-402.
146. Schapira M. M., Walker C. M., Cappaert K. J., Ganschow P. S., Fletcher K. E., McGinley E. L.,. Jacobs E. A., (2012). The numeracy understanding in medicine instrument: A measure of health numeracy developed using item response theory. Medical Decision Making, 32, 851-865.
147. Schirillo J. A., Stone E. R., (2005). The greater ability of graphical versus numerical displays to increase risk avoidance involves a common mechanism. Risk Analysis, 25, 555-566.
148. Schwartz L. M., Woloshin S., Black W. C., Welch H. G., (1997). The role of numeracy in understanding the benefit of screening mammography. Annals of Internal Medicine, 127, 966-972.
149. Shah P., Freedman E. G., (2011). Bar and line graph comprehension: An interaction of top-down and bottom-up processes. Topics in Cognitive Science, 3, 560-578.
150. Shah P., Hoeffner J., (2002). Review of graph comprehension research: Implications for instruction. Educational Psychology Review, 14, 47-69.
151. Sharit J., Lisigurski M., Andrade A. D., Karanam C., Nazi K. M., Lewis J. R., Ruiz J. G., (2014). The roles of health literacy, numeracy, and graph literacy on the usability of the VA's personal health record by veterans. Journal of Usability Studies, 9, 173-193.
152. Siegler R. S., Booth J. L., (2004). Development of numerical estimation in young children. Child Development, 75, 428-444.
153. Siegler R. S., Opfer J. E., (2003). The development of numerical estimation: Evidence for multiple representations of numerical quantity. Psychological Science, 14, 237-243.
154. Spiegelhalter D., Pearson M., Short I., (2011). Visualizing uncertainty about the future. Science, 333, 1393-1400.
155. Stone E. R., Gabard A. R., Groves A. E., Lipkus I. M., (2015). Effects of numerical versus foreground-only icon displays on understanding of risk magnitudes. Journal of Health Communication, 20, 1230-1241.
156. Stone E. R., Sieck W. R., Bull B. E., Frank Yates J., Parks S. C., Rush C. J., (2003). Foreground: Background salience: Explaining the effects of graphical displays on risk avoidance. Organizational Behavior and Human Decision Processes, 90, 19-36.
157. Stone E. R., Yates J. F., Parker A. M., (1997). Effects of numerical and graphical displays on professed risk-taking behavior. Journal of Experimental Psychology: Applied, 3, 243-256.
158. Tait A. R., Voepel-Lewis T., Brennan-Martinez C., McGonegal M., Levine R., (2012). Using animated computer-generated text and graphics to depict the risks and benefits of medical treatment. The American Journal of Medicine, 125, 1103-1110.
159. Tait A. R., Voepel-Lewis T., Zikmund-Fisher B. J., Fagerlin A., (2010 a). The effect of format on parents' understanding of the risks and benefits of clinical research: A comparison between text, tables, and graphics. Journal of Health Communication, 15, 487-501.
160. Tait A. R., Voepel-Lewis T., Zikmund-Fisher B. J., Fagerlin A., (2010 b). Presenting research risks and benefits to parents: Does format matter. ? Anesthesia and Analgesia, 111, 718-723.
161. Trevena L., Zikmund-Fisher B., Edwards A., Timmermans D., Peters E., Lipkus I.,. Han P., (2012). Presenting probabilities. In Volk R., Llewellyn-Thomas H., (Eds.), Update of the International Patient Decision Aids Standards (IPDAS) Collaboration's background document (chap. C). Retrieved from http://ipdas.ohri.ca/resources.html
162. Visschers V. H., Meertens R. M., Passchier W. W., De Vries N. N., (2009). Probability information in risk communication: A review of the research literature. Risk Analysis, 29, 267-287.
163. Vogt F., Marteau T. M., (2012). Perceived effectiveness of stop smoking interventions: Impact of presenting evidence using numbers, visual displays, and different timeframes. Nicotine & Tobacco Research, 14, 200-208.
164. von Wagner C., Steptoe A., Wolf M. S., Wardle J., (2009). Health literacy and health actions: A review and a framework from health psychology. Health Education & Behavior, 36, 860-877.
165. Waldrop-Valverde D., Jones D. L., Gould F., Kumar M., Ownby R. L., (2010). Neurocognition, health-related reading literacy, and numeracy in medication management for HIV infection. AIDS Patient Care and STDs, 24, 477-484.
166. Waldrop-Valverde D., Jones D. L., Jayaweera D., Gonzalez P., Romero J., Ownby R. L., (2009). Gender differences in medication management capacity in HIV infection: The role of health literacy and numeracy. AIDS and Behavior, 13, 46-52.
167. Waters E. A., Weinstein N. D., Colditz G. A., Emmons K. M., (2007). Reducing aversion to side effects in preventive medical treatment decisions. Journal of Experimental Psychology: Applied, 13, 11-21.
168. Weinfurt K. P., Castel L. D., Li Y., Sulmasy D. P., Balshem A. M., Benson A. B.,. Slater E. F., (2003). The correlation between patient characteristics and expectations of benefit from phase I clinical trials. Cancer, 98, 166-175.
169. Weller J. A., Dieckmann N. F., Tusler M., Mertz C., Burns W. J., Peters E., (2013). Development and testing of an abbreviated numeracy scale: A Rasch analysis approach. Journal of Behavioral Decision Making, 26, 198-212.
170. Woller-Carter M. M., Okan Y., Cokely E. T., Garcia-Retamero R., (2012). Communicating and distorting risks with graphs: An eye-tracking study. In Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting (pp. 1723-1727). Santa Monica, CA: Human Factors and Ergonomics Society.
171. Zikmund-Fisher B. J., Dickson M., Witteman H. O., (2011). Cool but counterproductive: Interactive, web-based risk communications can backfire. Journal of Medical Internet Research, 13, e60.
172. Zikmund-Fisher B. J., Fagerlin A., Ubel P. A., (2010). A demonstration of "less can be more" in risk graphics. Medical Decision Making, 30, 661-671.
173. Zikmund-Fisher B. J., Mayman G., Fagerlin A., (2014). Patient numeracy: What do patients need to recognize, think, or do with health numbers. ? In Anderson B. L., Schulkin J., (Eds.), Numerical reasoning in judgments and decision making about health (pp. 80-104). Cambridge, UK: Cambridge University Press.
174. Zikmund-Fisher B. J., Smith D. M., Ubel P. A., Fagerlin A., (2007). Validation of the subjective numeracy scale: Effects of low numeracy on comprehension of risk communications and utility elicitations. Medical Decision Making, 27, 663-671.
175. Zikmund-Fisher B. J., Ubel P. A., Smith D. M., Derry H. A., McClure J. B., Stark A.,. Fagerlin A., (2008). Communicating side effect risks in a tamoxifen prophylaxis decision aid: The debiasing influence of pictographs. Patient Education and Counseling, 73, 209-214.
176. Zikmund-Fisher B. J., Witteman H. O., Dickson M., Fuhrel-Forbis A., Kahn V. C., Exe N. L.,. Fagerlin A., (2014). Blocks, ovals, or people? Icon type affects risk perceptions and recall of pictographs. Medical Decision Making, 34, 443-453.
177. Zikmund-Fisher B. J., Witteman H. O., Fuhrel-Forbis A., Exe N. L., Kahn V. C., Dickson M., (2012). Animated graphics for comparing two risks: A cautionary tale. Journal of Medical Internet Research, 14, e106.