메뉴 건너뛰기




Volumn 15, Issue 6, 2013, Pages

Crowdsourcing participatory evaluation of medical pictograms using amazon mechanical turk

Author keywords

Amazon Mechanical Turk; Crowdsourcing; Health literacy; Medical instruction; Participatory design; Patient communication; Pictogram; Readability

Indexed keywords

CROWDSOURCING; HEALTH LITERACY; HUMAN; INFORMATION PROCESSING; INTERNET; INTERPERSONAL COMMUNICATION; QUALITY CONTROL; AMAZON MECHANICAL TURK; ARTICLE; MEDICAL EDUCATION; PARTICIPATORY DESIGN; PATIENT COMMUNICATION; PICTOGRAM; READING;

EID: 84881082315     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2513     Document Type: Article
Times cited : (51)

References (34)
  • 1
    • 84881057704 scopus 로고    scopus 로고
    • U.S. Department of Health and Human Services. Healthy People. Washington, DC: U.S. Government Printing Office; 2010
    • U.S. Department of Health and Human Services. Healthy People. Washington, DC: U.S. Government Printing Office; 2010.
  • 2
    • 33845194631 scopus 로고    scopus 로고
    • Use of pictorial aids in medication instructions: A review of the literature
    • Dec, [doi 102146/ajh060162] [Medline 17106013]
    • Katz MG, Kripalani S, Weiss BD. Use of pictorial aids in medication instructions: A review of the literature. Am J Health Syst Pharm 2006 Dec 1;63(23):2391-2397. [doi: 10.2146/ajhp060162] [Medline: 17106013]
    • (2006) Am J Health Syst Pharm , vol.63 , Issue.23 , pp. 2391-2397
    • Katz, M.G.1    Kripalani, S.2    Weiss, B.D.3
  • 3
    • 80053905951 scopus 로고    scopus 로고
    • Literature review: Using pictographs in discharge instructions for older adults with low-literacy skills
    • Nov;. [doi: 10.1111/j.1365-2702.2011.03814.x] [Medline: 21851434]
    • Choi J. Literature review: Using pictographs in discharge instructions for older adults with low-literacy skills. J Clin Nurs 2011 Nov;20(21-22):2984- 2996. [doi: 10.1111/j.1365-2702.2011.03814.x] [Medline: 21851434]
    • (2011) J Clin Nurs , vol.20 , Issue.21-22 , pp. 2984-2996
    • Choi, J.1
  • 4
    • 0034782327 scopus 로고    scopus 로고
    • The evaluation of pharmaceutical pictograms in a low-literate South African population
    • Nov; [Medline 11687321]
    • Dowse R, Ehlers MS. The evaluation of pharmaceutical pictograms in a low-literate South African population. Patient Educ Couns 2001 Nov;45(2):87-99. [Medline: 11687321]
    • (2001) Patient Educ Couns , vol.45 , Issue.2 , pp. 87-99
    • Dowse, R.1    Ehlers, M.S.2
  • 5
    • 20444400211 scopus 로고    scopus 로고
    • Medicine labels incorporating pictograms: Do they influence understanding and adherence?
    • Jul; [doi 101016/jpec 200406012] [Medline 15950838]
    • Dowse R, Ehlers M. Medicine labels incorporating pictograms: Do they influence understanding and adherence? Patient Educ Couns 2005 Jul;58(1):63-70. [doi: 10.1016/j.pec.2004.06.012] [Medline: 15950838]
    • (2005) Patient Educ Couns , vol.58 , Issue.1 , pp. 63-70
    • Dowse, R.1    Ehlers, M.2
  • 6
    • 33646110067 scopus 로고    scopus 로고
    • The role of pictures in improving health communication: A review of research on attention, comprehension, recall, and adherence
    • May; [doi 101016/jpec200505004] [Medline 16122896]
    • Houts PS, Doak CC, Doak LG, Loscalzo MJ. The role of pictures in improving health communication: A review of research on attention, comprehension, recall, and adherence. Patient Educ Couns 2006 May;61(2):173-190. [doi: 10.1016/j.pec.2005.05.004] [Medline: 16122896]
    • (2006) Patient Educ Couns , vol.61 , pp. 2173-2190
    • Houts, P.S.1    Doak, C.C.2    Doak, L.G.3    Loscalzo, M.J.4
  • 7
    • 0030221795 scopus 로고    scopus 로고
    • Using icons to convey medication schedule information
    • Aug; [Medline 15677067]
    • Morrow DG, Leirer VO, Andrassy JM. Using icons to convey medication schedule information. Appl Ergon 1996 Aug;27(4):267-275. [Medline: 15677067]
    • (1996) Appl Ergon , vol.27 , Issue.4 , pp. 267-275
    • Morrow, D.G.1    Leirer, V.O.2    Andrassy, J.M.3
  • 8
    • 0030873374 scopus 로고    scopus 로고
    • Design, development, and evaluation of visual aids for communicating prescription drug instructions to nonliterate patients in rural Cameroon
    • Jul; [Medline 9277247]
    • Ngoh LN, Shepherd MD. Design, development, and evaluation of visual aids for communicating prescription drug instructions to nonliterate patients in rural Cameroon. Patient Educ Couns 1997 Jul;31(3):245-261. [Medline: 9277247]
    • (1997) Patient Educ Couns , vol.31 , Issue.3 , pp. 245-261
    • Ngoh, L.N.1    Shepherd, M.D.2
  • 9
    • 73949091563 scopus 로고    scopus 로고
    • Improving patient comprehension and recall of discharge instructions by supplementing free texts with pictographs
    • 2008 Presented at: AMIA Annual Symposium; Nov. 8-12, Washington DC URL: [WebCite Cache]
    • Zeng-Treitler Q, Kim H, Hunter M. Improving patient comprehension and recall of discharge instructions by supplementing free texts with pictographs. In: AMIA Annual Symposium Proceedings. 2008 Presented at: AMIA Annual Symposium; Nov. 8-12, 2008; Washington, DC p. 849-853 URL: Http://europepmc.org/abstract/ MED/18999109 [WebCite Cache]
    • (2008) AMIA Annual Symposium Proceedings. , pp. 849-853
    • Zeng-Treitler, Q.1    Kim, H.2    Hunter, M.3
  • 10
    • 62449158008 scopus 로고    scopus 로고
    • Assessment of pictographs developed through a participatory design process using an online survey tool
    • [FREE Full text] [doi: 10.2196/jmir.1129] [Medline: 19275981]
    • Kim H, Nakamura C, Zeng-Treitler Q. Assessment of pictographs developed through a participatory design process using an online survey tool. J Med Internet Res 2009;11(1):e5 [FREE Full text] [doi: 10.2196/jmir.1129] [Medline: 19275981]
    • (2009) J Med Internet Res , vol.11 , Issue.1
    • Kim, H.1    Nakamura, C.2    Zeng-Treitler, Q.3
  • 11
    • 33846391109 scopus 로고    scopus 로고
    • Design and evaluation of a new pharmaceutical pictogram sequence to convey medicine usage
    • Mansoor LE, Dowse R. Design and evaluation of a new pharmaceutical pictogram sequence to convey medicine usage. Ergonomics SA 2004;16(2):29-41.
    • (2004) Ergonomics SA , vol.16 , Issue.2 , pp. 29-41
    • Mansoor, L.E.1    Dowse, R.2
  • 12
    • 46649087383 scopus 로고    scopus 로고
    • Participatory design with children in the development of a support system for patient-centered care in pediatric oncology
    • Aug; [doi 101016/jjbi 200710004] [Medline 18082468]
    • Ruland CM, Starren J, Vatne TM. Participatory design with children in the development of a support system for patient-centered care in pediatric oncology. J Biomed Inform 2008 Aug;41(4):624-635. [doi: 10.1016/j.jbi.2007.10. 004] [Medline: 18082468]
    • (2008) J Biomed Inform , vol.41 , Issue.4 , pp. 624-635
    • Ruland, C.M.1    Starren, J.2    Vatne, T.M.3
  • 13
    • 84862001575 scopus 로고    scopus 로고
    • Crowdsourced health research studies: An important emerging complement to clinical trials in the public health research ecosystem
    • [FREE Full text] [doi: 10.2196/jmir.1988] [Medline: 22397809]
    • Swan M. Crowdsourced health research studies: An important emerging complement to clinical trials in the public health research ecosystem. J Med Internet Res 2012;14(2):e46 [FREE Full text] [doi: 10.2196/jmir.1988] [Medline: 22397809]
    • (2012) J Med Internet Res , vol.14 , Issue.2
    • Swan, M.1
  • 14
    • 84864264138 scopus 로고    scopus 로고
    • Using crowdsourcing technology for testing multilingual public health promotion materials
    • [FREE Full text] [doi: 10.2196/jmir.2063] [Medline: 22664384]
    • Turner AM, Kirchhoff K, Capurro D. Using crowdsourcing technology for testing multilingual public health promotion materials. J Med Internet Res 2012;14(3):e79 [FREE Full text] [doi: 10.2196/jmir.2063] [Medline: 22664384]
    • (2012) J Med Internet Res , vol.14 , Issue.3
    • Turner, A.M.1    Kirchhoff, K.2    Capurro, D.3
  • 15
    • 84872434718 scopus 로고    scopus 로고
    • Crowdsourcing malaria parasite quantification: An online game for analyzing images of infected thick blood smears
    • [FREE Full text] [doi: 10.2196/jmir.2338] [Medline: 23196001]
    • Luengo-Oroz MA, Arranz A, Frean J. Crowdsourcing malaria parasite quantification: An online game for analyzing images of infected thick blood smears. J Med Internet Res 2012;14(6):e167 [FREE Full text] [doi: 10.2196/jmir.2338] [Medline: 23196001]
    • (2012) J Med Internet Res , vol.14 , Issue.6
    • Luengo-Oroz, M.A.1    Arranz, A.2    Frean, J.3
  • 16
    • 77953992027 scopus 로고    scopus 로고
    • Crowdsourcing graphical perception: Using mechanical turk to assess visualization design
    • 2010 Presented At: 28th Annual ACM SIGCHI Conference On Human Factors In Computing Systems; Apr. 10-15, Atlanta, Georgia. [doi: 10.1145/1753326.1753357]
    • Heer J, Bostock M. Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visualization Design. In: Proceedings of the 28th Annual ACM SIGCHI Conference on Human Factors in Computing Systems. 2010 Presented at: 28th Annual ACM SIGCHI Conference on Human Factors in Computing Systems; Apr. 10-15, 2010; Atlanta, Georgia p. 203-212. [doi: 10.1145/1753326.1753357]
    • (2010) Proceedings Of The 28th Annual ACM SIGCHI Conference On Human Factors In Computing Systems , pp. 203-212
    • Heer, J.1    Bostock, M.2
  • 17
    • 77957011930 scopus 로고    scopus 로고
    • Running experiments on amazon mechanical turk
    • [doi: 10.2139/ssrn.1626226]
    • Paolacci G, Chandler J, Ipeirotis PG. Running experiments on Amazon Mechanical Turk. Judgment and Decision Making 2010;5(5):411-419. [doi: 10.2139/ssrn.1626226]
    • (2010) Judgment and Decision Making , vol.5 , Issue.5 , pp. 411-419
    • Paolacci, G.1    Chandler, J.2    Ipeirotis, P.G.3
  • 18
    • 79960392344 scopus 로고    scopus 로고
    • Amazon's mechanical turk: A new source of inexpensive, yet high-quality, data?
    • Feb. [doi: 10.1177/1745691610393980]
    • Buhrmester M, Kwang T, Gosling SD. Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data? Perspectives on Psychological Science 2011 Feb 2011;6(1):3-5. [doi: 10.1177/1745691610393980]
    • (2011) Perspectives on Psychological Science 2011 , vol.6 , Issue.1 , pp. 3-5
    • Buhrmester, M.1    Kwang, T.2    Gosling, S.D.3
  • 19
    • 84881050403 scopus 로고    scopus 로고
    • American National Standards Institute. American National Standard Criteria for Safety Symbols. In: ANSI Z535.3. Rosslyn, VA: ANSI; 2007:3
    • American National Standards Institute. American National Standard Criteria for Safety Symbols. In: ANSI Z535.3. Rosslyn, VA: ANSI; 2007:3.
  • 20
    • 58149457944 scopus 로고    scopus 로고
    • Warning symbols
    • Wogalter M, editor. Mahwah, N.J: Lawrence Erlbaum Associates
    • Wogalter M, Silver N, Leonard S, Zaikina H. Warning symbols. In: Wogalter M, editor. Handbook of warnings. Mahwah, N.J: Lawrence Erlbaum Associates; 2006:159-176.
    • (2006) Handbook of Warnings , pp. 159-176
    • Wogalter, M.1    Silver, N.2    Leonard, S.3    Zaikina, H.4
  • 21
    • 0346169952 scopus 로고    scopus 로고
    • McDevitt Jr. Methodological issues in testing comprehension of safety symbols
    • 2002 Presented at: 46th Annual Human Factors and Ergonomics Society Annual Meeting; Sept. 30-""Oct. 4 Baltimore, MD. [doi: 10.1177/154193120204601912]
    • Lesch MF, McDevitt Jr. Methodological Issues in Testing Comprehension of Safety Symbols. In: Proceedings of the 46th Annual Human Factors and Ergonomics Society Annual Meeting. 2002 Presented at: 46th Annual Human Factors and Ergonomics Society Annual Meeting; Sept. 30-Oct. 4, 2002; Baltimore, MD. [doi: 10.1177/154193120204601912]
    • (2002) Proceedings Of The 46th Annual Human Factors And Ergonomics Society Annual Meeting.
    • Lesch, M.F.1
  • 22
    • 9944261404 scopus 로고    scopus 로고
    • Do pictograms improve children's understanding of medicine leaflet information?
    • Dec; [doi 101016/jpec200304006] [Medline 15582343]
    • Hämeen-Anttila K, Kemppainen K, Enlund H, Bush Patricia J, Marja A. Do pictograms improve children's understanding of medicine leaflet information? Patient Educ Couns 2004 Dec;55(3):371-378. [doi: 10.1016/j.pec.2003.04.006] [Medline: 15582343]
    • (2004) Patient Educ Couns , vol.55 , Issue.3 , pp. 371-378
    • Hämeen-Anttila, K.1    Kemppainen, K.2    Enlund, H.3    Bush Patricia, J.4    Marja, A.5
  • 23
    • 84874659030 scopus 로고    scopus 로고
    • Legibility of USP pictograms by clients of community pharmacies in portugal
    • Feb;. [doi: 10.1007/s11096-012-9698-z] [Medline: 23065039]
    • Soares MA. Legibility of USP pictograms by clients of community pharmacies in Portugal. Int J Clin Pharm 2013 Feb;35(1):22-29. [doi: 10.1007/s11096-012-9698-z] [Medline: 23065039]
    • (2013) Int J Clin Pharm , vol.35 , Issue.1 , pp. 22-29
    • Soares, M.A.1
  • 24
    • 84872416337 scopus 로고    scopus 로고
    • Effects of prospective-user factors and sign design features on guessability of pharmaceutical pictograms
    • Feb;. [doi: 10.1016/j.pec.2012.10.009] [Medline: 23146416]
    • Chan AH, Chan KW. Effects of prospective-user factors and sign design features on guessability of pharmaceutical pictograms. Patient Educ Couns 2013 Feb;90(2):268-275. [doi: 10.1016/j.pec.2012.10.009] [Medline: 23146416]
    • (2013) Patient Educ Couns , vol.90 , Issue.2 , pp. 268-275
    • Chan, A.H.1    Chan, K.W.2
  • 26
    • 84861680481 scopus 로고    scopus 로고
    • A taxonomy of representation strategies in iconic communication
    • Aug 1; [doi: 10.1016/j.ijhcs.2012.02.009] [Medline: 22754274]
    • Nakamura C, Zeng-Treitler Q. A Taxonomy of Representation Strategies in Iconic Communication. Int J Hum Comput Stud 2012 Aug 1;70(8):535-551. [doi: 10.1016/j.ijhcs.2012.02.009] [Medline: 22754274]
    • (2012) Int J Hum Comput Stud , vol.70 , Issue.8 , pp. 535-551
    • Nakamura, C.1    Zeng-Treitler, Q.2
  • 27
    • 77956232955 scopus 로고    scopus 로고
    • New York University Tech Report, [FREE Full text] [WebCite Cache]
    • Ipeirotis P. Demographics of Mechanical Turk. New York University Tech Report 2010:1-14 [FREE Full text] [WebCite Cache]
    • (2010) Demographics of Mechanical Turk. , pp. 1-14
    • Ipeirotis, P.1
  • 28
    • 0037358442 scopus 로고    scopus 로고
    • The influence of education on the interpretation of pharmaceutical pictograms for communicating medicine instructions
    • Mar, [doi 101211/002235702810]
    • Dowse R, Ehlers MS. The influence of education on the interpretation of pharmaceutical pictograms for communicating medicine instructions. International Journal of Pharmacy Practice 2003 Mar 2003;11(1):11-18. [doi: 10.1211/002235702810]
    • (2003) International Journal of Pharmacy Practice 2003 , vol.111 , pp. 11-18
    • Dowse, R.1    Ehlers, M.S.2
  • 29
    • 84881047570 scopus 로고    scopus 로고
    • The use of pictograms to convey health information regarding side effects and/or indications of medications
    • [doi: 10.1179/1753807612Y.0000000012]
    • Richler M, Vaillancourt R, Celetti SJ, Besançon L, Arun K, Sebastien F. The use of pictograms to convey health information regarding side effects and/or indications of medications. Journal of Communication In Healthcare 2012;5(4):220-226. [doi: 10.1179/1753807612Y.0000000012]
    • (2012) Journal of Communication In Healthcare , vol.5 , Issue.4 , pp. 220-226
    • Richler, M.1    Vaillancourt, R.2    Celetti, S.J.3    Besançon, L.4    Arun, K.5    Sebastien, F.6
  • 30
    • 84883393299 scopus 로고    scopus 로고
    • Mobile Health 2012 URL: [accessed 2013-04-30] [WebCite Cache ID 6GGSXYGnc]
    • Fox S, Duggan M. Pew Research Center. 2012. Mobile Health 2012 URL: Http://www.pewinternet.org/Reports/2012/Mobile-Health.aspx [accessed 2013-04-30] [WebCite Cache ID 6GGSXYGnc]
    • (2012) Pew Research Center.
    • Fox, S.1    Duggan, M.2
  • 31
    • 79958097389 scopus 로고    scopus 로고
    • Cooks or cobblers? Crowd creativity through combination
    • 2011 Presented At: 29th Annual ACM SIGCHI Conference On Human Factors In Computing Systems; May 7-12; Vancouver, BC. [doi: 10.1145/1978942.1979147]
    • Yu L, Nickerson JV. Cooks or Cobblers? Crowd Creativity through Combination. In: Proceedings of the 29th Annual ACM SIGCHI Conference on Human Factors in Computing Systems. 2011 Presented at: 29th Annual ACM SIGCHI Conference on Human Factors in Computing Systems; May 7-12, 2011; Vancouver, BC p. 1393-1402. [doi: 10.1145/1978942.1979147]
    • (2011) Proceedings Of The 29th Annual ACM SIGCHI Conference On Human Factors In Computing Systems , pp. 1393-1402
    • Yu, L.1    Nickerson, J.V.2
  • 32
    • 84880801718 scopus 로고    scopus 로고
    • Automated illustration of patients instructions
    • 2012 Presented at: AMIA Annual Symposium; Nov.; Chicago, IL1158-1167 URL: [WebCite Cache]
    • Bui D, Nakamura C, Bray BE, Zeng-Treitler Q. Automated illustration of patients instructions. In: AMIA Annual Symposium Proceedings. 2012 Presented at: AMIA Annual Symposium; Nov. 3-7, 2012; Chicago, IL p. 1158-1167 URL: Http://europepmc.org/abstract/MED/23304392 [WebCite Cache]
    • (2012) AMIA Annual Symposium Proceedings. , pp. 3-7
    • Bui, D.1    Nakamura, C.2    Bray, B.E.3    Zeng-Treitler, Q.4
  • 33
    • 80053360508 scopus 로고    scopus 로고
    • Cheap and fast-but is it good?: Evaluating non-expert annotations for natural language tasks
    • 2008 Presented at: Conference on Empirical Methods in Natural Language Processing; Oct. 25-27; Honolulu, Hawaii
    • Snow R, O'Connor B, Jurafsky D, Ng AY. Cheap and fast-but is it good?: Evaluating non-expert annotations for natural language tasks. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2008 Presented at: Conference on Empirical Methods in Natural Language Processing; Oct. 25-27, 2008; Honolulu, Hawaii p. 254-263.
    • (2008) Proceedings Of The Conference On Empirical Methods In Natural Language Processing. , pp. 254-263
    • Snow, R.1    O'Connor, B.2    Jurafsky, D.3    Ng, A.Y.4
  • 34
    • 0141733943 scopus 로고
    • Vox populi
    • 07 Mar [doi 101038/075450a0]
    • Galton F. Vox Populi. Nature 1907 Mar 07;75:450-451. [doi: 10.1038/075450a0]
    • (1907) Nature , vol.75 , pp. 450-451
    • Galton, F.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.