A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care

International Journal of Medical Informatics

Volumn 81, Issue 5, 2012, Pages 351-362

  Bakhshi Raiez, F ^a   de Keizer, N F ^a   Cornet, R ^a   Dorrepaal, M ^a   Dongelmans, D ^a   Jaspers, M W M ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Interface terminology; SNOMED CT; Terminological system; Usability evaluation

Indexed keywords

COMPOSITIONAL INTERFACES; CONTENT-BASED; DOMAIN SPECIFIC; EVALUATION STUDY; INTENSIVE CARE; LEARNABILITY; OBSERVATIONAL STUDY; PATIENT DATA MANAGEMENT; QUALITATIVE MEASUREMENTS; SNOMED CT; SYSTEM USABILITY; TERMINOLOGICAL SYSTEMS; USABILITY EVALUATION; USABILITY PROBLEMS; USER SATISFACTION; USER TESTING;

HOSPITAL DATA PROCESSING; INFORMATION MANAGEMENT; JOB ANALYSIS; USABILITY ENGINEERING;

TERMINOLOGY;

ACCURACY; ARTICLE; COMPETITION; COMPUTER INTERFACE; CONTROLLED STUDY; DATA ENTRY; EFFECTIVENES; EXPERIENCED USABILITY PROBLEM; HOSPITAL ADMISSION; INFORMATION PROCESSING; INFORMATION PROCESSING DEVICE; INTENSIVE CARE; INTERFACE TERMINOLOGY; LEARNABILITY; MACHINE LEARNING; OBSERVATIONAL STUDY; OVERALL USER SATISFACTION; PARAMETERS; PRIORITY JOURNAL; QUALITY CONTROL; RATING SCALE; REGISTRATION; SCORING SYSTEM; USABILITY EVALUATION;

DISEASE MANAGEMENT; HUMANS; INTENSIVE CARE UNITS; MEDICAL INFORMATICS APPLICATIONS; PATIENT ADMISSION; SYSTEMATIZED NOMENCLATURE OF MEDICINE; USER-COMPUTER INTERFACE;

EID: 84859113928     PISSN: 13865056     EISSN: 18728243     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2011.09.010     Document Type: Article

References (49)

1. Rosenbloom S.T., Miller R.A., Johnson K.B., Elkin P.L., Brown S.H. A model for evaluating interface terminologies. J. Am. Med. Inform. Assoc. 2008, 15(January (1)):65-76.
2. Rosenbloom S.T., Miller R.A., Johnson K.B., Elkin P.L., Brown S.H. Interface terminologies: facilitating direct entry of clinical data into electronic health record systems. J. Am. Med. Inform. Assoc. 2006, 13(May (3)):277-288.
3. Bakhshi-Raiez F., Ahmadian L., Cornet R., de Jonge E., de Keizer N.F. Construction of an interface terminology on SNOMED CT: generic approach and its application in intensive care. Methods Inf. Med. 2010, 49(4):349-359. [Epub 2010 Jun 22].
4. de Keizer N.F., Bakhshi-Raiez F., de J.E., Cornet R. Post-coordination in practice: evaluating compositional terminological system-based registration of ICU reasons for admission. Int. J. Med. Inform. 2008, 77(December (12)):828-835.
5. Cimino J.J., Patel V.L., Kushniruk A.W. Studying the human-computer-terminology interface. J. Am. Med. Inform. Assoc. 2001, 8(March (2)):163-173.
6. Douglas K., Nubie M. System design challenges: the integration of controlled vocabulary use into daily practice. Stud. Health Technol. Inform. 1997, 46:167-171.
7. Carayon P. Human computer interaction in health care. Handbook of Human Factors and Ergonomics in Health Care and Patient Safety 2011, 423-438. Lawrence Erlbaum Associates, Mahwah, New Jersey. 1 ed. P. Carayon (Ed.).
8. Navas H., Osornio A.L., Baum A., Gomez A., Luna D., de Quiros F.G. Creation and evaluation of a terminology server for the interactive coding of discharge summaries. Stud. Health Technol. Inform. 2007, 129(Pt 1):650-654.
9. Liaskos J., Mantas J. Measuring the user acceptance of a web-based nursing documentation system. Methods Inf. Med. 2006, 45(1):116-120.
10. Elkin P.L., Mohr D.N., Tuttle M.S., Cole W.G., Atkin G.E., Keck K., et al. Standardized problem list generation, utilizing the Mayo canonical vocabulary embedded within the Unified Medical Language System. Proc. AMIA Annu. Fall Symp. 1997, 500-504.
11. McKnight L.K., Elkin P.L., Ogren P.V., Chute C.G. Barriers to the clinical implementation of compositionality. Proc. AMIA Symp. 1999, 320-324.
12. Poon A.D., Fagan L.M., Shortliffe E.H. The PEN-Ivory project: exploring user-interface design for the selection of items from large controlled vocabularies of medicine. J. Am. Med. Inform. Assoc. 1996, 3(March (2)):168-183.
13. Cho I., Park H.A. Development and evaluation of a terminology-based electronic nursing record system. J. Biomed. Inform. 2003, 36(August (4-5)):304-312.
14. Kushniruk A., Patel V., Cimino J.J., Barrows R.A. Cognitive evaluation of the user interface and vocabulary of an outpatient information system. Proc. AMIA Annu. Fall Symp. 1996, 22-26.
15. Human-centred design processes for interactive systems. ISO standard 13407:1999, 2009.
16. Nielsen J. Usability Engineering 1995, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
17. Kjeldskov J., Skov M.B., Stage J. A longitudinal study of usability in health care: does time heal?. Int. J. Med. Inform. 2008, (August).
18. Kushniruk A.W., Patel V.L., Cimino J.J. Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces. Proc. AMIA Annu. Fall Symp. 1997, 218-222.
19. Cornet R., Prins A.K. An architecture for standardized terminology services by wrapping and integration of existing applications. AMIA Annu. Symp. Proc. 2003, 180-184.
20. *. Crit. Care Med. 2006, 34(May (5)):1297-1310.
21. C. Lewis, Using the 'thinking-aloud' method in cognitive interface design, Research Report RC9265 IBM, T.J. Watson Research Center, 1982.
22. Ericsson K.A., Simon A.H. Protocol Analysis: Verbal Reports as Data 1984, MIT Press, Cambridge.
23. J. Brooke, SUS: a quick and dirty usability scale, in: P.W. Jordan, B. Thomas, B.A. Weerdmeester, A.L. McClelland (Ed.), Usability Evaluation in Industry, 1996. Available from: http://www.usabilitynet.org/trump/documents/Suschapt.doc.
24. Zhang J., Johnson T.R., Patel V.L., Paige D.L., Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J. Biomed. Inform. 2003, 36(February (1-2)):23-30.
25. Nielsen J., Mack R.L. Usability inspection methods edited by 1995, John Wiley & Sons, New York.
26. Bangor A., Kortum P.T., Miller J.T. An empirical evaluation of the system usability scale. Int. J. Hum Comput Interact. 2008, 24(August (6)):574-594.
27. Brown S.H., Elkin P.L., Bauer B.A., Wahner-Roedler D., Husser C.S., Temesgen Z., et al. SNOMED CT: utility for a general medical evaluation template. AMIA Annu. Symp. Proc. 2006, 10:1-5.
28. J. Patrick, Y. Wang, P. Budd, A. Rector, S. Brandt, B.J. Rogers, et al., Developing SNOMED CT Subsets from Clinical Notes for Intensive Care Service, Health Informatics: Improving and Exploiting our Health Information, 7th Annual HINZ Conference and Exhibitions 2008, Rotorua, New Zealand, 2008. Available from: http://www.hinz.org.nz/page/archive_Conference_2008/conference-2008-post.
29. van Ginneken A.M., Verkoijen M.J. A multi-disciplinary approach to a user interface for structured data entry. Stud. Health Technol. Inform. 2001, 84(Pt 1):693-697.
30. Krall M.A., Chin H., Dworkin L., Gabriel K., Wong R. Improving clinician acceptance and use of computerized documentation of coded diagnosis. Am. J. Manag. Care 1997, 3(4):597-601.
31. Hansen D.P., Kemp M.L., Mills S.R., Mercer M.A., Frosdick P.A., Lawley M.J. Developing a national emergency department data reference set based on SNOMED CT. Med. J. Aust. 2011, 194(February (4)):S8-S10.
32. Spackman K.A., Campbell K.E., Cote R.A. SNOMED RT: a reference terminology for health care. Proc. AMIA Annu. Fall Symp. 1997, 640-644.
33. Macauley L. Human-computer interaction for software designers 1995, International Computer Press, London.
34. I.R. Horrocks, A comparison of two terminological knowledge representation systems [master's thesis]. Manchester, UK, University of Manchester. 1995. Ref Type Generic.
35. Rector A.L., Bechhofer S., Goble C.A., Horrocks I., Nowlan W.A., Solomon W.D. The GRAIL concept modelling language for medical terminology. Artif. Intell. Med. 1997, 9(February (2)):139-171.
36. Campbell J.R. Semantic features of an enterprise interface terminology for SNOMED RT. Medinfo 2001, 10(Pt 1):82-85.
37. Kahn C.E., Wang K., Bell D.S. Structured entry of radiology reports using World Wide Web technology. Radiographics 1996, 16(May (3)):683-691.
38. Rogers J., Bodenreider O. SNOMED CT. Browsing the browsers. Proc KR-MED 2008 Representing and sharing knowledge using SNOMED 2008.
39. Fung K.W., McDonald C., Bray B.E. RxTerms a drug interface terminology derived from RxNorm. AMIA Annu. Symp. Proc. 2008, 227-231.
40. Microsoft Design Guidance. Terminology Matching July 5 2007. Available at: Last accessed: November 2009. http://www%20mscui%20net/DesignGuide/Pdfs/2010.
41. Sundvall E., Nystrom M., Petersson H., Ahlfeldt H. Interactive visualization and navigation of complex terminology systems, exemplified by SNOMED CT. Stud. Health Technol. Inform. 2006, 124:851-856.
42. Elkin P.L., Froehling D., Wahner-Roedler D., Trusko B., Welsh G., Ma H., et al. NLP-based identification of pneumonia cases from free-text radiological reports. AMIA Annu. Symp. Proc. 2008, 172-176.
43. Ruch P., Gobeill J., Lovis C., Geissbuhler A. Automatic medical encoding with SNOMED categories. BMC Med Inform Decis Mak 2008;8 2008, 8(Suppl. 1):S6.
44. Stenzhorn H., Pacheco E.J., Nohama P., Schulz S. Automatic mapping of clinical documentation to SNOMED CT. Stud. Health Technol. Inform. 2009, 150:228-232.
45. Long W. Lessons extracting diseases from discharge summaries. AMIA Annu. Symp. Proc. 2007, 478-482.
46. Deleger L., Merkel M., Zweigenbaum P. Contribution to terminology internationalization by word alignment in parallel corpora. AMIA Annu. Symp. Proc. 2006, 185-189.
47. Deleger L., Merkel M., Zweigenbaum P. Translating medical terminologies through word alignment in parallel text corpora. J. Biomed. Inform. 2009, 42(August (4)):692-701.
48. Peute L.W., Spithoven R., Bakker P.J., Jaspers M.W. Usability studies on interactive health information systems; where do we stand?. Stud. Health Technol. Inform. 2008, 136:327-332.
49. Kushniruk A. Evaluation in the design of health information systems: application of approaches emerging from usability engineering. Comput. Biol. Med. 2002, 32(May (3)):141-149.