Evaluation of a flowchart-based EHR query system: A case study of RetroGuide

Journal of Biomedical Informatics

Volumn 43, Issue 1, 2010, Pages 41-50

  Huser, Vojtech ^a,b   Narus, Scott P ^c   Rocha, Roberto A ^d  

^a MARSHFIELD CLINIC   (United States)

^b MORGRIDGE INSTITUTE FOR RESEARCH   (United States)

^c UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

^d PARTNERS HEALTHCARE   (United States)

Author keywords

Biomedical informatics; Data warehouse; Evaluation; Informatics; Mixed method; Query system; RetroGuide; SQL

Indexed keywords

BIOMEDICAL INFORMATICS; FURTHER DEVELOPMENT; HUMAN SUBJECTS; INFORMATICS; LOGICAL MODELING; MIXED METHOD; QUALITATIVE EVALUATIONS; QUALITATIVE STUDY; QUANTITATIVE COMPARISON; QUERY SYSTEMS; QUERY TASKS; STRUCTURED QUERY LANGUAGES; STUDY DESIGN; TECHNOLOGY ACCEPTANCE; TECHNOLOGY ACCEPTANCE MODEL; VALIDATION STUDY; WORKFLOW TECHNOLOGY;

BIOINFORMATICS; COMPUTER CRIME; DATA WAREHOUSES; FLOWCHARTING; IMAGE RETRIEVAL; QUERY LANGUAGES; RECORDS MANAGEMENT; TECHNOLOGY;

QUALITY CONTROL;

ARTICLE; DATA ANALYSIS SOFTWARE; DATA BASE; ELECTRONIC MEDICAL RECORD; HUMAN; INFORMATION PROCESSING; INFORMATION SYSTEM; MEDICAL INFORMATICS; METHODOLOGY; PRIORITY JOURNAL; QUALITATIVE RESEARCH; RETROGUIDE;

ADOLESCENT; ADULT; ALGORITHMS; CHEMISTRY, CLINICAL; COMPUTER GRAPHICS; DATABASE MANAGEMENT SYSTEMS; DATABASES, FACTUAL; DECISION SUPPORT TECHNIQUES; FEMALE; HOSPITAL INFORMATION SYSTEMS; HUMANS; INFORMATION STORAGE AND RETRIEVAL; MALE; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; MIDDLE AGED; SOFTWARE; USER-COMPUTER INTERFACE; WORKFLOW;

EID: 74649086908     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2009.06.001     Document Type: Article

References (56)

1. Edward FE, Carl EM, Laura ED. Data warehousing in an integrated health system: building the business case. In: Proceedings of the 1st ACM international workshop on data warehousing and OLAP. Washington, DC, United States: ACM; 1998.
2. del Hoyo E., and Lees D. The use of data warehouses in the healthcare sector. Health Inform J 8 1 (2002) 43-46
3. Berwick D.M. Continuous improvement as an ideal in health care. N Engl J Med 320 1 (1989) 53-56
4. De Clercq E., Van Casteren V., Jonckheer P., Burggraeve P., Lafontaine M.F., Vandenberghe H., et al. Research networks: can we use data from GPs' electronic health records?. Stud Health Technol Inform 124 (2006) 181-186
5. Schubart J.R., and Einbinder J.S. Evaluation of a data warehouse in an academic health sciences center. Int J Med Inform 60 3 (2000) 319-333
6. Dorda W., Gall W., and Duftschmid G. Clinical data retrieval: 25 years of temporal query management at the University of Vienna Medical School. Methods Inf Med 41 2 (2002) 89-97
7. Chute C.G. Clinical data retrieval and analysis. I've seen a case like that before. Ann NY Acad Sci 670 (1992) 133-140
8. Nadkarni P.M., and Brandt C. Data extraction and ad hoc query of an entity-attribute-value database. J Am Med Inform Assoc 5 6 (1998) 511-527
9. Das A.K., and Musen M.A. A comparison of the temporal expressiveness of three database query methods. Proc Annu Symp Comput Appl Med Care (1995) 331-337
10. Murphy S.N., Gainer V., and Chueh H.C. A visual interface designed for novice users to find research patient cohorts in a large biomedical database. AMIA Annu Symp Proc 2003 (2003) 489-493
11. STRIDE tool. Available from: http://clinicalinformatics.stanford.edu/STRIDE.
12. McDonald C.J., Dexter P., Schadow G., Chueh H.C., Abernathy G., Hook J., et al. SPIN query tools for de-identified research on a humongous database. AMIA Annu Symp Proc 2005 (2005) 515-519
13. Murphy S.N., Mendis M., Hackett K., Kuttan R., Pan W., Phillips L.C., et al. Architecture of the open-source clinical research chart from Informatics for Integrating Biology and the Bedside. AMIA Annu Symp Proc 1 (2007) 548-552
14. Huser V, Rocha RA, James B. Use of workflow technology tools to analyze medical data. In: 19th IEEE international symposium on computer-based medical systems proceedings, Salt Lake City, UT; 2006. p. 455-60.
15. Huser V, Rocha RA. Analyzing medical data from multi-hospital healthcare information system using graphical flowchart models. In: Proceedings of the biomedical informatics and cybernetics symposium; 2007. p. 314-20.
16. Dorda W., Wrba T., Duftschmid G., Sachs P., Gall W., Rehnelt C., et al. ArchiMed: a medical information and retrieval system. Methods Inf Med 38 1 (1999) 16-24
17. Nigrin D.J., and Kohane I.S. Temporal expressiveness in querying a time-stamp-based clinical database. J Am Med Inform Assoc 7 2 (2000) 152-163
18. Das A.K., and Musen M.A. A temporal query system for protocol-directed decision support. Methods Inf Med 33 4 (1994) 358-370
19. Post A.R., and Harrison Jr. J.H. PROTEMPA: a method for specifying and identifying temporal sequences in retrospective data for patient selection. J Am Med Inform Assoc 14 5 (2007) 674-683
20. Schubart J.R., and Einbinder J.S. Evaluation of a data warehouse in an academic health sciences center. Proc AMIA Symp (1999) 614-618
21. Venkatesh V., Morris M.G., Davis G.B., and Davis F.D. User acceptance of information technology: toward a unified view. MIS Q 27 3 (2003) 425-478
22. Davis F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 13 3 (1989) 319-340
23. Bagozzi R.P., Davis F.D., and Warshaw P.R. Development and test of a theory of technological learning and usage. Human Relations 45 7 (1992) 659-686
24. Hulse N.C., Del Fiol G., and Rocha R.A. Modeling end-users' acceptance of a knowledge authoring tool. Methods Inf Med 45 5 (2006) 528-535
25. Chismar W.G., and Wiley-Patton S. Test of the technology acceptance model for the internet in pediatrics. Proc AMIA Symp (2002) 155-159
26. Wilson E.V., and Lankton N.K. Modeling patients' acceptance of provider-delivered e-health. J Am Med Inform Assoc 11 4 (2004) 241-248
27. Hu P.J., Chau P.Y., Sheng O.R., and Tam K.Y. Examining the technology acceptance model using physician acceptance of telemedicine technology. J Manag Inf Sys 16 2 (1999) 91-112
28. Catarci T. What happened when database researchers met usability. Inf Syst 25 3 (2000) 177-212
29. Mason T, Wang L, Lawrence R. AutoJoin: providing freedom from specifying joins. In: 7th international conference on enterprise information systems - human-computer interaction track, vol. 5, Miami, FL; 2005. p. 31-8.
30. Mason T, Lawrence R. INFER: a relational query language without the complexity of SQL. In: ACM CIKM (14th ACM international conference on information and knowledge management). Germany: Bremen; 2005. p. 241-2.
31. Batini C, Catarci T, Costabile M, Levialdi S. Visual query systems: a taxonomy. VDB 1991: 153-68.
32. Chen P.K., Chen G.D., and Liu B.J. HVQS: the hierarchical visual query system for databases. J Vis Lang Comput 11 1 (2000) 1-26
33. Murray N.S., Paton N.W., Goble C.A., and Bryce J. Kaleidoquery - A flow-based visual language and its evaluation. J Vis Lang Comput 11 2 (2000) 151-189
34. Androutsopoulos I., Ritchie G.D., and Thanisch P. Natural language interfaces to databases - an introduction. Nat Lang Eng 1 (1995) 29-81
35. Nelken R, Francez N. Querying temporal databases using controlled natural language. In: Proceedings of the 18th conference on computational linguistics, vol. 2. Germany: Saarbrücken; 2000. p. 1076-80.
36. Androutsopoulos I, Ritchie GD, Thanisch P. Experience using TSQL2 in a natural language interface. In Clifford J, Tuzhilin A, editors. Recent advances in temporal databases (Proceedings of the international workshop on temporal databases, Zurich, Switzerland), workshops in computing series. Springer-Verlag; 1995. p. 113-32.
37. Workflow Management Coalition. Terminology and glossary (WFMC-TC-1011). Available from: http://healthcareworkflow.files.wordpress.com/2008/10/wfmc-tc-1011_term_glossary_v3.pdf.
38. Workflow Management Coalition. XML process definition language (XPDL). Available from: http://www.wfmc.org/xpdl.html.
39. JaWE. Java workflow editor (XPDL). Available from: http://jawe.objectweb.org.
40. Cape VisionsTM. XPDL Extension for Microsoft Visio. Available from: http://www.capevisions.com/tech/wxml.shtml.
41. Tibco Business Studio. Available from: http://www.tibco.com/devnet/business_studio/default.jsp.
42. Huser V. Analyzing biomedical datasets using executable graphical models. PhD Dissertation. Salt Lake City: University of Utah; 2008. Available from: http://content.lib.utah.edu/u?/us-etd2, 61096.
43. Healthcare Workflow (project blog). Available from: http://healthcareworkflow.wordpress.com.
44. Huser V, Rocha RA, Huser M. Conducting time series analysis on large data sets: a case study with lymphoma. In: Kuhn KA, Warren JR, Leong TY, editors. Medinfo 2007: proceedings of the 12th world congress on health (medical) informatics. Amsterdam: Building Sustainable Health Systems, IOS Press; 2007. Available from: http://content.lib.utah.edu/cgi-bin/showfile.exe?CISOROOT=/ir-main&CISOPTR=13383&filename=2714.pdf.
45. Huser V. Running decision support logic retrospectively to determine guideline adherence. a case study with diabetes. Spring AMIA2007 symposium. Available from: http://content.lib.utah.edu/cgi-bin/showfile.exe?CISOROOT=/ir-main&CISOPTR=12786&filename=2156.pdf.
46. Huser V, Rocha RA. Retrospective analysis of the electronic health record of patients enrolled in a computerized glucose management protocol. In: Twentieth IEEE international symposium on computer-based medical systems (CBMS′07); 2007. p. 503-8. Available from: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=4262698.
47. Huser V, Rocha RA. Graphical modeling of HEDIS quality measures and prototyping of related decision support rules to accelerate improvement. AMIA Annu Symp Proc 2007; 11: 986. Available from: http://content.lib.utah.edu/cgi-bin/showfile.exe?CISOROOT=/ir-main&CISOPTR=12995&filename=2365.pdf.
48. Friedman C.P., and Wyatt J. Evaluation methods in biomedical informatics. 2nd ed. (2006), Springer, New York
49. Friedman CP, Wyatt J. Chapter 3: determining what to study. In: Evaluation methods in biomedical informatics. 2nd ed. New York: Springer, 2006; p. 48-84.
50. Good practice guide in question and test design. Available from: http://www.pass-it.org.uk/resources/031112-goodpracticeguide-hw.pdf.
51. R Development Core Team. R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2006.
52. Lacey A., and DLuff D. Qualitative research and data analysis (2004), University of Nottingham, UK (Trent Focus Group)
53. Landis J.R., and Koch G.G. The measurement of observer agreement for categorical data. Biometrics 33 1 (1977) 159-174
54. Nunnally J.C. Pyschometric theory. 2nd ed. (1978), McGraw-Hill, New York
55. Campbell R., and Ash J. Comparing bedside information tools: a user-centered, task-oriented approach. AMIA Annu Symp Proc (2005) 101-105
56. Hersh W.R., Pentecost J., and Hickam D. A task-oriented approach to information retrieval evaluation. J Am Soc Inf Sci 47 1 (1996) 50-56