Task 1a of the CLEF eHealth Evaluation Lab 2015

CEUR Workshop Proceedings

Volumn 1391, Issue , 2015, Pages

  Suominen, Hanna ^a,b   Hanlen, Leif ^a   Goeuriot, Lorraine ^c   Kelly, Liadh ^d   Jones, Gareth J F ^e  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b UNIVERSITY OF TURKU   (Finland)

^c UNIV GRENOBLE ALPES   (France)

^d TRINITY COLLEGE DUBLIN   (Ireland)

^e DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Computer systems evaluation; Data collection; Information extraction; Medical informatics; Nursing records; Patient Hand over; Patient handoff; Records as topic; Software design; Speech recognition; Test set generation

Indexed keywords

ENGINES; INFORMATION ANALYSIS; INFORMATION RETRIEVAL; INFORMATION SCIENCE; INTEROPERABILITY; LABORATORIES; MEDICAL COMPUTING; MEDICAL INFORMATION SYSTEMS; SOFTWARE DESIGN; SOFTWARE TESTING; SPEECH RECOGNITION;

DATA COLLECTION; HAND OVER; MEDICAL INFORMATICS; NURSING RECORDS; PATIENT HANDOFF; RECORDS AS TOPIC; SYSTEMS EVALUATIONS; TEST SET GENERATION;

DATA MINING;

EID: 84982805922     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (44)

1. Glaser, S. R., Zamanou, S., Hacker, K.: Measuring, interpreting organizational culture. Management Communication Quarterly (MCQ) 1(2), 173-198 (1987)
2. Tran, D. T., Johnson, M.: Classifying nursing errors in clinical management within an Australian hospital. International Nursing Review 57(4), 454-462 (2010)
3. Finlayson, S. G., LePendu, P., Shah, N. H.: Building the graph of medicine from millions of clinical narratives. Scientific Data 1, 140032 (2014)
4. Australian Commission on Safety and Quality in Healthcare (ACSQHC): Standard 6: Clinical handover. In: National Safety and Quality Health Standards, pp. 44-47. ACSQHC, Sydney, NSW, Australia (2012)
5. Pothier, D., Monteiro, P., Mooktiar, M. Shaw, A.: Pilot study to show the loss of important data in nursing handover. British Journal of Nursing 14(20), 1090-1093 (2005).
6. Matic, J. Davidson, P., Salamonson, Y.: Review: Bringing patient safety to the forefront through structured computerisation during clinical handover. Journal of Clinical Nursing 20(1-2), 184-189 (2011)
7. Suominen, H., Johnson, M., Zhou, L., Sanchez, P., Sirel, R., Basilakis, J., Hanlen, L., Estival, D., Dawson, L., Kelly, B.: Capturing patient information at nursing shift changes: Methodological evaluation of speech recognition and information extraction. Journal of the American Medical Informatics Association (JAMIA) 22(e1), e48-e66 (2015)
8. Suominen, H., Zhou, L., Hanlen, L, Ferraro, G.: Benchmarking clinical speech recognition and information extraction: New data, methods, and evaluations. JMIR Medical Informatics 3(2), e19 (2015)
9. Dawson, L., Johnson, M., Suominen, H., Basilakis, J., Sanchez, P., Kelly, B., Hanlen, L.: A usability framework for speech recognition technologies in clinical handover: A pre-implementation study. Journal of Medical Systems 38(6), 1-9 (2014)
10. Johnson M, Sanchez P, Suominen H, Basilakis J, Dawson L, Kelly B, Hanlen L. Comparing nursing handover and documentation: Forming one set of patient information. International Nursing Review 2014 61(1), 73-81 (2014)
11. Goeuriot, L., Kelly, L., Suominen, H., Hanlen, L., Névéol, A., Grouin, C., Palotti, J., Zuccon, G.: Overview of the CLEF eHealth Evaluation Lab 2015. In: CLEF 2015-6th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS). Springer, Berlin Heidelberg, Germany (2015)
12. Suominen, H., Salanterä, S., Velupillai, S., Chapman, W. W., Savova, G., Elhadad, N., Pradhan, S., South, B. R., Mowery, D. L., Jones, G. J. F., Leveling, J., Kelly, L., Goeuriot, L., Martinez, D., Zuccon, G.: Overview of the ShARe/CLEF eHealth Evaluation Lab 2013. In: Forner, P., Müller, H., Paredes, R., Rosso, P., Stein, B. (eds.): Information Access Evaluation. Multilinguality, Multimodality, and Visualization, LNCC, vol. 8138, pp. 212-231. Springer-Verlag, Berlin Heidelberg, Germany (2013)
13. Kelly, L., Goeuriot, L., Suominen, H., Schreck, T., Leroy, G., Mowery, D. L., Velupillai, S., Chapman, W. W., Martinez, D., Zuccon, G., Palotti, J.: Overview of the ShARe/CLEF eHealth Evaluation Lab 2014. In: Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., Toms, E. (eds.): Information Access Evaluation. Multilinguality, Multimodality, and Visualization, LNCC, vol. 8685, pp. 172-191. Springer-Verlag, Berlin Heidelberg, Germany (2014)
14. Poissant, L., Pereira, J., Tamblyn, R., Kawasumi, Y.: The impact of electronic health records on time efficiency on physicians and nurses: A systematic review. JAMIA 12(5), 505-516 (2005)
15. Hakes, B., Whittington, J.: Assessing the impact of an electronic medical record on nurse documentation time, Journal of Critical Care 26(4), 234-241 (2008)
16. Banner, L., Olney, C.: Automated clinical documentation: Does it allow nurses more time for patient care? Computers, Informatics, Nursing (CIN) 27(2), 75-81 (2009)
17. Johnson, M., Lapkin, S., Long, V., Sanchez, P., Suominen, H., Basilakis, J., Dawson, L.: A systematic review of speech recognition technology in health care. BMC Medical Informatics., Decision Making 14, 94 (2014)
18. Williams, J. R.: Guidelines for the use of multimedia in instruction. In: Proceedings of the Human Factors., Ergonomics Society 42nd Annual Meeting, pp. 1447-1451 (1998)
19. Ayres, R. U., Martinás, K.: 120 wpm for very skilled typist. In: On the Reappraisal of Micro-economics: Economic Growth and Change in a Material World, p. 41. Edward Elgar Publishing, Cheltenham, UK & Northampton, MA, USA (2005)
20. Allan, J., Aslam, J., Belkin, N., Buckley, C., Callan, J., Croft, B., Dumais, S., Fuhr, N., Harman, D., Harper, D. J., Hiemstra, D., Hofmann, T., Hovy, E., Kraaij, W., Lafferty, J., Lavrenko, V., Lewis, D., Liddy, L., Manmatha, R., McCallum, A., Ponte, J., Prager, J., Radev, D., Resnik, P., Robertson, S., Rosenfeld, R., Roukos, S., Sanderson, M., Schwartz, R., Singhal, A., Smeaton, A., Turtle, H., Voorhees, E., Weischedel, R., Xu, J., Zhai, C.: Challenges in in-formation retrieval., language modeling: Report of a workshop held at the Center for Intelligent Information Retrieval, University of Massachusetts Amherst, September 2002. SIGIR Forum 37(1), 31-47 (2003)
21. Kuniavsky, M.: Observing the User Experience: A Practitioner's Guide to User Research. Morgan Kaufmann Publishers, San Fransisco, CA, USA (2003)
22. Australian Government, Department of Health. Chronic disease: Chronic diseases are leading causes of death., disability in Australia, http://www.health.gov.au/internet/main/publishing.nsf/Content/chronic (last updated: 26 September 2012)
23. Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics Bulletin 1(6), 80-83 (1945)
24. Shapiro, S. S., Wilk, M. B.: An analysis of variance test for normality (complete samples). Biometrika 52(3-4), 591-611 (1965)
25. Razali, N., Wah, Y. B.: Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors., Anderson-Darling tests. Journal of Statistical Modeling., Analytics 2(1), 21-33 (2011)
26. Suominen, H. and Ferraro, G.: Noise in speech-to-text voice: Analysis of errors and feasibility of phonetic similarity for their correction. In Karimi, S. and Verspoor, K. (eds.) Proceedings of the Australasian Language Technology Association Workshop 2013 (ALTA 2013), pp. 34-42. Association for Computational Linguistics (ACL), Stroudsburg, Brisbane, QLD, Australia. (2013)
27. Powers, D. M. W. Applications and explanations of Zipf's law. In Powers, D. M. W. (ed.): Proceedings of the Joint Conferences on New Methods in Language Processing and Computational Natural Language Learning (NeMLaP3/CoNLL'98), pp. 151-160. ACL, Stroudsburg, PA, USA (1998)
28. Devine, E. G., Gaehde, S. A., Curtis, A. C.: Comparative evaluation of three continuous speech recognition software packages in the generation of medical reports. JAMIA 7(5), 462-468 (2000)
29. Al-Aynati, M. M. and Chorneyko, K. A.: Comparison of voice-automated transcription and human transcription in generating pathology reports. Achieves of Pathology and Laboratory Medicine 127(6), 721-725 (2003)
30. Sonnenburg, S., Braun, M. L., Ong, C. S., Bengio, S., Bottou, L., Holmes, G., LeCunn, Y., Müller, K.-R., Pereira, F., Rasmussen, C. E., Rätsch, G., Schölkopf, B., Smola, A., Vincent, P., Weston, J., Williamson, R. C.: The need for open source software in machine learning. Journal of Machine Learning 8, 2443-2466 (2007)
31. Pedersen, T.: Empiricism is not a matter of faith. Computational Linguistics 34(3), 465-470 (2008)
32. Organisation for Economic Development (OECD): OECD Principles and Guidelines for Access to Research Data from Public Funding. OECD, Danvers, MA, USA (2007)
33. Estrin, D. and Sim, I.: Open mHealth architecture: An engine for health care innovation. Science 330(6005), 759-760 (2010)
34. Dunn, A. G., Day, R. O., Mandl, K. D., Coiera, E.: Learning from hackers: open-source clinical trials. Science Translational Medicine 4(132), 132cm5 (2012)
35. Chapman, W. W., Nadkarni, P. M., Hirschman, L., D'Avolio, L. W., Savova, G. K., Uzuner, Ö: Overcoming barriers to NLP for clinical text: The role of shared tasks and the need for additional creative solutions. Editorial. JAMIA 18(5), 540-543 (2011)
36. Huang, C.-C. and Lu, Z.: Community challenges in biomedical text mining over 10 years: success, failure and the future. Briefings in Bioinformatics May 1 (2015)
37. Morita, M., Kano, Y., Ohkuma, T., Miyabe, M., Aramaki, E.: Overview of the NTCIR-10 MedNLP task. In: Proceedings of the 10th NTCIR Conference, pp. 696-701. NTCIR, Tokyo, Japan (2013)
38. Aramaki, E., Morita, M., Kano, Y., Ohkuma, T.: Overview of the NTCIR-11 MedNLP-2 task. In: Proceedings of the 11th NTCIR Conference, pp. 147-154. NTCIR, Tokyo, Japan (2014)
39. Neamatullah, I., Douglass, M., Lehman, L. H., Reisner, A., Villarroel, M., Long, W. J., Szolovits, P., Moody, G. B., Mark, R. G., Clifford, G. D.: Automated de-identification of free-text medical records. BMC 8, 32 (2008)
40. Carrell, D.Malin, B., Aberdeen, J., Bayer, S., Clark, C., Wellner, B., Hirschman, L.: Hiding in plain sight: Use of realistic surrogates to reduce exposure of protected health information in clinical text. JAMIA 20(2), 342-348 (2013)
41. Suominen, H., Lehtikunnas, T., Back, B., Karsten, H., Salakoski, T., Salanterä, S. Applying language technology to nursing documents: Pros and cons with a focus on ethics. International Journal of Medical Informatics 76(S2), S293-S301 (2007)
42. Hrynaszkiewicz, I., Norton, M. L., Vickers, A. J., Altman, D. G.: Preparing raw clinical data for publication: Guidance for journal editors, authors, and peer reviewers. British Medical Journal (BMC) 340, c181and Trials 11, 9 (2010)
43. National Health and Medical Research Council, Australian Research Council and Australian Vice-Chancellors' Committee: National Statement on Ethical Conduct in Human Research. National Health Medical Research Council and Australian Vice-Chancellors' Committee, Canberra, ACT, Australia (2007 updated 2014)
44. Jisc: The Value and Benefit of Text Mining to UK Further and Higher Education. Digital Infrastructure. http://www.jisc.ac.uk/whatwedo/programmes/di-directions/strategicdirections/textmining.aspx (2012)