Evaluating and reducing the effect of data corruption when applying bag of words approaches to medical records

International Journal of Medical Informatics

Volumn 67, Issue 1-3, 2002, Pages 75-83

  Ruch, Patrick ^a,b   Baud, R ^b   Geissbuhler A ^b  

^a EPFL   (Switzerland)

^b GENEVA UNIVERSITY HOSPITALS   (Switzerland)

Author keywords

Corruption; Information retrieval; Medical records; Natural language processing; Spelling correction

Indexed keywords

AUTOMATION; INFORMATION RETRIEVAL; PATIENT MONITORING; PROGRAM DOCUMENTATION; RECORDS MANAGEMENT;

SPELLING CORRECTION;

MEDICAL COMPUTING;

ARTIFICIAL INTELLIGENCE; AUTOMATION; CONFERENCE PAPER; DATA ANALYSIS; ERROR; INFORMATION RETRIEVAL; LINGUISTICS; MEDICAL DOCUMENTATION; MEDICAL LITERATURE; MEDICAL RECORD; PRIORITY JOURNAL; PUBLICATION; QUALITY CONTROL;

FORECASTING; HUMANS; INFORMATION STORAGE AND RETRIEVAL; LINGUISTICS; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; NATURAL LANGUAGE PROCESSING; SOFTWARE; VOCABULARY, CONTROLLED;

EID: 0037021441     PISSN: 13865056     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1386-5056(02)00057-6     Document Type: Conference Paper

References (26)

1. A. Aizawa, Linguistic techniques to improve the performance of automatic text categorization, Proceedings of the Sixth Natural Language Processing Pacific Rim Symposium (NLPRS2001), 2001, pp. 307-314.
2. D. Carmel, D. Cohen, R. Fagin, E. Farchi, M. Herscovici, Y. Maarek, A. Soffer, Static index pruning for information retrieval systems, Proceedings ACM-SIGIR, 2001, pp. 43-50.
3. de Bruijn L., Hasman A., Arends J. Automatic SNOMED Classification - A Corpus Based Method, Yearbook of Medical Informatics. 1999.
4. P. Franz, A. Zaiss, S. Schulz, U. Hahn, R. Klar, Automated coding of diagnoses: Three methods compared, AMIA Symposium Proceedings, 2000.
5. Friedman C., Kra P., Krauthammer M., Yu H., Rzhetsky A. Genies: A natural-language processing system for the extraction of molecular pathways from journal articles. Bioinformatics. 17:(Suppl. 1):2001;74-82.
6. Hahn U., Romacker M., Schulz S. Creating knowledge repositories from biomedical reports: the medsyndikate text mining system. Pacific Symposium on Biocomputing. 7:2002;338-349.
7. Iliopoulos I., Enright A., Ouzounis C. TextQuest: document clustering of MedLine abstracts for concept discovery in molecular biology. Pacific Symposium on Biocomputing. 6:2001;384-395.
8. T. Joachims, Making large-scale support vector machine learning practical, in B. Scholkopf, C. Burges, A. Surola. Advances in Kernel Methods: Support Vector Machines, MIT Press, Cambridge, MA, December 1998.
9. Jurafeky D., Martin J. Speech and Language Processing. 2000;Prentice Hall, London.
10. P. Kantor, E. Voorhees, The TREC-5 confusion track: Comparing retrieval methods for scanned text, Information Retrieval (2000) 165-176.
11. J. Klavans, S. Muresan, Evaluation of DEFINDER: A system to mine definitions from consumer-oriented medical text, JCDL'01, 2002.
12. Kukich K. Techniques for automatically correcting words in text. ACM Computer Survey. 24:1992;377-439.
13. E. Mittendorf, P. Schauble, Measuring the effects of data corruption on information retrieval, SDAIR Proceedings, 1996.
14. Peterson J. Computer programs for detecting and correcting spelling errors. Communication ACM. 23:1980;12.
15. Robertson S., Jones K.S. Relevance weighting of search terms. Journal of American Society for Information Science. 27:(3):1976;129-146.
16. Ruch P., Baud R., Geissbuhler A., Lovis C., Rassinoux A., Riviere A. Using part-of-speech and word-sense disambiguation for boosting string-edit, distance spelling correction. Lecture Notes in Artificial Intelligence. 2101:2001;249-257.
17. P. Ruch, R. Baud, R. Rassinoux, P. Bouillon, G. Robert, Medical document anonymisation with a semantic lexicon, Journal of American Medical Information Association (Symposium Suppl.) (2000) 729-733.
18. P. Ruch, A. Gaudinat, Comparing corpora and lexical disambiguation, ACL Workshop on Comparing Corpora Proceedings, 2001.
19. Salton G. The SMART Retrieval System - Experiment in Automatic Document Retrieval. 1971;Prentice Hall.
20. Salton G., Buckley C. Term-weighting approaches in automatic text retrieval. Information Processing and Management. 24:(5):1988;513-523.
21. Salton G., McGill M. Introduction to Modern Information Retrieval. 1983;McGraw Hill Book.
22. Shatkay H., Edwards S., Wilbur W., Boguski M. Genes themes and microarrays: using information retrieval for large-scale gene analysis. Proceddings of International Conference Intellectual System and Molecular Biology. 8:2000;317-328.
23. A. Singhal, G. Salton, C. Buckley, Length normalization in degraded text collections. Technical Report TR95-1507, NEC, 1995.
24. K. Taghva, J. Borsack, A. Condit, Results to Applying Probablistic IR to OCR Text, ACM-SIGIR, 1994 pp. 202-211.
25. Y. Yang, X. Liu, A Re-examination of Text Categorization Methods. ACM SIGIR1, 1998, pp. 42-49.
26. Q. Zeng, Patient and clinician vocabulary: How different are they, Medlnfo'2001 Proceedings, 2001.