Optimal Training Sets for Bayesian Prediction of MeSH® Assignment

Journal of the American Medical Informatics Association

Volumn 15, Issue 4, 2008, Pages 546-553

  Sohn, Sunghwan ^a   Kim, Won ^a   Comeau, Donald C ^a   Wilbur, W John ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BUPIVACAINE; DYNORPHIN; PENTAZOCINE; THIOPENTAL;

ARTICLE; BAYES THEOREM; BIBLIOGRAPHIC DATABASE; LEARNING; MEDICAL INFORMATICS; MEDICAL INFORMATION; MEDICAL LITERATURE; MEDLINE; MESH HEADING; PROBABILITY; RECALL; SCORING SYSTEM; STATISTICAL ANALYSIS; TASK PERFORMANCE; TRAINING;

ABSTRACTING AND INDEXING AS TOPIC; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; MEDICAL SUBJECT HEADINGS; NATURAL LANGUAGE PROCESSING;

EID: 45849122150     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M2431     Document Type: Article

References (36)

1. Aronson A.R., Bodenreider O., Chang H.F., et al. The NLM Indexing Initiative. Proc AMIA Symp (2000) 17-21
2. Aronson A.R., Mork J.G., Gay C.W., Humphrey S.M., and Rogers W.J. The NLM Indexing Initiative's Medical Text Indexer. Medinfo (2004) 268-272
3. Cooper G.F., and Miller R.A. An experiment comparing lexical and statistical methods for extracting MeSH terms from clinical free text. J Am Med Inform Assoc 5 (1998) 62-75
4. Fowler J., Maram S., Kouramajian V., and Devadhar V. Automated MeSH indexing of the World-Wide Web. Proc Annu Symp Comput Appl Med Care (1995) 893-897
5. Kim W., Aronson A.R., and Wilbur W.J. Automatic MeSH term assignment and quality assessment. Proc AMIA Symp (2001) 319-323
6. Kim W., and Wilbur W.J. A strategy for assigning new concepts in the MEDLINE database. AMIA 2005 Symp Proc (2005) 395-399
7. Kouramajian V., Devadhar V., Fowler J., and Maram S. Categorization by reference: A novel approach to MeSH term assignment. Proc Annu Symp Comput Appl Med Care (1995) 878-882
8. Ruch P. Automatic assignment of biomedical categories: Toward a generic approach. Bioinformatics 22 (2006) 658-664
9. Blum A.L., and Langley P. Selection of relevant features and examples in machine learning. Art Intell 97 (1997) 245-271
10. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Available electronically from the author: Bell Laboratories, Lucent Technologies (1999)
11. th International Conference on Pattern Recognition, Barcelona, Spain, September 3-8, 2000 (2000), IEEE Computer Society, Los Alamitos, CA 2219-2222. http://doi.ieeecomputersociety.org/10.1109/ICPR.2000.906052. Accessed May 22, 2008
12. th SIAM International Conference on Data Mining, Lake Buena Vista, Florida, April 22-24, 2004 (2004), Society for Industrial and Applied Mathematics, Philadelphia, PA 126-137
13. Quinlan J.R. C4.5: Programs for Machine Learning (1993), Morgan Kaufman Publishers, San Mateo, CA
14. Lewis D.D., and Catlett J. Heterogeneous uncertainty sampling for supervised learning. Eleventh International Conference on Machine Learning, New Brunswick, New Jersey, July 10-13, 1994. In: Cohen W.W., and Hirsh H. (Eds) (1994), Morgan Kaufmann Publishers, San Francisco, CA 148-156
15. th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Dublin, Ireland, July 3-6, 1994 (1994), Springer-Verlag, New York, NY 3-12
16. Freund Y., Seung H., Shamir E., and Tishby N. Selective sampling using the query by committee algorithm. Mach Learn 28 (1997) 133-168
17. Seung H.S., Opper M., and Sompolinsky H. Query by committee. Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, Pennsylvania, July 27-29, 1992 (1992), ACM Press, New York, NY 287-294. http://doi.acm.org/10.1145/130385.130417 Accessed May 22, 2008
18. Tong S., and Koller D. Support vector machine active learning with applications to text classification. J Mach Learn Res 2 (2001) 45-66
19. Roy N., and McCallum A. Toward optimal active learning through sampling estimation of error reduction. In: Brodley C.E., and Danyluk A.P. (Eds). Eighteenth International Conference on Machine Learning, Williamstown, MA, June 28-July 01, 2001 (2001), Morgan Kaufmann Publishers, San Francisco, CA
20. Bordes A., Ertekin S., Weston J., and Bottou L. Fast kernel classifiers with online and active learning. J Mach Learn Res 6 (2005) 1579-1619
21. Schohn M., and Cohn D. Less is more: Active learning with support vector machines. In: Langley P. (Ed). Proceedings of the Seventeenth International Conference on Machine Learning 2000 (2000), Morgan Kaufmann, San Francisco, CA
22. Schapire R.E. The boosting approach to machine learning: An overview. MSRI Workshop on Nonlinear Estimation and Classification; 2002 (2002)
23. Wilbur W.J. Boosting naive Bayesian learning on a large subset of MEDLINE. American Medical Informatics 2000 Annual Symposium; 2000 (2000), American Medical Informatics Association, Los Angeles, CA 918-922
24. Japkowicz N., and Stephen S. The class imbalance problem: A systematic study. Intell Data Anal 6 (2002) 429-450
25. Domingos P. MetaCost: A general method for making classifiers cost-sensitive. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1999. San Diego, CA, August 15-18, 1999 (1999), ACM Press, New York, NY 155-164
26. Maloof M. Learning when data sets are imbalanced and when costs are unequal and unknown. Proceedings of the ICML-2003 Workshop: Learning with Imbalanced Data Sets II, August 21-24, 2003 (2003), AAAI Press, Menlo Park, CA 73-80
27. Nickerson A.S., Japkowicz N., and Milios E. Using unsupervised learning to guide resampling in imbalanced data sets. Proceedings of the Eighth International Workshop on AI and Statistics, January 4-7, 2001 (2001), Gatsby Computational Neuroscience Unit, London, UK 261-265
28. Lewis D.D. Naive (Bayes) at forty: The independence assumption in information retrieval. ECML (1998) 4-15
29. Zhang T., and Oles F.J. Text categorization based on regularized linear classification methods. Inf Retrieval 4 (2001) 5-31
30. Mladenic D., and Grobelnik M. Feature selection for unbalanced class distribution and naive Bayes. Sixteenth International Conference on Machine Learning, 1999 (1999), Morgan Kaufmann, San Francisco, CA 258-267
31. Manning C.D., and Schutze H. Foundations of Statistical Natural Language Processing (1999), MIT Press, Cambridge, MA
32. Visa S., and Ralescu A. Issues in Mining Imbalanced Data Sets-A Review Paper. Proceedings of the Sixteen Midwest Artificial Intelligence and Cognitive Science Conference, April 16-17, 2005 (2005), University of Cincinnatti, Cincinnatti, OH 67-73
33. Friedman N., Geiger D., and Goldszmidt M. Bayesian network classifiers. Machine Learning 29 2-3 (1997) 131-163
34. Madsen R.E., Kauchak D., and Elkan C. Modeling word burstiness using the Dirichlet distribution. 22nd International Conference on Machine Learning, 2005 (2005), ACM Press, Bonn, Germany 545-52
35. Witten I.H., Moffat A., and Bell T.C. Managing Gigabytes. Second edition (1999), Morgan-Kaufmann, San Francisco
36. Salton G. Automatic Text Processing (1989), Addison-Wesley, Reading, MA