Active learning for biomedical citation screening

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2010, Pages 173-181

  Wallace, Byron C ^a,b   Small, Kevin ^a   Brodley, Carla E ^a   Trikalinos, Thomas A ^b  

^a TUFTS UNIVERSITY   (United States)

^b TUFTS MEDICAL CENTER   (United States)

Author keywords

Active learning; Applications; Medical; Text classification

Indexed keywords

ACTIVE LEARNING; BIOMEDICAL CITATIONS; CLASSIFICATION PERFORMANCE; DATA SETS; DOMAIN EXPERTS; DOMAIN KNOWLEDGE; EMPIRICAL RESULTS; EVALUATION FRAMEWORK; EVIDENCE-BASED PRACTICES; FALSE NEGATIVES; FALSE POSITIVE; LABELED DATA; LINEAR PROGRAMMING ALGORITHM; MEDICAL; MEDICAL CENTER; MEDICAL DECISIONS; PREDICTIVE MODELS; REAL-WORLD; REAL-WORLD APPLICATION; SYSTEMATIC REVIEW; TEXT CLASSIFICATION; UTILITY MEASURE;

TEXT PROCESSING;

DECISION THEORY;

EID: 77956197516     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835804.1835829     Document Type: Conference Paper

References (31)

1. Y. Baram, R. El-Yaniv, and K. Luz. Online choice of active learning algorithms. J. Mach. Learn. Res., 5:255-291, 2004.
2. A. Blum and T. Mitchell. Combining labeled and unlabeled data with co-training. In COLT, pages 92-100, 1998.
3. Chih-Chung and C.-J. Lin. LIBSVM: A Library For Support Vector Machines, 2001.
4. C. Counsell. Formulating questions and locating primary studies for inclusion in systematic reviews. Ann. Intern. Med., 127:380-387, Sep 1997.
5. P. Donmez and J. G. Carbonell. Proactive learning: cost-sensitive active learning with multiple imperfect oracles. In CIKM, pages 619-628, 2008.
6. G. Druck, G. S. Mann, and A. McCallum. Learning from labeled features using generalized expectation criteria. In SIGIR, pages 595-602, 2009.
7. G. Druck, B. Settles, and A. McCallum. Active learning by labeling features. In EMNLP, pages 81-90, 2009.
8. Y. Freund, H. S. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. In Machine Learning, volume 28, pages 133-168, 1997.
9. C.-W. Hsu, C.-C. Chang, and C.-J. Lin. A practical guide to support vector classification, 2003.
10. L. Hunter and K. B. Cohen. Biomedical language processing: What's beyond pubmed? Mol Cell, 21(5):589-594, March 2006.
11. N. Japkowicz. Learning from imbalanced data sets: A comparison of various strategies. AAAI Workshop on Learning from Imbalanced Data Sets, 2000.
12. T. Joachims. Text categorization with support vector machines: Learning with many relevant features. In Machine Learning: ECML-98, pages 137-142, 1998.
13. D. Lewis. Evaluating and optimizing autonomous text classification systems. In SIGIR, pages 246-254, 1995.
14. D. Lewis and W. Gale. A sequential algorithm for training text classifiers. In SIGIR, pages 3-12, 1994.
15. A. Mccallum and K. Nigam. Employing EM and pool-based active learning for text classification. In ICML, pages 350-358, San Francisco, CA, USA, 1998.
16. I. Muslea, S. Minton, and C. A. Knoblock. Active learning with multiple views. Journal Artificial Intelligence Research (JAIR), 27:203-233, 2006.
17. W. N. S. O. L. Mangasarian and W. W. Wolberg. Breast cancer diagnosis and prognosis via linear programming. Operations Research, 43:570-577, 1995.
18. T. Osugi, D. Kun, and S. Scott. Balancing exploration and exploitation: A new algorithm for active machine learning. In ICDM, pages 330-337, 2005.
19. H. Raghavan and J. Allan. An interactive algorithm for asking and incorporating feature feedback into support vector machines. In SIGIR, pages 79-86, 2007.
20. H. Raghavan, O. Madani, and R. Jones. Active learning with feedback on features and instances. J. Mach. Learn. Res., 7:1655-1686, 2006.
21. V. E. Schütze, H. and J. Pedersen. Performance thresholding in practical text classification. In CIKM, pages 662-671, New York, NY, USA, 2006.
22. B. Settles. Active learning literature survey. Technical Report 1648, University of Wisconsin-Madison, 2009.
23. V. S. Sheng, F. Provost, and P. G. Ipeirotis. Get another label? improving data quality and data mining using multiple, noisy labelers. In KDD, pages 614-622, 2008.
24. V. Sindhwani, P. Melville, and R. D. Lawrence. Uncertainty sampling and transductive experimental design for active dual supervision. In ICML, pages 120-128, 2009.
25. K. Tomanek and F. Olsson. A web survey on the use of active learning to support annotation of text data. In NAACL Workshop on AL for NLP, pages 45-48, June 2009.
26. S. Tong and D. Koller. Support vector machine active learning with applications to text classification. In J. Mach. Learn. Res., pages 999-1006, 2000.
27. V. N. Vapnik. The Nature of Statistical Learning Theory. 1995.
28. A. J. Vickers and E. B. Elkin. Decision curve analysis: A novel method for evaluating prediction models. Medical Decision Making, 26:565-574, 2006.
29. B. C. Wallace, T. A. Trikalinos, J. Lau, C. E. Brodley, and C. H. Schmid. Semi-automated screening of biomedical citations for systematic reviews. BMC Bioinformatics, 11, 2010.
30. G. Widmer and M. Kubat. Learning in the presence of concept drift and hidden contexts. 23:69-101, 1996.
31. O. F. Zaidan, J. Eisner, and C. Piatko. Machine learning with annotator rationales to reduce annotation cost. In NIPS Workshop on Cost Sensitive Learning, December 2008.