Scaling drug indication curation through crowdsourcing

Database

Volumn 2015, Issue , 2015, Pages

  Khare, Ritu ^a   Burger, John D ^b   Aberdeen, John S ^b   Tresner Kirsch, David W ^b   Corrales, Theodore J ^a,c   Hirchman, Lynette ^b   Lu, Zhiyong ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b MITRE CORPORATION   (United States)

^c Montgomery Blair High School   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DRUG;

CHEMISTRY; CLASSIFICATION; CROWDSOURCING; DRUG DATABASE; DRUG LABELING; HUMAN; INFORMATION PROCESSING; PROCEDURES;

CROWDSOURCING; DATA CURATION; DATABASES, PHARMACEUTICAL; DRUG LABELING; HUMANS; PHARMACEUTICAL PREPARATIONS;

EID: 84943187305     PISSN: 17580463     EISSN: None     Source Type: Journal    
DOI: 10.1093/database/bav016     Document Type: Article

References (51)

1. Rinaldi, F., Clematide, S., Hafner, S. et al. (2013) Using the OntoGene pipeline for the triage task of BioCreative 2012. Database. Vol. 2013, Article ID bas053.
2. Torii, M., Li, G., Li, Z. et al. (2014) RLIMS-P: an online textmining tool for literature-based extraction of protein phosphorylation information. Database. Vol. 2014, Article ID bau081.
3. Arighi, C.N., Carterette, B., Cohen, K.B. et al. (2013) An overview of the BioCreative 2012 Workshop Track III: interactive text mining task. Database. Vol. 2013, Article ID bas056.
4. Arighi, C.N., Roberts, P.M., Agarwal, S. et al. (2011) BioCreative III interactive task: an overview.BMC Bioinformatics, 12 (Suppl 8), S4.
5. Wei, C.H., Kao, H.Y. and Lu, Z. (2013) PubTator: a web-based text mining tool for assisting biocuration. Nucleic Acids Res. 41(Web Server issue), W518-W522.
6. Wu, C.H., Arighi, C.N., Cohen, K.B. et al. (2012) BioCreative-2012 virtual issue. Database. Vol. 2012, Article ID bas049.
7. Rak, R., Batista-Navarro, R.T., Rowley, A. et al. (2014) Textmining- assisted biocuration workflows in Argo. Database. Vol. 2014, Article ID bas049.
8. Van Auken, K., Fey, P., Berardini, T.Z. et al. (2012) Text mining in the biocuration workflow: applications for literature curation at WormBase, dictyBase and TAIR. Database. Vol. 2012, Article ID bas040.
9. Wiegers, T.C., Davis, A.P. and Mattingly, C.J. (2012) Collaborative biocuration-text-mining development task for document prioritization for curation. Database. Vol. 2012, Article ID bas037.
10. Kim, S., Kim, W., Wei, C.H. et al. (2012) Prioritizing PubMed articles for the Comparative Toxicogenomic Database utilizing semantic information. Database. Vol. 2012, Article ID bas042.
11. Wei, C.H., Harris, B.R., Li, D. et al. (2012) Accelerating literature curation with text-mining tools: a case study of using PubTator to curate genes in PubMed abstracts. Database. Vol. 2012, Article ID bas041.
12. Mao, Y., Van Auken, K., Li, D. et al. (2014) Overview of the gene ontology task at BioCreative IV. Database. Vol. 2014, Article ID bau086.
13. Blaschke, C., Leon, E.A., Krallinger, M. et al. (2005) Evaluation of BioCreAtIvE assessment of task 2. BMC Bioinformatics, 6 (Suppl 1), S16.
14. Islamaj Dogan, R., Murray, G.C., Neveol, A. et al. (2009) Understanding PubMed user search behavior through log analysis. Database. Vol. 2009, Article ID bap018.
15. Ely, J.W., Osheroff, J.A., Gorman, P.N. et al. (2000) A taxonomy of generic clinical questions: classification study. BMJ, 321, 429-432.
16. Neveol, A., Dogan, R.I. and Lu, Z. (2011) Semi-automatic semantic annotation of PubMed Queries: a study on quality, efficiency, satisfaction. J. Biomed. Inform., 44, 310-318.
17. Li, J. and Lu, Z. (2012) A New method for computational drug repositioning using drug pairwise similarity. IEEE International Conference on Bioinformatics and Biomedicine. IEEE Computing Society, Philadelphia, PA, pp. 1-4.
18. Li, J. and Lu, Z. (2013) Pathway-based drug repositioning using causal inference. BMC Bioinformatics, 14 (Suppl 16), S3.
19. Nikfarjam, A., Emadzadeh, E. and Gonzalez, G. (2013) Towards generating a patient's timeline: extracting temporal relationships from clinical notes. J. Biomed. Inform., 46 (Suppl), S40-47.
20. Tatonetti, N.P., Ye, P.P., Daneshjou, R. et al. (2012) Data-driven prediction of drug effects and interactions. Sci. Transl. Med., 4, 125ra131.
21. Khare, R., An, Y., Wolf, S. et al. (2013) Understanding the EMR error control practices among gynecologic physicians. iConference 2013 iSchools, Fort Worth, Texas, pp. 289-301.
22. McCoy, A.B., Wright, A., Laxmisan, A. et al. (2012) Development and evaluation of a crowdsourcing methodology for knowledge base construction: identifying relationships between clinical problems and medications. J. Am.Med. Inform. Assoc., 19, 713-718.
23. Duke, J.D. and Friedlin, J. (2010) ADESSA: a real-time decision support service for delivery of semantically coded adverse drug event data. AMIA, 2010, 177-181.
24. Wei, W.Q., Cronin, R.M., Xu, H. et al. (2013) Development and evaluation of an ensemble resource linking medications to their indications. J. Am. Med. Inform. Assoc., 20, 954-961.
25. Fung, K.W., Jao, C.S., Demner-Fushman, D. (2013) Extracting drug indication information from structured product labels using natural language processing. J. Am. Med. Inform. Assoc., 20, 482-488.
26. Khare, R., Li, J. and Lu, Z. (2013) Toward Creating a Gold Standard of Drug Indications from FDA Drug Labels. IEEE International Conference on Health Informatics. IEEE Xplore, Philadelphia, PA, pp. 30-35.
27. Khare, R., Li, J. and Lu, Z. (2014) LabeledIn: cataloging labeled indications for human drugs. J. Biomed. Inform., 52, 448-456.
28. Estellés-Arolas, E. and González-Ladrón-de-Guevara, F. (2012) Towards an integrated crowdsourcing definition. Journal of Information Science, 38, 189-200.
29. Galperin, M.Y. and Fernandez-Suarez, X.M. (2012) The 2012 Nucleic Acids Research Database Issue and the online Molecular Biology Database Collection. Nucleic Acids Res., 40, D1-8.
30. Good, B.M. and Su, A.I. (2013) Crowdsourcing for bioinformatics. Bioinformatics, 29, 1925-1933.
31. Lakhani, K.R., Boudreau, K.J., Loh, P.R. et al. (2013) Prize-based contests can provide solutions to computational biology problems. Nat. Biotechnol., 31, 108-111.
32. Snow, R., O'Connor, B., Jurafsky, D. et al. (2008) Cheap and Fast - But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks. Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Honolulu, Hawaii, pp. 254-263.
33. Yetisgen-Yildiz, M., Solti, I., Xia, F. et al. (2010) Preliminary experiments with Amazon's mechanical turk for annotating medical named entities. NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk. Association for Computational Linguistics, Los Angeles, CA, pp. 180-183.
34. Ross, J., Irani, I., Silberman, M.S. et al. (2010) Who are the Crowdworkers?: Shifting Demographics in Amazon Mechanical Turk. CHI '10 Extended Abstracts on Human Factors in Computing Systems. ACM, Atlanta, Georgia, pp. 2863-2872.
35. Zhai, H., Lingren, T., Deleger, L. et al. (2013) Web 2.0-based crowdsourcing for high-quality gold standard development in clinical natural language processing. J. Med. Internet Res., 15, e73.
36. Burger, J.D., Doughty, E., Bayer, S. et al. (2012) Validating candidate gene-mutation relations in MEDLINE abstracts via crowdsourcing. Data Integration in the Life Science. Lecture Notes in Computer Science, vol. 7348, pp. 83-91.
37. Burger, J., Doughty, E.K., Khare, R. et al. (2014) Hybrid curation of gene-mutation relations combining automated extraction and crowdsourcing. Database. Vol. 2014, Article ID bau094.
38. Aronson, A.R. (2001) Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. AMIA Annual Symposium Proceedings, pp. 17-21.
39. Khare, R., An, Y., Li, J. et al. (2012) Exploiting semantic structure for mapping user-specified form terms to SNOMED CT concepts. SIGHIT International Health Informatics Symposium. ACM, Miami, FL, pp. 285-294.
40. An, Y., Khare, R., Hu, X. et al. (2012) Bridging encounter forms and electronic medical record databases: Annotation, mapping, and integration. International Conference on Bioinformatics and Biomedicine (BIBM 2012). IEEE Computer Society, Philadelphia, PA, pp. 1-4.
41. Leaman, R., Khare, R. and Lu, Z. (2013) NCBI at 2013 ShARe/CLEF eHealth Shared Task: Disorder Normalization in Clinical Notes with DNorm. CLEF 2013 Evaluation Labs and Workshop. The CLEF Initiative, Valencia - Spain, September 23-26, 2013.
42. Dogan, R.I. and Lu, Z. (2012) An improved corpus of disease mentions in PubMed citations. Workshop on Biomedical Natural Language Processing. Association for Computational Linguistics, Montreal, Canada, pp. 91-99.
43. Sohn, S., Comeau, D.C., Kim, W. et al. (2008) Abbreviation definition identification based on automatic precision estimates. BMC Bioinformatics, 9, 402.
44. Miller, G.A. (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. The Psychological Review, 63, 81-97.
45. Tratz, S. and Hovy, E.H. (2010) A Taxonomy, Dataset, and Classifier for Automatic Noun Compound Interpretation. The 48th Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden, pp. 678-687.
46. Raykar, V.C., Yu, S., Zhao, L.H. et al. (2010) Learning from crowds. J. Mach. Learn., 11, 1297-1322.
47. Lu, Z., Kao, H.Y., Wei, C.H. et al. (2011) The gene normalization task in BioCreative III. BMC Bioinformatics, 12 (Suppl 8), S2.
48. Fort, K., Adda, G. and Cohen, K.B. (2011) Amazon mechanical turk: gold mine or coal mine? Comput. Ling. 37, 413-420.
49. Khare, R., Wei, C.H. and Lu, Z. (2014) Automatic extraction of drug indications from FDA drug labels. AMIA Annual Symposium. American Medical Informatics Association, Washington, DC, pp. 787-794.
50. Adda, G. and Mariani, J. (2010) Language resources and Amazon Mechanical Turk: Legal, ethical and other issues. In LISLR2010, "Legal Issues for Sharing Language Resources workshop", LREC2010, Malta, 17 May.
51. Leaman, R., Islamaj Dogan, R. and Lu, Z. (2013) DNorm: disease name normalization with pairwise learning to rank. Bioinformatics, 29, 2909-2917.