Hadoop Recognition of Biomedical Named Entity Using Conditional Random Fields

IEEE Transactions on Parallel and Distributed Systems

Volumn 26, Issue 11, 2015, Pages 3040-3051

  Li, Kenli ^a   Ai, Wei ^a   Tang, Zhuo ^a   Zhang, Fan ^b   Jiang, Lingang ^a   Li, Keqin ^a,c   Hwang, Kai ^d  

^a HUNAN UNIVERSITY   (China)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c STATE UNIVERSITY OF NEW YORK   (United States)

^d University of Southern California   (United States)

Author keywords

Biomedical named entity recognition; conditional random fields; MapReduce; parallel algorithm

Indexed keywords

ALGORITHMS; BIOINFORMATICS; NONLINEAR PROGRAMMING; PARALLEL ALGORITHMS; RANDOM PROCESSES;

BIOMEDICAL NAMED ENTITY RECOGNITION; CONDITIONAL RANDOM FIELD; ESTIMATING PARAMETERS; LIMITED MEMORY BROYDEN-FLETCHER-GOLDFARB-SHANNO; MAP-REDUCE; MAPREDUCE FRAMEWORKS; REDUNDANT SYSTEM; TIME EFFICIENCIES;

VITERBI ALGORITHM;

EID: 84944081343     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2014.2368568     Document Type: Article

References (41)

1. Wikipedia. MEDLINE[EB/OL] [Online]. Available: http://en. wikipedia.org/wiki/MEDLINE, 2014.
2. T. Cohn, "Efficient inference in large conditional random fields, " in Proc. 17th Eur. Conf. Mach. Learn., 2006, pp. 606-613.
3. S. Della Pietra, V. Della Pietra, and J. Lafferty, "Inducing features of random fields, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 4, pp. 380-393, 1997.
4. J. E. Dennis, Jr. and J. J. More, "Quasi-newton methods, motivation and theory, " SIAM Rev., vol. 19, no. 1, pp. 46-89, Apr. 1977.
5. J. R. Finkel, T. Grenager, and C. Manning, "Incorporating nonlocal information into information extraction systems by gibbs sampling, " in Proc. 43rd Annu. Meeting Assoc. Comput. Linguistics, 2005, pp. 363-370.
6. G. D. Forney Jr., "The viterbi algorithm, " Proc. IEEE, vol. 61, no. 3, pp. 268-278, Mar. 1973.
7. C. M. Friedrich, T. Revillion, M. Hofmann, and J. Fluck, "Biomedical and chemical named entity recognition with conditional random fields: The advantage of dictionary features, " in Proc. 2nd Int. Symp. Semantic Mining Biomed., 2006, vol. 7, pp. 85-89.
8. Y. Ganjisaffar, T. Debeauvais, S. Javanmardi, R. Caruana, and C. V. Lopes, "Distributed tuning of machine learning algorithms using mapreduce clusters, " in Proc. 3rd Workshop Large Scale Data Mining: Theory Appl., 2011, p. 2.
9. A. Gunawardana, M. Mahajan, A. Acero, and J. C. Platt, "Hidden conditional random fields for phone classification, " in Proc. Int. Conf. Speech Commun. Technol., 2005, pp. 1117-1120.
10. Z. GuoDong and S. Jian, "Exploring deep knowledge resources in biomedical name recognition, " in Proc. Int. Joint Workshop Nat. Lang. Process. Biomed. Appl, 2004, pp. 96-99.
11. M. Jeong, C.-Y. Lin, and G. G Lee, "Efficient inference of CRFs for large-scale natural language data, " in Proc. ACL-IJCNLP 2009 Conf. Short Papers, 2009, pp. 281-284.
12. J.-D. Kim, T. Ohta, Y. Tsuruoka, Y. Tateisi, and N. Collier, "Introduction to the bio-entity recognition task at JNLPBA, " in Proc. Int. Joint Workshop Nat. Lang. Process. Biomed. Appl, 2004, pp. 70-75.
13. M. Laclavik, M. Seleng, and L. Hluch, "Towards large scale semantic annotation built on mapreduce architecture, " in Proc. 8th Int. Conf. Comput. Sci., 2008, pp. 331-338.
14. J. Lafferty, A. McCallum, and F. C. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data, " in Proc. 18th Eur. Conf. Mach. Learn, 2001, pp. 282-289.
15. T. Lavergne, O. Cappe, and F. Yvon, "Practical very large scale CRFs, " in Proc. 48th Annu. Meeting Assoc. Comput. Linguistics, 2010, pp. 504-513.
16. C. Lee, W.-J. Hou, and H.-H. Chen, "Annotating multiple types of biomedical entities: A single word classification approach, " in Proc. Int. Joint Workshop Nat. Lang. Process. Biomed. Appl, 2004, pp. 80-83.
17. L. Li, R. Zhou, and D. Huang, "Two-phase biomedical named entity recognition using CRFs, " Comput. Biol. Chem., vol. 33, no. 4, pp. 334-338, 2009.
18. J. Lin and C. Dyer, "Data-intensive text processing with mapreduce, " Synthesis Lectures Human Lang. Technol., vol. 3, no. 1, pp. 1-177, 2010.
19. X. Lin, L. Zhao, D. Yu, and X. Wu, "Distributed training for conditional random fields, " in Proc. Int. Conf. Nat. Lang. Process. Knowl. Eng., 2010, pp. 1-6.
20. R. McDonald and F. Pereira, "Identifying gene and protein mentions in text using conditional random fields, " BMC Bioinformat., vol. 6, no. Suppl 1, p. S6, 2005.
21. K. Morik and N. Piatkowski, "Parallel inference on structured data with CRFs on GPUs, " in Proc. Int. Workshop ECML PKDD Collective Learn. Inference Structured Data, 2012.
22. J. Nocedal, "Updating quasi-newton matrices with limited storage, " Math. Comput., vol. 35, no. 151, pp. 773-782, 1980.
23. S. Nowozin, P. V. Gehler, and C. H. Lampert, "On parameter learning in CRF-based approaches to object class image segmentation, " in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 98-111.
24. F. Olsson, G Eriksson, K. Franzen, L. Asker, and P. Liden, "Notions of correctness when evaluating protein name taggers, " in Proc. 19th Int. Conf. Comput. Linguistics, 2002, pp. 1-7.
25. C. Pal, C. Sutton, and A. McCallum, "Sparse forward-backward using minimum divergence beams for fast training of conditional random fields, " in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2006, vol. 5, p. V.
26. I. Palit and C. K. Reddy, "Scalable and parallel boosting with mapreduce, " IEEE Trans. Knowl. Data Eng., vol. 24, no. 10, pp. 1904-1916, Oct. 2012.
27. D. Pinto, A. McCallum, X. Wei, and W. B. Croft, "Table extraction using conditional random fields, " in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2003, pp. 235-242.
28. B. Settles, "Biomedical named entity recognition using conditional random fields and rich feature sets, " in Proc. Int. Joint Workshop Nat. Lang. Process. Biomed. Appl., 2004, pp. 104-107.
29. F. Sha and F. Pereira, "Shallow parsing with conditional random fields, " in Proc. Conf. North Amer. Chapter Assoc. Comput. Linguistics Human Lang. Technol., 2003, vol. 1, pp. 134-141.
30. C. Sun, Y. Guan, X. Wang, and L. Lin, "Rich features based conditional random fields for biological named entities recognition, " Comput. Biol. Med., vol. 37, no. 9, pp. 1327-1333, 2007.
31. H. Tamano, S. Nakadai, and T. Araki, "Optimizing multiple machine learning jobs on mapreduce, " in Proc. IEEE 3rd Int. Conf. Cloud Comput. Technol. Sci., 2011, pp. 59-66.
32. Z. Tang, J. Zhou, K. Li, and R. Li, "A mapreduce task scheduling algorithm for deadline constraints, " Cluster Comput., vol. 16, no. 4, pp. 651-662, 2013.
33. R. T. Tsai, C.-L. Sung, H.-J. Dai, H.-C. Hung, T.-Y. Sung, and W.-L. Hsu, "Nerbio: Using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition, " BMC Bioinformat., vol. 7, no. Suppl 5, p. S11, 2006.
34. T.-h. Tsai, W.-C. Chou, S.-H. Wu, T.-Y. Sung, J. Hsiang, and W.-L. Hsu, "Integrating linguistic knowledge into a conditional random fieldframework to identify biomedical named entities, " Expert Syst. Appl., vol. 30, no. 1, pp. 117-128, 2006.
35. A. J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimum decoding algorithm, " IEEE Trans. Inf. Theory, vol. 13, no. 2, pp. 260-269, Apr. 1967.
36. D. Z. Wang, E. Michelakis, M. J. Franklin, M. Garofalakis, and J. M. Hellerstein, "Probabilistic declarative information extraction, " in Proc. IEEE 26th Int. Conf. Data Eng., 2010, pp. 173-176.
37. P. Wittek and S. Daranyi, "Accelerating text mining workloads in a mapreduce-based distributed GPU environment, " J. Parallel Dis-trib. Comput., vol. 73, no. 2, pp. 198-206, 2013.
38. P. Xuan-Hieu, L.-M. Nguyen, Y. Inoguchi, and S. Horiguchi, "High-performance training of conditional random fields for large-scale applications of labeling sequence data, " IEICE Trans. Inf. Syst., vol. 90, no. 1, pp. 13-21, 2007.
39. L. Yang and Y. Zhou, "Exploring feature sets for two-phase biomedical named entity recognition using semi-CRFs, " Knowl. Inf. Syst., vol. 40, no. 2, pp. 439-453, 2014.
40. Z. Yang, H. Lin, and Y. Li, "Exploiting the performance of dictionary-based bio-entity name recognition in biomedical literature, " Comput. Biol. Chem., vol. 32, no. 4, pp. 287-291, 2008.
41. B. Zhu and M. Nakagawa, "A MRF model with parameter optimization by CRF for on-line recognition of handwritten japanese characters, " in Proc. SPIE-IS&T Electron. Imaging, 2011, vol. 7874, p. 787407.