Protein interaction detection in sentences via gaussian processes: A preliminary evaluation

International Journal of Data Mining and Bioinformatics

Volumn 5, Issue 1, 2011, Pages 52-72

  Polajnar, Tamara ^a   Rogers, Simon ^a   Girolami, Mark ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Gaussian process; GP; Protein interaction; Sentence classification; Support vector machine; SVM; Text mining; TM

Indexed keywords

EID: 79951611860     PISSN: 17485673     EISSN: 17485681     Source Type: Journal    
DOI: 10.1504/IJDMB.2011.038577     Document Type: Article

References (65)

1. Airola, A., Pyysalo, S., Björne, J., Pahikkala, T., Ginter, F. and Salakoski, T. (2008) 'All-paths graph kernel for protein-protein interaction extraction with evaluation of cross-corpus learning', BMC Bioinformatics, Vol. 9, Suppl. 11, URL: http://dx.doi.org/10.1186/1471-2105-9-S11-S2
2. Aizerman, A., Braverman, E.M. and Rozoner, L.I. (1964) 'Theoretical foundations of the potential function method in pattern recognition learning', Automation and Remote Control, Vol. 25, 821-837.
3. Albert, J.H. and Chib, S. (1993) 'Bayesian analysis of binary and polychotomous response data', Journal of the American Statistical Association, Vol. 88, No. 422, p.669.
4. Altun, Y., Hofmann, T. and Smola, A.J. (2004) 'Gaussian process classification for segmenting and annotating sequences', Proceedings of the Twenty-First International Conference on Machine Learning (ICML'04), Banff, Alberta, Canada, 4.8 July, Vol. 69, ACM, New York, NY, p.4, DOI: http://doi.acm.org/10.1145/1015330.1015433
5. Baldwin, B. and Carpenter, B (2008) Lingpipe Software Package, WWW document, URL: http://alias-i.com/lingpipe/index.html
6. Berger, A.L., Della Pietra, V.J. and Della Pietra, S.A. (1996) 'A maximum entropy approach to natural language processing', Computational Linguistics, Vol. 22, pp. 39-71. BIND (2007) Biomolecular Interaction Network Database (BIND), WWW document, URL: http://bind.ca/
7. Boser, B.E., Guyon, I. and Vapnik, V. (1992) 'A training algorithm for optimal margin classifiers', Computational Learing Theory, pp. 144-152, URL: http://citeseer. ist.psu.edu/boser92training.html (Pubitemid 23615470)
8. Bunescu, R., Ge, R., Kate, R.J., Marcotte, E.M., Mooney, R.J., Ramani, A.K. and Wong, Y.W. (2005) 'Comparative experiments on learning information extractors for proteins and their interactions', Artif. Intell. Med., Vol. 33, No. 2, pp. 139-155, URL: http://www.hubmed.org/display.cgi?uids=15811782 (Pubitemid 40462453)
9. Cawley, G.C. (2000) MATLAB Support Vector Machine Toolbox (v0.55β), University of East Anglia, School of Information Systems, Norwich, Norfolk, UK, NR4 7TJ, URL: http://theoval.sys.uea.ac.uk/.gcc/svm/toolbox
10. Chai, K., Adam, M., Chieu, H.L. and Ng, H.T. (2002) 'Bayesian online classifiers for text classification and filtering', SIGIR '02: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, USA, pp. 97-104.
11. Chu, W. and Ghahramani, Z. (2005a) 'Gaussian processes for ordinal regression', Journal of Machine Learning Research, Vol. 6, pp. 1019-1041.
12. Chu, W., Ghahramani, Z., Falciani, F. and Wild, D.L. (2005) 'Biomarker discovery in microarray gene expression data with gaussian processes', Bioinformatics, Vol. 21, No. 16, pp. 3385-3393, URL: http://www.hubmed.org/ display.cgi?uids=15937031 (Pubitemid 41222443)
13. Chu, W. and Ghahramani, Z. (2005b) 'Preference learning with Gaussian processes', Proceedings of the 22nd International Conference on Machine Learning (ICML'05),Bonn, Germany, 7.11 August, Vol. 119, ACM, New York, NY, pp. 137-144, DOI= http://doi.acm.org/10.1145/1102351.1102369 (Pubitemid 43183326)
14. Cohen, A.M. and Hersh, W.R. (2005) 'A survey of current work in biomedical text mining', Briefings in Bioinformatics, Vol. 6, No. 1, pp.51-71.
15. Crammer, K. and Singer, Y. (2001) 'On the algorithmic implementation of multiclass kernel-based vector machines', Journal of Machine Learning Research, Vol. 2, pp. 265-292, URL: http://jmlr.csail.mit.edu/papers/volume2/crammer01a/ crammer01a.pdf
16. Damoulas, T. and Girolami, M.A. (2008) 'Probabilistic multi-class multi-kernel learning: on protein fold recognition and remote homology detection', Bioinformatics, URL: http://www.hubmed.org/display.cgi?uids=18378524
17. Ding, C.H. and Dubchak, I. (2001) 'Multi-class protein fold recognition using support vector machines and neural networks', Bioinformatics, Vol. 17, No. 4, pp.349-358, URL: http://www.hubmed.org/display.cgi?uids=11301304 (Pubitemid 32421929)
18. Donaldson, I., Martin, J., de Bruijn, B., Wolting, C., Lay, V., Tuekam, B., Zhang, S., Baskin, B., Bader, G.D., Michalickova, K., Pawson, T. and Hogue, C.W.V. (2003) 'PreBIND and textomy - mining the biomedical literature for protein-protein interactions using a support vector machine', BMC Bioinformatics, Vol. 4, No. 11, URL: http://www.biomedcentral.com/1471-2105/4/11
19. Erkan, G., Ozgur, A. and Radev, D.R. (2007) 'Semi-supervised classification for extracting protein interaction sentences using dependency parsing', Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pp.228-237, URL: http://www.aclweb.org/anthology/D/D07/D07-1024
20. Girolami, M. and Zhong, M. (2007) 'Data integration for classification problems employing gaussian process priors', in Schölkopf, B., Platt, J. and Hoffman, T. (Eds.): Advances in Neural Information Processing Systems, MIT Press, Cambridge, MA, Vol. 19, pp.465-472.
21. Girolami, M. and Rogers, S. (2006) 'Variational bayesian multinomial probit regression with gaussian process priors', Neural Computation, Vol. 18, No. 8, pp.1790-1817. (Pubitemid 44036395)
22. Giuliano, C., Lavelli, A. and Romano, L. (2006) 'Exploiting shallow linguistic information for relation extraction from biomedical literature', Proc. EACL'06, Trento, Italy, pp.401-408.
23. Hersh, W. (2005) 'Evaluation of biomedical text mining systems: lessons learned from information retrieval', Briefings in Bioinformatics, Vol. 6, pp.344-356. (Pubitemid 43091940)
24. Hsu, C-W. and Lin, C-J. (2002) 'A comparison of methods for multiclass support vector machines', IEEE Transactions on Neural Networks, Vol. 13, pp.415-425. (Pubitemid 34475042)
25. Huang, J., Lu, J. and Ling, C.X. (2003) 'Comparing naive bayes, decision trees, and svm with auc and accuracy', ICDM '03: Proceedings of the Third IEEE International Conference on Data Mining, IEEE Computer Society, Washington DC, USA, p.553.
26. Joachims, T. (1998) 'Text categorization with support vector machines: learning with many relevant features', Proceedings of the European Conference on Machine Learning, Springer, Chemnitz, Germany, pp.137-142. (Pubitemid 128067178)
27. Joachims, T. (2007) SVM-Light Support Vector Machine, WWW document, URL: http://svmlight.joachims.org/
28. Joachims, T. (1999) Advances in Kernel Methods - Support Vector Learning, MIT-Press, chapter Making large-Scale SVM Learning Practical, Cambridge, Massachusetts.
29. Keerthi, S.S., Chapelle, O. and DeCoste, D. (2006) 'Building support vector machines with reduced classifier complexity', Journal of Machine Learning Research, Vol. 7, pp.1493-1515. (Pubitemid 44024591)
30. Kim, J.D., Ohta, T., Tateisi, Y. and Tsujii, J. (2003) 'Genia corpus-semantically annotated corpus for bio-textmining', Bioinformatics, Vol. 19, Suppl. 1, pp.180-182, URL:http://www.hubmed.org/display.cgi?uids=12855455
31. Kote-Jarai, Z., Matthews, L., Osorio, A., Shanley, S., Giddings, I., Moreews, F., Locke, I., Evans, D.G., Eccles, D., Williams, R.D., Girolami, M., Campbell, C. and Eeles, R. (2006) 'Accurate prediction of brca1 and brca2 heterozygous genotype using expression profiling after induced DNA damage', Clin. Cancer Res., Vol. 12, No. 13, pp.3896-3901, URL: http://www.hubmed.org/ display.cgi?uids=16818684 (Pubitemid 44078072)
32. Lama, N. and Girolami, M. (2008) 'Vbmp: variational bayesian multinomial probit regression for multi-class classification in r', Bioinformatics, Vol. 24, No. 1, pp.135-136, URL: http://www.hubmed.org/display.cgi?uids=18003643
33. Lawrence, N.D., Seeger, M. and Herbrich, R. (2003) Advances in Neural Information Processing Systems, MIT Press, chapter Fast sparse Gaussian process methods: the informative vector machine, Cambridge, Massachusetts, pp.625-632.
34. Lawrence, N.D. and Jordan, M.I. (2006) 'Gaussian processes and the null-category noise model', in Chapelle, O., Schölkopf, B. and Zien, A. (Eds.): Semi-supervised Learning, MIT Press, Cambridge, Massachusetts, Chapter 8, pp.27-40.
35. Lawrence, N., Platt, J.C. and Jordan, M.I. (2005) 'Extensions of the informative vector machine', in Winkler, J., Lawrence, N.D. and Niranjan, M. (Eds.): Proceedings of the Shefield Machine Learning Workshop, Springer-Verlag, Berlin, pp.56-87.
36. Lee, K-J., Hwang, Y-S. and Rim, H-C. (2003) 'Two-phase biomedical NE recognition based on SVMs', Proceedings of the ACL 2003 Workshop on Natural Language Processing in Biomedicine, 11 July, Vol. 13, Sapporo, Japan, Annual Meeting of the ACL, Association for Computational Linguistics, Morristown, NJ, pp.33-40, DOI=http://dx.doi.org/10.3115/1118958.1118963
37. Lee, K.J., Hwang, Y.S., Kim, S. and Rim, H.C. (2004a) 'Biomedical named entity recognition using two-phase model based on SVMs', J. Biomed. Inform., Vol. 37, No. 6, pp.436-447, URL: http://www.hubmed.org/display.cgi?uids=15542017 (Pubitemid 39487149)
38. Lee, Y., Lin, Y. and Wahba, G. (2004b) 'Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data', Journal of the American Statistical Association, Vol. 99, No. 15, pp.67-81. (Pubitemid 38545195)
39. Lewis, D.D. (1998) 'Naive (Bayes) at forty: the independence assumption in information retrieval', ECML '98: Proceedings of the 10th European Conference on Machine Learning, Springer-Verlag, London, UK, pp.4-15.
40. Manning, C.D. and Schütze, H. (1999) Foundations of Statistical Natural Language Processing, The MIT Press, Cambridge, Massachusetts, URL: citeseer.csail.mit.edu/635422.html
41. Mitchell, A.L., Divoli, A., Kim, J.H., Hilario, M., Selimas, I. and Attwood, T.K. (2005) 'Metis: multiple extraction techniques for informative sentences', Bioinformatics, Vol. 21, No. 22, pp.4196-4197, URL: http://www.hubmed.org/display.cgi?uids=16159915 (Pubitemid 41672115)
42. Nigam, K., McCallum, A. and Mitchell, T. (2006) Semi-Supervised Learning, MIT Press, Boston, chapter Semi-supervised Text Classification Using EM.
43. NIH (2008) Statistical Reports on MEDLINE/PubMed Baseline Data, WWW document, URL: http://www.nlm.nih.gov/bsd/licensee/baselinestats.html
44. Opper, M. and Winther, O. (1999) Large Margin Classifiers, MIT Press, chapter Gaussian
45. Platt, J.C. (1999) Advances in Large Margin Classifiers, MIT Press, chapter Probabilities for SV Machines, Cambridge, Massachusetts, pp.61-74.
46. Rasmussen, C.E. and Williams, C.K.I. (2006) Gaussian Processes for Machine Learning, MIT Press, Cambridge, Massachusetts.
47. Rogers, S. and Girolami, M. (2007) 'Multi-class semi-supervised learning with the -truncated multinomial probit Gaussian process', Journal of Machine Learning Research Workshop and Conference Proceedings, Vol. 1, pp.17-32.
48. Rosario, B. and Hearst, M. (2005) 'Multi-way relation classification: application to protein-protein interaction', Proceedings of HLT-NAACL'05, URL: http://biotext.berkeley.edu/papers/hlt-emnlp05-rosario.pdf
49. Sculley, D. and Wachman, G.M. (2007) 'Relaxed online svms for spam filtering', SIGIR '07: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, pp.415-422. (Pubitemid 350164988)
50. Seeger, M. and Jordan, M.I. (2004) Sparse Gaussian Process Classification with Multiple Classes, Technical Report TR 661, Department of Statistics, University of California at Berkeley, URL: http://www.kyb.tuebingen.mpg.de/bs/ people/seeger/
51. Shawe-Taylor, J. and Cristianini, N. (2004) Kernel Methods for Pattern Analysis, Cambridge University Press, New York, NY, USA.
52. Silva, C. and Ribeiro, B. (2007) 'On text-based mining with active learning and background knowledge using SVM', Soft Computing, Vol. 11, No. 6, January, pp.519-530, URL: http://dx.doi.org/10.1007/s00500-006-0080-8
53. Song, M., Song, I-Y., Hu, X. and Allen, R.B. (2005a) 'Integrating text chunking with mixture hidden markov models for effective biomedical information extraction', International Conference on Computational Science, Vol. 2, pp.976-984. (Pubitemid 41342762)
54. Song, M., Song, I-Y., Hu, X. and Allen, R.B. (2005b) 'Kxtractor: an effective biomedical information extraction technique based on mixture hidden markov models', Transactions on Computational Systems Biology II, Vol. 2, pp.68-81.
55. Stankovic, M., Moustakis, V. and Stankovic, S. (2005) 'Text categorization using informative vector machine', The International Conference on Computer as a Tool, 'EUROCON 2005', Vol. 1, 21-24 November, Belgrade, Serbia, pp.209-212. (Pubitemid 46389003)
56. Sugiyama, K., Hatano, K. and Yoshikawa, S.U.M. (2003) 'Extracting information on protein-protein interactions from biological literature based on machine learning approaches', in Gribskov, M., Kanehis, M., Miyano, S. and Takagi, T. (Eds.): Genome Informatics 2003, Universal Academy Press, Tokyo, pp.701-702.
57. Takeuchi, K. and Collier, N. (2005) 'Bio-medical entity extraction using support vector machines', Artif. Intell. Med., Vol. 33, No. 2, pp.125-137, URL: http://www.hubmed. org/display.cgi?uids=15811781 (Pubitemid 40462452)
58. Theodosiou, T., Angelis, L., Vakali, A. and Thomopoulos, G.N. (2007) 'Gene functional annotation by statistical analysis of biomedical articles', Int. J. Med. Inform., Vol. 76, No. 8, pp.601-613, URL: http://www.hubmed.org/ display.cgi?uids=16781189 (Pubitemid 46874260)
59. Van Rijsbergen, C.J. (1979) Information Retrieval, 2nd ed., Dept. of Computer Science, University of Glasgow, URL: citeseer.csail.mit.edu/ vanrijsbergen79information.html
60. Vapnik, V. (1995) The Nature of Statistical Learning Theory, Springer Verlag, New York.
61. Vapnik, V. (1995) The Nature of Statistical Learning Theory, Springer Verlag, New York. Wang, J.T.L. and Wu, X. (2006) 'Kernel design for RNA classification using support vector machines', Int. J. Data Min. Bioinformatics, Vol. 1, No. 1, pp.57-76.
62. Wang, T., Li, Y., Bontcheva, K., Cunningham, H. and Wang, J. (2006) 'Automatic extraction of hierarchical relations from text', Proceedings of the Third European Semantic Web Conference (ESWC 2006), Springer, URL: http://gate.ac.uk/sale/eswc06/eswc06-relation.pdf
63. Xenarios, I., Fernandez, E., Salwinski, L., Duan, X.J., Thompson, M.J., Marcotte, E.M. and Eisenberg, D. (2001) 'Dip: the database of interacting proteins: 2001 update', Nucleic Acids Res., Vol. 29, No. 1, pp.239-241, URL: http://www.hubmed.org/display.cgi?uids=11125102 (Pubitemid 32054458)
64. Xu, J. and Huang, Y. (2007) 'Using SVM to extract acronyms from text', Soft Comput., Vol. 11, No. 4, pp.369-373. (Pubitemid 44741402)
65. Yu, W., Clyne, M., Dolan, S.M., Yesupriya, A., Wulf, A., Liu, T., Khoury, M.J. and Gwinn, M. (2008) 'Gapscreener: an automatic tool for screening human genetic association literature in pubmed using the support vector machine technique', BMC Bioinformatics, Vol. 9, No. 1, p.205, URL: http://www.hubmed. org/display.cgi?uids=18430222