An overview of topic modeling and its current applications in bioinformatics

SpringerPlus

Volumn 5, Issue 1, 2016, Pages

  Liu, Lin ^a,b   Tang, Lin ^b   Dong, Wen ^a   Yao, Shaowen ^a   Zhou, Wei ^a  

^a YUNNAN UNIVERSITY   (China)

^b YUNNAN NORMAL UNIVERSITY   (China)

Author keywords

Bioinformatics; Classification; Clustering; Probabilistic generative model; Topic model

Indexed keywords

EID: 84988369357     PISSN: None     EISSN: 21931801     Source Type: Journal    
DOI: 10.1186/s40064-016-3252-8     Document Type: Review

References (85)

1. Andrzejewski D (2006) Modeling protein–protein interactions in biomedical abstracts with latent dirichlet allocation. CS 838-Final Project
2. Arnold CW, El-Saden SM, Bui AA, Taira R (2010) Clinical case-based retrieval using latent topic analysis. In: AMIA annual symposium proceedings, 26 pp
3. Bakalov A, McCallum A, Wallach H, Mimno D (2012) Topic models for taxonomies. In: Proceedings of the 12th ACM/IEEE-CS joint conference on digital libraries, pp 237–240
4. Bicego M, Lovato P, Ferrarini A, Delledonne M (2010a) Biclustering of expression microarray data with topic models. In: 2010 International conference on pattern recognition, pp 2728–2731
5. Bicego M, Lovato P, Oliboni B, Perina A (2010b) Expression microarray classification using topic models. In: ACM symposium on applied computing, pp 1516–1520
6. Bicego M, Lovato P, Perina A, Fasoli M, Delledonne M et al (2012) Investigating topic models’ capabilities in expression microarray data classification. IEEE/ACM Trans Comput Biol Bioinform 9(6):1831–1836
7. Bisgin H, Liu Z, Fang H, Xu X, Tong W (2011) Mining FDA drug labels using an unsupervised learning technique-topic modeling. BMC Bioinform 12(10):1
8. Bisgin H, Liu Z, Kelly R, Fang H, Xu X et al (2012) Investigating drug repositioning opportunities in FDA drug labels through topic modeling. BMC Bioinform 13(15):1
9. Bisgin H, Chen M, Wang Y, Kelly R, Hong F et al (2013) A systems approach for analysis of high content screening assay data with topic modeling. BMC Bioinform 14(Suppl 14):1–10
10. Blei DM (2012) Probabilistic topic models. Commun ACM 55(4):77–84
11. Blei DM, Lafferty JD (2006) Dynamic topic models. In: Proceedings of the 23rd international conference on machine learning, pp 113–120
12. Blei DM, Lafferty JD (2007) A correlated topic model of science. Statistics 1(1):17–35
13. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3(Jan):993–1022
14. Caldas J, Gehlenborg N, Faisal A, Brazma A, Kaski S (2009) Probabilistic retrieval and visualization of biologically relevant microarray experiments. Bioinformatics 25(12):296–300
15. Castellani U, Perina A, Murino V, Bellani M, Rambaldelli G et al (2010) Brain morphometry by probabilistic latent semantic analysis. Int Conf Med Image Comput Computer Assist Intervent 13:177–184
16. Chang J, Blei DM (2010) Hierarchical relational models for document networks. Ann Appl Stat 4(1):124–150
17. Chen X, Hu X, Shen X, Rosen G (2010) Probabilistic topic modeling for genomic data interpretation. In: IEEE international conference on bioinformatics and biomedicine (BIBM), pp 149–152
18. Chen X, He T, Hu X, An Y, Wu X (2011) Inferring functional groups from microbial gene catalogue with probabilistic topic models. In: IEEE international conference on bioinformatics and biomedicine (BIBM), pp 3–9
19. Chen X, He T, Hu X, Zhou Y, An Y et al (2012a) Estimating functional groups in human gut microbiome with probabilistic topic models. IEEE Trans Nanobiosci 11(3):203–215
20. Chen X, Hu X, Lim TY, Shen X (2012b) Exploiting the functional and taxonomic structure of genomic data by probabilistic topic modeling. IEEE/ACM Trans Comput Biol Bioinform 9(4):980–991
21. Chen Y, Yin X, Li Z, Hu X, Huang JX (2012c) A LDA-based approach to promoting ranking diversity for genomics information retrieval. BMC Genom 13(3):1
22. Coelho LP, Peng T, Murphy RF (2010) Quantifying the distribution of probes between subcellular locations using unsupervised pattern unmixing. Bioinformatics 26(12):i7–i12
23. Dawson JA, Kendziorski C (2012) Survival-supervised latent Dirichlet allocation models for genomic analysis of time-to-event outcomes, preprint. arXiv:1202.5999
24. Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 41(6):391
25. Fang EX, Li M-D, Jordan MI, Liu H (2015) Mining massive amounts of genomic data: a semiparametric topic modeling approach
26. Fei-Fei L, Perona P (2005) A bayesian hierarchical model for learning natural scene categories. IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 2, pp 524–531
27. Griffiths TL, Steyvers M (2004) Finding scientific topics. Proc Natl Acad Sci 101(Suppl 1):5228–5235
28. Griffiths D, Tenenbaum M (2004) Hierarchical topic models and the nested chinese restaurant process. Adv Neural Inf Process Syst 16:17
29. Hoffman MD, Blei DM, Bach FR (2010) Online learning for latent dirichlet allocation. Adv Neural Inf Process Syst 23:856–864
30. Hofmann T (2001) Unsupervised learning by probabilistic latent semantic analysis. Mach Learn 42(1–2):177–196
31. Howes C, Purver M, McCabe R (2013) Using conversation topics for predicting therapy outcomes in schizophrenia. Biomed Inf Insights 6(Suppl 1):39
32. Hu QV, He L, Li M, Huang JX, Haacke EM (2014) A semi-informative aware approach using topic model for medical search. 2014 IEEE international conference on bioinformatics and biomedicine (BIBM) 2014, pp 320–324
33. Huang Z, Dong W, Ji L, Gan C, Lu X et al (2014) Discovery of clinical pathway patterns from event logs using probabilistic topic models. J Biomed Inform 47:39–57
34. Jiang S, Qian X, Shen J, Fu Y, Mei T (2015) Author topic model-based collaborative filtering for personalized POI recommendations. IEEE Trans Multimedia 17(6):907–918
35. Kataria SS, Kumar KS, Rastogi RR, Sen P, Sengamedu SH (2011) Entity disambiguation with hierarchical topic models. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1037–1045
36. Konietzny SG, Dietz L, Mchardy AC (2011) Inferring functional modules of protein families with probabilistic topic models. BMC Bioinform 12(12):1–14
37. La Rosa M, Fiannaca A, Rizzo R, Urso A (2015) Probabilistic topic modeling for the analysis and classification of genomic sequences. BMC Bioinform 16(6):1
38. Lacoste-Julien S, Sha F, Jordan M I (2009) DiscLDA: Discriminative learning for dimensionality reduction and classification. In: Advances in neural information processing systems, pp 897–904
39. Lee M, Liu Z, Kelly R, Tong W (2014) Of text and gene—using text mining methods to uncover hidden knowledge in toxicogenomics. BMC Syst Biol 8(1):1–11
40. Li W, McCallum A (2006) Pachinko allocation: DAG-structured mixture models of topic correlations. In: Proceedings of the 23rd international conference on Machine learning, pp 577–584
41. Liu B, Liu L, Tsykin A, Goodall GJ, Green JE et al (2011) Identifying functional miRNA–mRNA regulatory modules with correspondence latent dirichlet allocation. Bioinformatics 26(24):3105–3111
42. Luo W, Stenger B, Zhao X, Kim T-K (2015) Automatic Topic discovery for multi-object tracking. In: AAAI conference on artificial intelligence, 2015
43. Ma H, Chen E, Xu L, Xiong H (2012) Capturing correlations of multiple labels: a generative probabilistic model for multi-label learning. Neurocomputing 92:116–123
44. Mao X-L, Ming Z-Y, Chua T-S, Li S, Yan H et al (2012) SSHLDA: a semi-supervised hierarchical topic model. In: Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning, pp 800–809
45. Masada T, Hamada T, Shibata Y, Oguri K (2009) Bayesian multi-topic microarray analysis with hyperparameter reestimation. In: Proceedings of the 5th international conference on advanced data mining and applications, vol 5678, pp 253–264
46. Masseroli M, Chicco D, Pinoli P (2012) Probabilistic latent semantic analysis for prediction of gene ontology annotations. In: The 2012 international joint conference on neural networks (IJCNN), pp 1–8
47. Mcauliffe JD, Blei DM (2008) Supervised topic models. In: Advances in neural information processing systems, pp 121–128
48. McCallum AK (2002) MALLET. http://mallet.cs.umass.edu/
49. Mimno D, McCallum A (2012) Topic models conditioned on arbitrary features with Dirichlet-multinomial regression. University of Massachusetts, Amherst 2008, pp 411–418
50. Minka T, Lafferty J (2002) Expectation-propagation for the generative aspect model. In: Proceedings of the eighteenth conference on Uncertainty in artificial intelligence, pp 352–359
51. Moon TK (1996) The expectation-maximization algorithm. IEEE Signal Process Mag 13(6):47–60
52. Nguyen V-A, Boyd-Graber JL, Resnik P (2013) Lexical and hierarchical topic regression. In: Advances in neural information processing systems, pp 1106–1114
53. Pan XY, Zhang YN, Shen HB (2010) Large-scale prediction of human protein-protein interactions from amino acid sequence based on latent topic features. J Proteome Res 9(10):4992–5001
54. Perina A, Lovato P, Murino V, Bicego M (2010) Biologically-aware latent Dirichlet allocation (BaLDA) for the classification of expression microarray. IAPR Int Conf Pattern Recogn Bioinform 6282(Suppl 1):230–241
55. Petinot Y, McKeown K, Thadani K (2011) A hierarchical model of web summaries. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies: short papers, vol 2, pp 670–675
56. Pinoli P, Chicco D, Masseroli M (2013) Enhanced probabilistic latent semantic analysis with weighting schemes to predict genomic annotations. 2013 IEEE 13th international conference on bioinformatics and bioengineering (BIBE), vol 7789, Suppl 1, pp 1–4
57. Pinoli P, Chicco D, Masseroli M (2014) Latent Dirichlet allocation based on Gibbs sampling for gene function prediction. In: IEEE conference on computational intelligence in bioinformatics and computational biology, pp 1–8
58. Porteous I, Newman D, Ihler A, Asuncion A, Smyth P et al (2008) Fast collapsed Gibbs sampling for latent Dirichlet allocation. In: ACM SIGKDD international conference on knowledge discovery and data mining, Las Vegas, NE, USA, August, pp 569–577
59. Pratanwanich N, Lio P (2014) Exploring the complexity of pathway–drug relationships using latent Dirichlet allocation. Comput Biol Chem 53:144–152
60. Ramage D, Rosen E (2009) Stanford TMT. http://nlp.stanford.edu/software/tmt/tmt-0.4/
61. Ramage D, Hall D, Nallapati R, Manning CD (2009) Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora. In: Proceedings of the 2009 conference on empirical methods in natural language processing, pp 248–256
62. Ramage D, Manning CD, Dumais S (2011) Partially labeled topic models for interpretable text mining. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, pp 457–465
63. Randhave DS, Sonkamble KV (2014) Probabilistic topic modeling using LDA of taxonomic structure of genomic data. Int J Comput Sci Mobile Comput 3(5):257–262
64. Rehurek R (2008) Gensim. http://radimrehurek.com/gensim/
65. Rogers S, Girolami M, Campbell C, Breitling R (2005) The latent process decomposition of cDNA microarray data sets. IEEE/ACM Trans Comput Biol Bioinf 2(2):143–156
66. Rosen-Zvi M, Griffiths T, Steyvers M, Smyth P (2004) The author-topic model for authors and documents. In: Proceedings of the 20th conference on uncertainty in artificial intelligence, pp 487–494
67. Rubin TN, Chambers A, Smyth P, Steyvers M (2011) Statistical topic models for multi-label document classification. Mach Learn 88(1–2):157–208
68. Sarioglu E, Choi H-A, Yadav K (2012) Clinical report classification using natural language processing and topic modeling. IEEE 11th international conference on machine learning and applications (ICMLA), vol 2, pp 204–209
69. Sarioglu E, Yadav K, Choi H-A (2013) Topic modeling based classification of clinical reports. In: ACL (student research workshop), 2013
70. Sinkkonen J, Parkkinen J, Kaski S, Aukia J (2008) A simple infinite topic mixture for rich graphs and relational data. In: NIPS workshop on analyzing graphs: theory and applications
71. Song M, Kim SY (2013) Detecting the knowledge structure of bioinformatics by mining full-text collections. Scientometrics 96(1):183–201
72. Teh YW, Jordan MI, Beal MJ, Blei DM (2006a) Hierarchical dirichlet processes. J Am Stat Assoc 101(476):1566–1581
73. Teh YW, Newman D, Welling M (2006b) A collapsed variational Bayesian inference algorithm for latent Dirichlet allocation. In: Advances in neural information processing systems, pp 1353–1360
74. Wallach HM (2006) Topic modeling: beyond bag-of-words. In: Proceedings of the 23rd international conference on Machine learning, pp 977–984
75. Wang X, McCallum A (2006) Topics over time: a non-Markov continuous-time model of topical trends. In: Proceedings of the 12th ACM SIGKDD international conference on knowledge discovery and data mining, pp 424–433
76. Wang H, Huang M, Zhu X (2009) Extract interaction detection methods from the biological literature. BMC Bioinform 10(1):1
77. Wang V, Xi L, Enayetallah A, Fauman E, Ziemek D (2013) GeneTopics-interpretation of gene sets via literature-driven topic models. BMC Syst Biol 7(5):1
78. Wang X, Zhu P, Liu T, Xu K (2016) BioTopic: a topic-driven biological literature mining system. Int J Data Mining Bioinform 14(4):373–386
79. Yao L, Mimno D, Mccallum A (2009) Efficient methods for topic model inference on streaming document collections. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 937–946
80. Youngs N, Penfold-Brown D, Bonneau R, Shasha D (2014) Negative example selection for protein function prediction: the NoGO database. PLoS Comput Biol 10(6):e1003644
81. Zeng QT, Redd D, Rindflesch TC, Nebeker JR (2012) Synonym, topic model and predicate-based query expansion for retrieving clinical documents. In: AMIA, 2012
82. Zhang J, Bing L, He J, Lei M, Li J (2012a) Inferring functional miRNA–mRNA regulatory modules in epithelial–mesenchymal transition with a probabilistic topic model. Comput Biol Med 42(4):428–437
83. Zhang R, Pakhomov S, Gladding S, Aylward M, Borman-Shoap E et al (2012b) Automated assessment of medical training evaluation text. In: AMIA annual symposium proceedings, 1459 pp
84. Zhang R, Cheng Z, Guan J, Zhou S (2015) Exploiting topic modeling to boost metagenomic reads binning. BMC Bioinform 16(Suppl 5):1–10
85. Zhu J, Ahmed A, Xing EP (2012) MedLDA: maximum margin supervised topic models. J Mach Learn Res 13:2237–2278