Multi-Modal Event Topic Model for Social Event Analysis

IEEE Transactions on Multimedia

Volumn 18, Issue 2, 2016, Pages 233-246

  Qian, Shengsheng ^a   Zhang, Tianzhu ^a   Xu, Changsheng ^a   Shao, Jie ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Event evolution; multi modality; social event tracking; social media; topic model

Indexed keywords

SOCIAL NETWORKING (ONLINE);

EVENT EVOLUTIONS; MULTI MODALITY; SOCIAL EVENTS; SOCIAL MEDIA; TOPIC MODELING;

EVOLUTIONARY ALGORITHMS;

EID: 84962243365     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2510329     Document Type: Article

References (53)

1. D. Patel, W. Hsu, and M. L. Lee, "Mining relationships among intervalbased events for classification," in Proc. SIGMOD, 2008, pp. 393-404.
2. J. Allan, R. Papka, and V. Lavrenko, "On-line new event detection and tracking," in Proc. SIGIR, 1998, pp. 37-45.
3. M. Merler, B. Huang, L. Xie, G. Hua, and A. Natsev, "Semantic model vectors for complex video event recognition," IEEE Trans. Multimedia, vol. 14, no. 1, pp. 88-101, Feb. 2012.
4. T. Zhang and C. Xu, "Cross-domain multi-event tracking via CO-PMHT," ACM Trans. Multimedia Comput. Commun. Appl., vol. 10, no. 4, pp. 31:1-31:19, 2014.
5. X. Yang, T. Zhang, C. Xu, and M. S. Hossain, "Automatic visual concept learning for social event understanding," IEEE Trans.Multimedia, vol. 17, no. 3, pp. 346-358, Mar. 2015.
6. L. Xie et al., "Discovering meaningful multimedia patterns with audio-visual concepts and associated text," in Proc. ICIP, 2004, pp. 2383-2386.
7. D. M. Blei and J. D. Lafferty, "Dynamic topic models," in Proc. ICML, 2006, pp. 113-120.
8. Y. Yang, J. Zhang, J. Carbonell, and C. Jin, "Topic-conditioned novelty detection," in Proc. KDD, 2002, pp. 688-693.
9. J. Makkonen, H. Ahonen-Myka, and M. Salmenkivi, "Simple semantics in topic detection and tracking," Inform. Retrieval, vol. 7, no. 3-4, pp. 347-368, 2004.
10. N. Diakopoulos, M. Naaman, and F. Kivran-Swaine, "Diamonds in the rough: Social media visual analytics for journalistic inquiry," in Proc. IEEE Symp. Vis. Analytics Sci. Technol., Oct. 2010, pp. 115-122.
11. X. Wu, C.-W. Ngo, and A. G. Hauptmann, "Multimodal news story clustering with pairwise visual near-duplicate constraint," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 188-199, Feb. 2008.
12. I. Kalamaras, A. Drosou, and D. Tzovaras, "Multi-objective optimization for multimodal visualization," IEEE Trans. Multimedia, vol. 16, no. 5, pp. 1460-1472, Aug. 2014.
13. X. Chen, A. O. Hero III, and S. Savarese, "Multimodal video indexing and retrieval using directed information," IEEE Trans.Multimedia, vol. 14, no. 1, pp. 3-16, Feb. 2012.
14. W. Liu, T. Mei, and Y. Zhang, "Instant mobile video search with layered audio-video indexing and progressive transmission," IEEE Trans. Multimedia, vol. 16, no. 8, pp. 2242-2255, Dec. 2014.
15. C. Kang, S. Xiang, S. Liao, C. Xu, and C. Pan, "Learning consistent feature representation for cross-modal multimedia retrieval," IEEE Trans. Multimedia, vol. 17, no. 3, pp. 370-381, Mar. 2015.
16. S. Qian, T. Zhang, R. Hong, and C. Xu, "Cross-domain collaborative learning in social multimedia," in Proc. ACM MM, 2015, pp. 99-108.
17. T. Reuter and P. Cimiano, "Event-based classification of social media streams," in Proc. ICMR, 2012, pp. 22:1-22:8.
18. X. Liu and B. Huet, "Heterogeneous features and model selection for event-based media classification," in Proc. ICMR, 2013, pp. 151-158.
19. D. M. Blei and M. I. Jordan, "Modeling annotated data," in Proc. SIGIR, 2003, pp. 127-134.
20. K. Barnard et al., "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, 2003.
21. J. Bian, Y. Yang, H. Zhang, and T. Chua, "Multimedia summarization for social events in microblog stream," IEEE Trans. Multimedia, vol. 17, no. 2, pp. 216-228, Feb. 2015.
22. J. Dodge et al., "Detecting visual text," in Proc. NAACL HLT, 2012, pp. 762-772.
23. A. Sun and S. S. Bhowmick, "Quantifying visual-representativeness of social image tags using image tag clarity," in Proc. Social Media Modeling Comput., 2011, pp. 3-23.
24. C. S. Firan, M. Georgescu, W. Nejdl, and R. Paiu, "Bringing order to your photos: Event-driven classification of Flickr images based on social knowledge," in Proc. CIKM, 2010, pp. 189-198.
25. T. Zhang, C. Xu, G. Zhu, S. Liu, and H. Lu, "A generic framework for video annotation via semi-supervised learning," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1206-1219, Aug. 2012.
26. X. Yang, T. Zhang, and C. Xu, "Cross-domain feature learning in multimedia," IEEE Trans.Multimedia, vol. 17, no. 1, pp. 64-78, Jan. 2015.
27. X. Yang, T. Zhang, C. Xu, and M. Yang, "Boosted multifeature learning for cross-domain transfer," TOMCCAP, vol. 11, no. 3, pp. 35:1-35:18, 2015.
28. S. Qian, T. Zhang, C. Xu, and M. S. Hossain, "Social event classification via boosted multimodal supervised latent Dirichlet allocation," TOMCCAP, vol. 11, no. 2, pp. 27:1-27:22, 2014.
29. Y.-R. Lin, H. Sundaram, M. D. Choudhury, and A. Kelliher, "Discovering multirelational structure in social media streams," TOMCCAP, vol. 8, no. 1, p. 4, 2012.
30. Y. Gong and X. Liu, "Generic text summarization using relevance measure and latent semantic analysis," in Proc. SIGIR, 2001, pp. 19-25.
31. A. Haghighi and L. Vanderwende, "Exploring content models for multi-document summarization," in Proc. NAACL, 2009, pp. 362-370.
32. W. Zhou, C. Shen, T. Li, S. Chen, and N. Xie, "Generating textual storyline to improve situation awareness in disaster management," in Proc. IRI, 2014, pp. 585-592.
33. D. Wang, T. Li, S. Zhu, and C. Ding, "Multi-document summarization via sentence-level semantic analysis and symmetric matrix factorization," in Proc. SIGIR, 2008, pp. 307-314.
34. X. Hu, L. Tang, J. Tang, and H. Liu, "Exploiting social relations for sentiment analysis in microblogging," in Proc.WSDM, 2013, pp. 537-546.
35. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," JMLR, vol. 3, pp. 993-1022, Mar. 2003.
36. T. Hofmann, "Probabilistic latent semantic analysis," in Proc. UAI, 1999, pp. 289-296.
37. D. Blei and J. McAuliffe, "Supervised topic models," in Proc. NIPS, 2008, pp. 121-128.
38. L. AlSumait, D. Barbará, and C. Domeniconi, "On-line LDA: Adaptive topic models for mining text streams with applications to topic detection and tracking," in Proc. ICDM, 2008, pp. 3-12.
39. L. Hong, B. Dom, S. Gurumurthy, and K. Tsioutsiouliklis, "A timedependent topic model for multiple text streams," in Proc. KDD, 2011, pp. 832-840.
40. J. Sang and C. Xu, "Right buddy makes the difference: An early exploration of social relation analysis in multimedia applications," in Proc. ACM MM, 2012, pp. 19-28.
41. D. Putthividhya, H. T. Attias, and S. S. Nagarajan, "Topic regression multi-modal latent Dirichlet allocation for image annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3408-3415.
42. C. Chemudugunta, P. Smyth, and M. Steyvers, "Modeling general and specific aspects of documents with a probabilistic topic model," in Proc. NIPS, 2006, pp. 241-248.
43. Y. Yang, J. G. Carbonell, R. D. Brown, T. Pierce, B. T. Archibald, and X. Liu, "Learning approaches for detecting and tracking news events," IEEE Intell. Syst. Appl., vol. 14, no. 4, pp. 32-43, Jul./Aug. 1999.
44. S. Lacoste-Julien, F. Sha, and M. I. Jordan, "DiscLDA: Discriminative learning for dimensionality reduction and classification," in Proc. NIPS, 2008, pp. 897-904.
45. Y. Jia, M. Salzmann, and T. Darrell, "Learning cross-modality similarity for multinomial data," in Proc. ICCV, 2011, pp. 2407-2414.
46. S. Virtanen, Y. Jia, A. Klami, and T. Darrell, "Factorized multi-modal topic model," in Proc. UAI, 2012, pp. 843-851.
47. T. L. Griffiths and M. Steyvers, "Finding scientific topics," Proc. Nat. Academy Sci., vol. 101, pp. 5228-5235, 2004.
48. T. Reuter et al., "Social event detection at MediaEval 2013: Challenges, datasets, and evaluation," in Proc.MediaEval 2013Multimedia Benchmark Workshop, Oct. 2013, pp. 1-2.
49. Q. Fang, J. Sang, and C. Xu, "Giant: Geo-informative attributes for location recognition and exploration," in Proc. MM, 2013, pp. 13-22.
50. S. Singh, A. Gupta, and A. A. Efros, "Unsupervised discovery of midlevel discriminative patches," in Proc. ECCV, 2012, pp. 73-86.
51. B. J. Frey and D. Dueck, "Clustering by passing messages between data points," Science, vol. 315, pp. 972-976, 2007.
52. D. Putthividhya, H. T. Attias, and S. S. Nagarajan, "Topic regression multi-modal latent Dirichlet allocation for image annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3408-3415.
53. Y. Zhao and G. Karypis, "Empirical and theoretical comparisons of selected criterion functions for document clustering," Mach. Learn., vol. 55, pp. 311-331, 2004.