Cross-Domain Feature Learning in Multimedia

IEEE Transactions on Multimedia

Volumn 17, Issue 1, 2015, Pages 64-78

  Yang, Xiaoshan ^a,b   Zhang, Tianzhu ^a,b   Xu, Changsheng ^a,b  

^a INSTITUTE OF AUTOMATION   (China)

^b China Singapore Institute of Digital Media (CSIDM)   (Singapore)

Author keywords

Cross domain; deep learning; feature learning; multi modal

Indexed keywords

LEARNING SYSTEMS; SEMANTICS; VIDEO CAMERAS;

COMPREHENSIVE EVALUATION; CROSS-DOMAIN; DEEP LEARNING; EVENT CLASSIFICATION; FEATURE LEARNING; FEATURE REPRESENTATION; MULTI-MODAL; SENTIMENT CLASSIFICATION;

SOCIAL NETWORKING (ONLINE);

EID: 84937576103     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2375793     Document Type: Article

References (59)

1. M. Naaman, "Social multimedia: Highlighting opportunities for search and mining of multimedia data in social media applications," Multimedia Tools Appl., vol. 56, no. 1, pp. 9-34, 2012.
2. J. Sang and C. Xu, "Browse by chunks: Topic mining and organizing on web-scale social media," TOMCCAP, vol. 7, p. 30, 2011.
3. S. D. Roy, T. Mei, W. Zeng, and S. Li, "Socialtransfer: Cross-domain transfer learning from social streams for media applications," in Proc. ACM Multimedia, 2012, pp. 649-658.
4. J. Sang andC.Xu, "Right buddymakes the difference: An early exploration of social relation analysis in multimedia applications," in Proc. 20th ACM Multimedia Conf., Nara, Japan, Oct.-Nov. 2012, pp. 19-28.
5. X. Jin, A. C. Gallagher, L. Cao, J. Luo, and J. Han, "The wisdom of social multimedia: Using Flickr for prediction and forecast," in Proc. ACM Multimedia, 2010, pp. 1235-1244.
6. G. Ma and J. Luo, "Is a picture worth 1000 votes? Analyzing the sentiment of election related social photos," in Proc. IEEE Int. Conf. Multimedia Expo, 2013, pp. 1-6.
7. C. Tan, L. Lee, J. Tang, L. Jiang, M. Zhou, and P. Li, "User-level sentiment analysis incorporating social networks," in Proc. 17th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining, New York, NY, USA, 2011, pp. 1397-1405.
8. B.-K. Bao, W. Min, K. Lu, and C. Xu, "Social event detection with robust high-order co-clustering," in Proc. 3rd ACM Conf. Int. Conf. Multimedia Retrieval, New York, NY, USA, 2013, pp. 135-142.
9. M. Zaharieva, M. Zeppelzauer, and C. Breiteneder, "Automated social event detection in large photo collections," in Proc. 3rd ACM Conf. Int. Conf. Multimedia Retrieval, New York, NY, USA, 2013, pp. 167-174.
10. G. Petkos, S. Papadopoulos, and Y. Kompatsiaris, "Social event detection using multimodal clustering and integrating supervisory signals," in Proc. 2nd ACM Int. Conf. Multimedia Retrieval, New York, NY, USA, 2012, pp. 23:1-23:8.
11. M. Brenner and E. Izquierdo, "Social event detection and retrieval in collaborative photo collections," in Proc. 2nd ACM Int. Conf. Multimedia Retrieval, New York, NY, USA, 2012, pp. 21:1-21:8.
12. Y. Wang, H. Sundaram, and L. Xie, "Social event detection with interaction graph modeling," in Proc. 20th ACM Int. Conf. Multimedia, New York, NY, USA, 2012, pp. 865-868.
13. S. Orlando, F. Pizzolon, and G. Tolomei, "Seed: A framework for extracting social events from press news," in Proc. 22nd Int. Conf. World Wide Web Companion, Geneva, Switzerland, 2013, pp. 1285-1294.
14. T. Reuter and P. Cimiano, "Event-based classification of social media streams," in Proc. 2nd ACM Int. Conf. Multimedia Retrieval, New York, NY, USA, 2012, pp. 22:1-22:8.
15. X. Liu and B. Huet, "Heterogeneous features and model selection for event-based media classification," in Proc. 3rd ACM Conf. Int. Conf. Multimedia Retrieval, New York, NY, USA, 2013, pp. 151-158.
16. K. Saenko, B.Kulis, M. Fritz, and T.Darrell, "Adapting visual category models to new domains," in Proc. ECCV, 2010, vol. 4, pp. 213-226.
17. J. Hoffman, B. Kulis, T. Darrell, and K. Saenko, "Discovering latent domains for multisource domain adaptation," in Proc. ECCV, 2012, vol. 2, pp. 702-715.
18. B. Gong, K. Grauman, and F. Sha, "Reshaping visual datasets for domain adaptation," in Proc. NIPS, 2013, pp. 1286-1294.
19. G. E. Hinton, S. Osindero, and Y. W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
20. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks," in Proc. NIPS, 2006, pp. 153-160.
21. M. Ranzato, C. S. Poultney, S. Chopra, and Y. LeCun, "Efficient learning of sparse representations with an energy-based model," in Proc. NIPS, 2006, pp. 1137-1144.
22. H. Theil and C.-F. Chung, "Relations between two sets of variates: The bits of information provided by each variate in each set," Statist. Probability Lett., vol. 6, no. 3, pp. 137-139, Feb. 1988.
23. D. R. Hardoon, S. R. Szedmak, and J. R. Shawe-taylor, "Canonical correlation analysis: An overview with application to learning methods," Neural Comput, , vol. 16, no. 12, pp. 2639-2664, Dec. 2004.
24. N. Rasiwasia, J. C. Pereira, E. Coviello, G.Doyle, G. R. G. Lanckriet, R. Levy, and N. Vasconcelos, "A new approach to cross-modal multimedia retrieval," in Proc. ACM Multimedia, 2010, pp. 251-260.
25. N. Rasiwasia, P. J. Moreno, and N. Vasconcelos, "Bridging the gap: Query by semantic example," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 923-938, Aug. 2007.
26. M. Guillaumin, J. J. Verbeek, and C. Schmid, "Multimodal semi-supervised learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 902-909.
27. J. Blitzer, R. T. McDonald, and F. Pereira, "Domain adaptation with structural correspondence learning," in Proc. EMNLP, 2006, pp. 120-128.
28. S. J. Pan, I. W. Tsang, J. T. Kwok, and Q. Yang, "Domain adaptation via transfer component analysis," in Proc. IJCAI, 2009, pp. 1187-1192.
29. B. Gong, Y. Shi, F. Sha, and K. Grauman, "Geodesic flow kernel for unsupervised domain adaptation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2066-2073.
30. B. Gong, K. Grauman, and F. Sha, "Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation," in Proc. ICML, 2013, pp. 222-230.
31. A. Habrard, J.-P. Peyrache, andM. Sebban, "Boosting for unsupervised domain adaptation," in Proc. ECML/PKDD, 2013, pp. 433-448.
32. Z. Ma, Y. Yang, Y. Cai, N. Sebe, and A. G. Hauptmann, "Knowledge adaptation for ad hoc multimedia event detection with few exemplars," in Proc. ACM Multimedia, 2012, pp. 469-478.
33. W. Lu, J. Li, T. Li, W. Guo, H. Zhang, and J. Guo, "Web multimedia object classification using cross-domain correlation knowledge," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1920-1929, Dec. 2013.
34. G. Qi, C. C.Aggarwal, and T. S.Huang, "Towards semantic knowledge propagation from text corpus to web images," in Proc.WWW, 2011, pp. 297-306.
35. Y. Bengio, "Deep learning of representations: Looking forward," in Proc. SLSP, 2013, pp. 1-37.
36. P. Smolensky, "Information processing in dynamical systems: Foundations of harmony theory," in Parallel Distributed Processing, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA, USA: MIT Press, 1986, vol. 1, ch. 6, pp. 194-281.
37. P. Vincent, H. Larochelle, Y. Bengio, and P.-A.Manzagol, "Extracting and composing robust features with denoising autoencoders," in Proc. ICML, 2008, pp. 1096-1103.
38. X. Glorot, A. Bordes, and Y. Bengio, "Domain adaptation for large-scale sentiment classification: A deep learning approach," in Proc. ICML, 2011, pp. 513-520.
39. M. Chen, Z. E. Xu, K. Q. Weinberger, and F. Sha, "Marginalized denoising autoencoders for domain adaptation," in Proc. ICML, 2012, pp. 767-774.
40. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng, "Multimodal deep learning," in Proc. ICML, 2011, pp. 689-696.
41. K. M. Borgwardt, A. Gretton, M. J. Rasch, H.-P. Kriegel, B. Schölkopf, and A. J. Smola, "Integrating structured biological data by kernel maximum mean discrepancy," in Proc. ISMB, 2006, pp. 49-57.
42. A. Gretton, A. Smola, J. Huang, M. Schmittfull, K. Borgwardt, and B. Schölkopf, "Covariate shift by kernel mean matching," Dataset Shift Mach. Learn., vol. 3, no. 4, p. 5, 2009.
43. M. Baktashmotlagh, M. T. Harandi, B. C. Lovell, and M. Salzmann, "Unsupervised domain adaptation by domain invariant projection," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 769-776.
44. M. Long, J. Wang, G. Ding, J. Sun, and P. S. Yu, "Transfer feature learning with joint distribution adaptation," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2200-2207.
45. I. Steinwart, "On the influence of the kernel on the consistency of support vector machines," J. Mach. Learn. Res., vol. 2, pp. 67-93, 2001.
46. N. Boumal, B. Mishra, P.-A. Absil, and R. Sepulchre, "Manopt, a Matlab toolbox for optimization on manifolds," J. Mach. Learn. Res., vol. 15, pp. 1455-1459, 2014.
47. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
48. J. Blitzer, M. Dredze, and F. Pereira, "Biographies, Bollywood, boomboxes and blenders: Domain adaptation for sentiment classification," in Proc. ACL, 2007, pp. 440-447.
49. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Mach. Learn.: Proc. 13th Int. Conf., 1996, pp. 148-156.
50. L. Bruzzone and M. Marconcini, "Domain adaptation problems: A DASVM classification technique and a circular validation strategy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 770-787, May 2010.
51. J. Huang, A. Smola, A. Gretton, K. M. Borgwardt, and B. Scholkopf, "Correcting sample selection bias by unlabeled data," in Proc. NIPS, 2007, pp. 601-608.
52. P. Over, G. Awad, M. Michel, J. Fiscus, G. Sanders, W. Kraaij, A. F. Smeaton, and G. Quenot, "TRECVID 2013-An overviewof the goals, tasks, data, evaluation mechanisms and metrics," in Proc. TRECVID, May 2013, pp. 1-45.
53. G. Salton, A. Wong, and C. S. Yang, "A vector space model for automatic indexing," Commun. ACM, vol. 18, no. 11, pp. 613-620, Nov. 1975.
54. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval," Inf. Process. Manage., vol. 24, no. 5, pp. 513-523, 1988.
55. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
56. L. Liu, L. Wang, and X. Liu, "In defense of soft-assignment coding," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 2486-2493.
57. J. Yang, K. Yu, Y. Gong, and T. S. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2009, pp. 1794-1801.
58. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, vol. 2, pp. 2169-2178.
59. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct. 2010.