Learning sample specific weights for late fusion

IEEE Transactions on Image Processing

Volumn 24, Issue 9, 2015, Pages 2772-2783

  Lai, Kuan Ting ^a   Liu, Dong ^b   Chang, Shih Fu ^b   Chen, Ming Syan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b Department of Earth and Environmental Sciences   (United States)

Author keywords

Image Recognition; Infinite Push l1 norm.; Late Fusion; Video Recognition

Indexed keywords

IMAGE RECOGNITION; INFORMATION DISSEMINATION; LAPLACE TRANSFORMS; OPTIMIZATION;

ALTERNATING DIRECTION METHOD OF MULTIPLIERS; CONSTRAINED OPTIMI-ZATION PROBLEMS; GRADIENT PROJECTION ALGORITHMS; INFORMATION PROPAGATION; L1 NORM; LATE FUSION; RECOGNITION ACCURACY; VIDEO RECOGNITION;

CONSTRAINED OPTIMIZATION;

EID: 84930958462     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2423560     Document Type: Article

References (47)

1. P. K. Atrey, M. A. Hossain, A. El Saddik, and M. S. Kankanhalli, "Multimodal fusion for multimedia analysis: A survey," Multimedia Syst., vol. 16, no. 6, pp. 345-379, 2010.
2. B. L. Tseng, C.-Y. Lin, M. Naphade, A. Natsev, and J. R. Smith, "Normalized classifier fusion for semantic visual concept detection," in Proc. IEEE ICIP, vol. 2. Sep. 2003, pp. II-535-II-538.
3. O. R. Terrades, E. Valveny, and S. Tabbone, "Optimal classifier fusion in a non-Bayesian probabilistic framework," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 9, pp. 1630-1644, Sep. 2009.
4. G. Ye, D. Liu, I.-H. Jhuo, and S.-F. Chang, "Robust late fusion with rank minimization," in Proc. IEEE CVPR, Jun. 2012, pp. 3021-3028.
5. K. Nandakumar, Y. Chen, S. C. Dass, and A. K. Jain, "Likelihood ratiobased biometric score fusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 342-347, Feb. 2008.
6. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009.
7. S. Ayache, G. Quénot, and J. Gensel, "Classifier fusion for SVM-based multimedia semantic indexing," in Advances in Information Retrieval. Berlin, Germany: Springer-Verlag, 2007.
8. P. Natarajan et al., "Multimodal feature fusion for robust event detection in Web videos," in Proc. IEEE CVPR, Jun. 2012, pp. 1298-1305.
9. J. Liu, S. McCloskey, and Y. Liu, "Local expert forest of score fusion for video event classification," in Proc. 12th ECCV, 2012, pp. 397-410.
10. S. Oh et al., "Multimedia event detection with multimodal feature fusion and temporal concept localization," Mach. Vis. Appl., vol. 25, no. 1, pp. 49-69, 2014.
11. C. G. M. Snoek, M. Worring, and A. W. M. Smeulders, "Early versus late fusion in semantic video analysis," in Proc. 13th Annu. ACM Int. Conf. Multimedia, 2005, pp. 399-402.
12. D. Liu, K.-T. Lai, G. Ye, M.-S. Chen, and S.-F. Chang, "Samplespecific late fusion for visual category recognition," in Proc. IEEE CVPR, Jun. 2013, pp. 803-810.
13. T. Joachims, "Optimizing search engines using clickthrough data," in Proc. 8th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2002, pp. 133-142.
14. S. Agarwal, "The infinite push: A new support vector ranking algorithm that directly optimizes accuracy at the absolute top of the list," in Proc. SDM, 2011, pp. 839-850.
15. W. Liu, J. He, and S.-F. Chang, "Large graph construction for scalable semi-supervised learning," in Proc. 27th ICML, 2010, pp. 679-686.
16. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, 2011.
17. S. Boyd, C. Cortes, M. Mohri, and A. Radovanovic, "Accuracy at the top," in Proc. NIPS, 2012, pp. pp. 953-961.
18. A. Rakotomamonjy, "Sparse support vector infinite push," in Proc. 29th ICML, 2012, pp. 1335-1342.
19. D. Zhou and B. Schölkopf, "Learning from labeled and unlabeled data using random walks," in Pattern Recognition. Berlin, Germany: Springer-Verlag, 2004, pp. 237-244.
20. D. Zhou, J. Weston, A. Gretton, O. Bousquet, and B. Schölkopf, "Ranking on data manifolds," in Proc. NIPS, vol. 3. 2004, pp. 169-176.
21. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning, vol. 2. Cambridge, MA, USA: MIT Press, 2006.
22. X. Zhu, "Semi-supervised learning literature survey," Ph.D. dissertation, Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, WI, USA, 2006.
23. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. 16th ICML, 1999, pp. 200-209.
24. R. Collobert, F. Sinz, J. Weston, and L. Bottou, "Large scale transductive SVMs," J. Mach. Learn. Res., vol. 7, pp. 1687-1712, Dec. 2006.
25. D.-C. Zhan, M. Li, Y.-F. Li, and Z.-H. Zhou, "Learning instance specific distances using metric propagation," in Proc. 26th Annu. ICML, 2009, pp. 1225-1232.
26. C. Rudin, "The p-norm push: A simple convex ranking algorithm that concentrates at the top of the list," J. Mach. Learn. Res., vol. 10, pp. 2233-2271, Dec. 2009.
27. J. Eckstein and D. P. Bertsekas, "On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators," Math. Program., vol. 55, nos. 1-3, pp. 293-318, 1992.
28. A. Quattoni, X. Carreras, M. Collins, and T. Darrell, "An efficient projection for l1,? regularization," in Proc. 26th Annu. ICML, 2009, pp. 857-864.
29. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, "Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering," in Advances in Neural Information Processing Systems, vol. 16. Cambridge, MA, USA: MIT Press, 2004, pp. 177-184.
30. C. Hou, F. Nie, F. Wang, C. Zhang, and Y. Wu, "Semisupervised learning using negative labels," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 420-432, Mar. 2011.
31. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
32. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 221-228.
33. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semisupervised learning for image classification," in Proc. IEEE CVPR, Jun. 2010, pp. 902-909.
34. R. B. Girshick, P. F. Felzenszwalb, and D. McAllester. Discriminatively Trained Deformable Part Models, Release 5. http://people.cs.uchicago.edu/~rbg/latent-release5/
35. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE CVPR, Jun. 2014, pp. 580-587.
36. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
37. J. van de Weijer and C. Schmid, "Coloring local feature extraction," in Proc. 9th ECCV, 2006, pp. 334-348.
38. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
39. M.-E. Nilsback and A. Zisserman, "Automated flower classification over a large number of classes," in Proc. 6th ICVGIP, Dec. 2008, pp. 722-729.
40. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2005, pp. 886-893.
41. Y.-G. Jiang, G. Ye, S.-F. Chang, D. Ellis, and A. C. Loui, "Consumer video understanding: A benchmark database and an evaluation of human and machine performance," in Proc. 1st ACM ICMR, 2011, Art. ID 29.
42. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, nos. 2-3, pp. 107-123, 2005.
43. H. Wang, A. Kläser, C. Schmid, and C.-L. Liu, "Dense trajectories and motion boundary descriptors for action recognition," Int. J. Comput. Vis., vol. 103, no. 1, pp. 60-79, 2013.
44. K. Tang, B. Yao, L. Fei-Fei, and D. Koller, "Combining the right features for complex event recognition," in Proc. IEEE ICCV, Dec. 2013, pp. 2696-2703.
45. A. Tamrakar et al., "Evaluation of low-level features and their combinations for complex event detection in open source videos," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 3681-3688.
46. K.-T. Lai, D. Liu, M.-S. Chen, and S.-F. Chang, "Recognizing complex events in videos by learning key static-dynamic evidences," in Proc. 13th ECCV, 2014, pp. 675-688.
47. A. Vahdat, K. Cannons, G. Mori, S. Oh, and I. Kim, "Compositional models for video event detection: A multiple kernel learning latent variable approach," in Proc. IEEE ICCV, Dec. 2013, pp. 1185-1192.