Large-margin multi-vewInformation bottleneck

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 8, 2014, Pages 1559-1572

  Xu, Chang ^a   Tao, Dacheng ^b   Xu, Chao ^a  

^a Peking University   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

information bottleneck; large margin learning; Multi view learning

Indexed keywords

ALGORITHMS; CODES (SYMBOLS); COMPUTER PROGRAMMING;

ALTERNATING DIRECTION METHODS; CLASSIFICATION AND RECOGNITION; GENERALIZATION ERROR BOUNDS; INFORMATION BOTTLENECK; LARGE-MARGIN LEARNING; LEARNING FROM EXAMPLES; MULTI-VIEW LEARNING; RADEMACHER COMPLEXITY;

INFORMATION FILTERING;

EID: 84904192140     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.2296528     Document Type: Article

References (56)

1. A. Blum and T. Mitchell, "Combining Labeled and Unlabeled Data with Co-Training," Proc. 11th Ann. Conf. Computational Learning Theory (COLT '98), 1998.
2. K. Nigam and R. Ghani, "Analyzing the Effectiveness and Applicability of Co-Training," Proc. Ninth Int'l Conf. Information and Knowledge Management (CIKM '00), 2000.
3. V. Sindhwani, P. Niyogi, and M. Belkin, "A Co-Regularization Approach to Semi-Supervised Learning with Multiple Views," Proc. Workshop Learning with Multiple Views at ICML, 2005.
4. G. Lanckriet, N. Cristianini, L. El Ghaoui, P. Bartlett, and M. Jordan, "Learning the Kernel Matrix with Semi-Definite Programming," J. Machine Learning Research, vol. 5, pp. 27-72, 2004.
5. S. Sonnenburg, G. Reatsch, C. Scheafer, and B. Scheolkopf, "Large Scale Multiple Kernel Learning," J. Machine Learning Research, vol. 7, pp. 1531-1565, 2006. (Pubitemid 44373694)
6. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "Simplemkl," J. Machine Learning Research, vol. 9, pp. 2491-2521, 2008.
7. K. Chaudhuri, S.M. Kakade, K. Livescu, and K. Sridharan, "Multi-View Clustering via Canonical Correlation Analysis," Proc. 26th Ann. Int'l Conf. Machine Learning (ICML'09), 2009.
8. S.M. Kakade and D.P. Foster, "Multi-View Regression via Canonical Correlation Analysis," Learning Theory, pp. 82-96, Springer, 2007.
9. S. Akaho, "A Kernel Method for Canonical Correlation Analysis," preprint cs/0609071, 2006.
10. F.R. Bach and M.I. Jordan, "A Probabilistic Interpretation of Canonical Correlation Analysis," Technical Report 688, Dept. of Statistics, Univ. of California, 2005.
11. C. Archambeau and F. Bach, "Sparse Probabilistic Projections," Proc. Advances in Neural Information Processing Systems (NIPS), 2008.
12. B. Xie, Y. Mu, D. Tao, and K. Huang, "m-SNE: Multiview Stochastic Neighbor Embedding," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 41, no. 4, pp. 1088-1096, Aug. 2011.
13. D. Tao, X. Wang, and W. Bian, "Grassmannian Regularized Structured Multi-View Embedding for Image Classification," IEEE Trans. Image Processing, vol. 22, no. 7, pp. 2646-2660, July 2013.
14. Y. Jia, M. Salzmann, and T. Darrell, "Factorized Latent Spaces with Structured Sparsity," Proc. Advances in Neural Information Processing Systems (NIPS), 2010.
15. Y. Song, L. Morency, and R. Davis, "Multi-View Latent Variable Discriminative Models for Action Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2012.
16. A. Damianou, C. Ek, M. Titsias, and N. Lawrence, "Manifold Relevance Determination," preprint arXiv:1206.4610, 2012.
17. R. Memisevic, "Kernel Information Embeddings," Proc. 23rd Int'l Conf. Machine Learning (ICML), 2006.
18. R. Memisevic, L. Sigal, and D. Fleet, "Shared Kernel Information Embedding for Discriminative Inference," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 4, pp. 778-790, Apr. 2012.
19. N. Chen, J. Zhu, and E. Xing, "Predictive Subspace Learning for Multi-View Data: A Large Margin Approach," Proc. Advances in Neural Information Processing Systems (NIPS), 2010.
20. N. Chen, J. Zhu, F. Sun, and E. Xing, "Large-Margin Predictive Latent Subspace Learning for Multi-View Data Analysis.," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 12, pp. 2365-2378, Dec. 2012.
21. C. Xu, D. Tao, and C. Xu, "A Survey on Multi-View Learning," preprint 1304.5634, 2013.
22. D. Tao and W. Liu, "Multiview Hessian Regularization for Image Annotation," IEEE Trans. Image Processing, vol. 22, no. 7, pp. 2676-2687, July 2013.
23. Y. Luo, D. Tao, C. Xu, H. Liu, and Y. Wen, "Multiview Vector-Valued Manifold Regularization for Multilabel Image Classification," IEEE Trans. Neural Networks and Learning Systems, vol. 24, no. 5, pp. 709-722, May 2013.
24. J. Yu, M. Wang, and D. Tao, "Semi-Supervised Multiview Distance Metric Learning for Cartoon Synthesis," IEEE Trans. Image Processing, vol. 21, no. 11, pp. 4636-4648, Nov. 2012.
25. D.R. Hardoon, S. Szedmak, and J. Shawe-Taylor, "Canonical Correlation Analysis: An Overview with Application to Learning Methods," Neural Computation, vol. 16, no. 12, pp. 2639-2664, 2004. (Pubitemid 39604012)
26. A. Sharma, A. Kumar, H. Daume, and D.W. Jacobs, "Generalized Multiview Analysis: A Discriminative Latent Space," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012.
27. Y. Lu and D.P. Foster, "Optimal Weighting of Multi-View Data with Low Dimensional Hidden States," CoRR, 2012.
28. C. Xu, D. Tao, Y. Li, and C. Xu, "Large-Margin Multi-View Gaussian Process for Image Classification," Proc. Fifth Int'l Conf. Internet Multimedia Computing and Service (ICIMCS '13), 2013.
29. T. Diethe, D.R. Hardoon, and J. Shawe-Taylor, "Multiview Fisher Discriminant Analysis," Proc. Workshop Learning from Multiple Sources, 2008.
30. T. Diethe, D.R. Hardoon, and J. Shawe Taylor, "Constructing Nonlinear Discriminants from Multiple Data Views," Machine Learning and Knowledge Discovery in Databases, pp. 328-343, Springer, 2010.
31. M. Kan, S. Shan, H. Zhang, S. Lao, and X. Chen, "Multi-View Discriminant Analysis," Proc. European Conf. Computer Vision, 2012.
32. A. Globerson and N. Tishby, "Sufficient Dimensionality Reduction," J. Machine Learning Research, vol. 3, pp. 1307-1331, 2003.
33. T. Suzuki and M. Sugiyama, "Sufficient Dimension Reduction via Squared-Loss Mutual Information Estimation," Proc. Int'l Conf. Artificial Intelligence and Statistics (AISTATS), 2010.
34. D.M. Blei, A.Y. Ng, and M.I. Jordan, "Latent Dirichlet Allocation," J. Machine Learning Research, vol. 3, pp. 993-1022, 2003.
35. J. Zhu, A. Ahmed, and E.P. Xing, "Medlda: Maximum Margin Supervised Topic Models for Regression and Classification," Proc. 26th Ann. Int'l Conf. Machine Learning (ICML), 2009.
36. N. Tishby, F. Pereira, and W. Bialek, "The Information Bottleneck Method," preprint physics/0004057, 2000.
37. A.J. Smola, Advances in Large Margin Classifiers. MIT Press, 2000.
38. L. Torresani and K.-C. Lee, "Large Margin Component Analysis," Proc. Advances in Neural Information Processing Systems (NIPS), 2006.
39. T. Cover and J. Thomas, Elements of Information Theory. Wiley-Interscience, 2006.
40. D. Goldfarb, S. Ma, and K. Scheinberg, "Fast Alternating Linearization Methods for Minimizing the Sum of Two Convex Functions," Math. Programming, vol. 141, pp. 349-382, 2013.
41. Y. Nesterov, "Smooth Minimization of Non-Smooth Functions," Math. Programming, vol. 103, no. 1, pp. 127-152, 2005. (Pubitemid 40537674)
42. K. Morik, P. Brockhausen, and T. Joachims et al., "Combining Statistical Learning with a Knowledge-Based Approach-A Case Study in Intensive Care Monitoring," Proc. 16th Int'l Conf. Machine Learning (ICML'99), 1999.
43. T. Joachims, T. Finley, and C. Yu, "Cutting-Plane Training of Structural SVMs," Machine Learning, vol. 77, no. 1, pp. 27-59, 2009.
44. C. Chang and C. Lin, "Libsvm: A Library for Support Vector Machines," ACM Trans. Intelligent Systems and Technology (TIST), vol. 2, no. 3, article 27, 2011.
45. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers," Foundations and Trends in Machine Learning, vol. 3, no. 1, pp. 1-122, 2011.
46. B. He and X. Yuan, "On the o(1/n) Convergence Rate of the Douglas-Rachford Alternating Direction Method," SIAM J. Numerical Analysis, vol. 50, no. 2, pp. 700-709, 2012.
47. C. Zhang, H. Lee, and K.G. Shin, "Efficient Distributed Linear Classification Algorithms via the Alternating Direction Method of Multipliers," Proc. Int'l Conf. Artificial Intelligence and Statistics (AISTATS), 2012.
48. G.-B. Ye, Y. Chen, and X. Xie, "Efficient Variable Selection in Support Vector Machines via the Alternating Direction Method of Multipliers," Proc. Int'l Conf. Artificial Intelligence and Statistics (AISTAS), 2011.
49. H. Xu and S. Mannor, "Robustness and Generalization," Machine Learning, vol. 86, pp. 391-423, 2012.
50. P. Bartlett and S. Mendelson, "Rademacher and Gaussian Complexities: Risk Bounds and Structural Results," J. Machine Learning Research, vol. 3, pp. 463-482, 2003.
51. Z. Hussain and J. Shawe-Taylor, "Improved Loss Bounds for Multiple Kernel Learning," Proc. Int'l Conf. Artificial Intelligence and Statistics (AISTATS), 2011.
52. J. Farquhar, D. Hardoon, H. Meng, J. Shawe-Taylor, and S. Szedmak, "Two View Learning: SVM-2k, Theory and Practice," Proc. Advances in Neural Information Processing Systems (NIPS), 2005.
53. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal Semi-Supervised Learning for Image Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2010.
54. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre, "HMDB: A Large Video Database for Human Motion Recognition," Proc. IEEE Int'l Conf. Computer Vision (ICCV), 2011.
55. P. Sen, G. Namata, M. Bilgic, L. Getoor, B. Galligher, and T. Eliassi Rad, "Collective Classification in Network Data," Artificial Intelligence Magazine, vol. 29, no. 3, article 93, 2008.
56. Z. Lin, M. Chen, and Y. Ma, "The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices," preprint 1009.5055, 2010.