High-order distance-based multiview stochastic learning in image classification

IEEE Transactions on Cybernetics

Volumn 44, Issue 12, 2014, Pages 2431-2442

  Yu, Jun ^a   Rui, Yong ^b   Tang, Yuan Yan ^c   Tao, Dacheng ^d  

^a HANGZHOU DIANZI UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c UNIVERSITY OF MACAU   (Macao)

^d UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Hypergraph; Image classification; Multiview stochastic; Probability matrix

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONTENT BASED RETRIEVAL; MATRIX ALGEBRA; OPTICAL CHARACTER RECOGNITION; PROBABILITY DISTRIBUTIONS; STOCHASTIC SYSTEMS; SUPPORT VECTOR MACHINES;

CLASSIFICATION METHODS; CONTENT BASED IMAGE RETRIEVAL; HYPERGRAPH; MULTI-VIEWS; PHYSICAL INTERPRETATION; PROBABILISTIC FRAMEWORK; PROBABILITY MATRIXES; TRANSDUCTIVE SUPPORT VECTOR MACHINE;

IMAGE CLASSIFICATION;

EID: 84911897421     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2307862     Document Type: Article

References (65)

1. R. Fergus, L. Fei-Fei, P. Perona, and A. Zisserman, "Learning object categories from Google's image search," in Proc. 10th IEEE Int. Conf. Comput. Vision, vol. 2. 2005, pp. 1816-1823.
2. A. Frome, Y. Singer, and J. Malik, "Image retrieval and classification using local distance functions," in Proc. Annu. Conf. Neural Inf. Process. Syst., pp. 417-424, 2006.
3. F. Wang, "Semisupervised metric learning by maximizing constraint margin," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 931-939, Aug. 2011.
4. G. Wang, F. Wang, T. Chen, D. Yeung, and F. Lochovsky, "Solution path for manifold regularized semisupervised classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 308-319, Apr. 2012.
5. X. Zhu, "Cross-domain semi-supervised learning using feature formulation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 6, pp. 1627-1638, Dec. 2011.
6. J. Winn, A. Criminisi, and T. Minka, "Object categorization by learned universal visual dictionary," in Proc. 10th IEEE Int. Conf. Comput. Vision, 2005, pp. 1800-1807.
7. D. Tao, L. Jin, W. Liu, and X. Li, "Hessian regularized support vector machines for mobile image annotation on the Cloud," IEEE Trans. Multimedia, vol. 15, no. 4, pp. 833-844, Apr. 2013.
8. G. Csurka, C. Dance, L. Fan, J. Williamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. ECCV Workshop Stat. Learn. Comput. Vision, 2004, pp. 59-74.
9. D. Tao, L. Jin, Z. Yang, and X. Li, "Rank preserving sparse learning for kinect based scene classification," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1406-1417, May 2013.
10. A. Ferencz, E. G. Learned-Miller, and J. Malik, "Building a classification cascade for visual identification from one example," in Proc. 10th IEEE Int. Conf. Comput. Vision, vol. 1. 2005, pp. 286-293.
11. A. D. Ferencz, E. G. Learned-Miller, and J. Malik, "Learning hyperfeatures for visual identification," in Proc. Annu. Conf. Neural Inf. Process. Syst., 2005, pp. 425-432.
12. L. Rokach and O. Maimon, "Top-down induction of decision trees classifiers: A survey," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 4, pp. 476-487, Nov. 2005.
13. V. N. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
14. F. Bovolo, L. Bruzzone, and L. Carlin, "A novel technique for subpixel image classification based on support vector machine," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2983-2999, Nov. 2010.
15. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning, O. Chapelle, B. Schölkopf, and A. Zien, Eds. Cambridge, MA, USA: MIT Press, 2006.
16. O. Chapelle, V. Sindhwani, and S. S. Keerthi, "Optimization techniques for semi-supervised support vector machines," J. Mach. Learn. Res., vol. 9, pp. 203-233, Jun. 2008.
17. O. Chapelle, J. Weston, and B. Scholkopf, "Cluster kernels for semi-supervised learning," in Proc. Adv. Neural Inf. Process. Syst., pp. 585-592, 2012.
18. K. Nigam, A. K. McCallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using Em," Mach. Learn., vol. 39, nos. 2-3, pp. 103-134, 2000.
19. M. Belkin and P. Niyogi, "Using Manifold Structure for Partially Labelled Classification," in Proc. Neural Inf. Process. Syst. Conf., pp. 929-936, 2002.
20. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
21. A. Smola and R. Kondor, "Kernels and regularization on graphs," in Proc. Conf. Learn. Theory Kernel Mach., pp. 144-158, 2003.
22. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," Adv. Neural Inf. Process. Syst., vol. 16, pp. 321-328, 2004.
23. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. 20th Int. Conf. Mach. Learn., pp. 912-919, 2003.
24. D. Zhou, J. Huang, and B. Schölkopf, "Learning with hypergraphs: Clustering, classification, and embedding," in Proc. Neural Inf. Process. Syst., 2006, pp. 1601-1608.
25. Y. Huang, Q. Liu, F. Lv, Y. Gong, and D. Metaxas, "Unsupervised image categorization by hypergraph partition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1266-1273, Jun. 2011.
26. R. Kohavi, "A study of cross-validation and bootstrap for accuracy estimation and model selection," in Proc. 14th Int. Joint Conf. Artif. Intell., 1995, pp. 1137-1145.
27. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
28. G. David, "Object recognition from local scale-invariant features," in Proc. Int. Conf. Comput. Vision, 1999, pp. 1150-1157.
29. C. J. Alpert and A. B. Kahng, "Recent directions in netlist partitioning: A survey," Integr. Very Large Scale Integr. J., vol. 19, pp. 1-81, Aug. 1995.
30. R. Zass and A. Shashua, "Probabilistic graph and hypergraph matching," in Proc. Int. Conf. Comput. Vision Pattern Recognit., 2008, pp. 1-8.
31. L. Sun, S. Ji, and J. Ye, "Hypergraph spectral learning for multi-label classification," in Proc. Int. Conf. Knowl. Discovery Data Mining, 2008, pp. 668-676.
32. Y. Huang, Q. Liu, and D. Metaxas, "Video object segmentation by hypergraph cut," in Proc. Int. Conf. Comput. Vision Pattern Recognit., 2009, pp. 1738-1745.
33. Z. Tian, T. Hwang, and R. Kuang, "A hypergraph-based learning algorithm for classifying gene expression and arrayCGH data with prior knowledge," Bioinformatics, vol. 25, no. 21, pp. 2831-2838, Jul. 2009.
34. Y. Huang, Q. Liu, S. Zhang, and D. Metaxas, "Image retrieval via probabilistic hypergraph ranking," in Proc. Int. Conf. Comput. Vision Pattern Recognit., 2010, pp. 3376-3383.
35. J. Bu et al., "Music recommendation by unified hypergraph: Combining social media information and music content," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 391-400.
36. A. Wong and S. Lu, "Recognition and shape synthesis of 3D objects based on attributed hypergraphs," IEEE Trans. Pattern Anal. Mach. Intell, vol. 11, no. 3, pp. 279-290, Mar. 1989.
37. F. Girosi, M. Jones, and T. Poggio, "Regularization theory and neural networks architectures," Neural Comput., vol. 7, pp. 219-269, Mar. 1995.
38. M. Everingham, L. VanGool, C. Williams, J. Winn, and A. Zisserman. (2007). The PASCAL Visual Object Classes Challenge (VOC2007) Results [Online]. Available: http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html
39. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003.
40. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
41. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Edu. Psychol., vol. 24, pp. 417-441, Sep. 1933.
42. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugenics, vol. 7, pp. 179-188, Sep. 1936.
43. J. Tenenbaum, V. Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
44. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
45. G. Hinton and S. Roweis, "Stochastic neighbor embedding," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2003, pp. 833-840.
46. L. van der Maaten and G. Hinton, "Visualizing data using t-SNE," J. Mach. Learn. Res., vol. 9, pp. 2579-2605, Nov. 2008.
47. S. Agarwal, K. Branson, and S. Belongie, "Higher order learning with graphs," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 17-24.
48. S. Boyd and L. Vandenberghe, Convex Optimization. New York, NY, USA: Cambridge Univ. Press, 2004.
49. Y. Nesterov, "Smooth minimization of non-smooth functions," Math. Program., vol. 103, no. 1, pp. 127-152, May 2005.
50. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization," in Proc. ICML, 2009, pp. 457-464.
51. M. Wang, H. Li, D. Tao, K. Lu, and X. Wu, "Multimodal graph-based reranking for web image search," IEEE Trans. Image Process., vol. 21, no. 11, pp. 4649-4661, Nov. 2012.
52. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embedding," IEEE Trans. Systems, Man, Cybern. B, Cybern., vol. 40, no. 6, pp. 1438-1446, Dec. 2010.
53. Y. Wu, E. Chang, K. Chang, and J. Smith, "Optimal multimodal fusion for multimedia data analysis," in Proc. ACM Multimedia, pp. 572-579, 2004.
54. C. Snoek, M. Worring, and A. Smeulders, "Early versus late fusion in semantic video analysis," in Proc. ACM Multimedia, pp. 399-402, 2005.
55. G. Iyengar, H. J. Nock, and C. Neti, "Discriminative model fusion for semantic concept detection and annotation in video," in Proc. ACM Multimedia, pp. 255-258, 2003.
56. R. Yan and A. Hauptmann, "The combination limit in multimedia retrieval," in Proc. ACM Multimedia, pp. 339-342, 2003.
57. B. Geng, C. Xu, D. Tao, L. Yang, and X. S. Hua, "Ensemble manifold regularization," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 2396-2402.
58. C. Xu, D. Tao, and C. Xu, "A survey on multi-view learning," CoRR abs/1304.5634, 2013.
59. J. Yu, Y. Rui, and B. Chen, "Exploiting click constraints and multiview features for image reranking," IEEE Trans. Multimedia, vol. 16, no. 1, pp. 159-168, Jan. 2014.
60. J. Yu, M. Wang, and D. Tao, "Semi-supervised multiview distance metric learning for cartoon synthesis," IEEE Trans. Image Process., vol. 21, no. 11, pp. 4636-4648, Nov. 2012.
61. J. Yu, D. Tao, D. Liu, and H. Seah, "On combining multiview features for cartoon character retrieval and clip synthesis," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 5, pp. 1413-1427, Oct. 2012.
62. J. Yu, D. Tao, and M. Wang, "Adaptive hypergraph learning and its application in image classification," IEEE Trans. Image Process., vol. 21, no. 7, pp. 3262-3272, Jul. 2012.
63. J. Yu, D. Liu, D. Tao, and H. Seah, "Complex object correspondence construction in 2D animation," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3257-3269, Nov. 2011.
64. J. Yu, D. Tao, J. Li, and J. Cheng. (2014). Semantic preserving distance metric learning and applications. Inf. Sci. [Online] Available: http://dx.doi.org/10.1016/j.ins.2014.01.025
65. J. Yu and D. Tao, Modern Machine Learning Techniques and Their Applications in Cartoon Animation Research. New York, NY, USA: Wiley, Mar. 2013.