Transfer latent variable model based on divergence analysis

Pattern Recognition

Volumn 44, Issue 10-11, 2011, Pages 2358-2366

  Gao, Xinbo ^a   Wang, Xiumei ^a   Li, Xuelong ^b   Tao, Dacheng ^c  

^a XIDIAN UNIVERSITY   (China)

^b XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Bregman divergence; Dimensionality reduction; Latent variable model; Transfer learning

Indexed keywords

BREGMAN DIVERGENCES; DATA SETS; DIFFERENT DOMAINS; DIMENSIONALITY REDUCTION; LATENT VARIABLE MODELS; REAL DATA SETS; TESTING SAMPLES; TRAINING DATASET; TRAINING MODEL; TRAINING SAMPLE; TRANSFER LEARNING;

PATTERN RECOGNITION; STATISTICAL TESTS;

CASE BASED REASONING;

EID: 79958858308     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.06.013     Document Type: Article

References (48)

1. H. Hotelling Analysis of a complex of statistical variables into principal components Journal of Educational Psychology 24 1933 417 441
2. Y. Zhang Z.-H. Zhou, Multi-label dimensionality reduction via dependency maximization, in: AAAI Conference on Artificial Intelligence, Chicago, IL, 2008, pp. 15031505.
3. X. He, and P. Niyogi Locality preserving projections Advances in Neural Information Processing Systems 16 2003 153 160
4. X. He, D. Cai, S. Yan, H. Zhang, Neighborhood preserving embedding, in: IEEE International Conference on Computer Vision, 2005, pp. 12081213. (Pubitemid 44042318)
5. D. Cai, X. He, J. Han, Semi-supervised discriminant analysis, in: IEEE International Conference on Computer Vision, 2007, pp. 17.
6. X. He, D. Cai, H. Liu, W. Ma, Locality preserving indexing for document representation, SIGIR'04, 2004, pp. 96103.
7. Y. Yuan, X. Li, Y. Pang, X. Lu, and D. Tao Binary sparse nonnegative matrix factorization IEEE Transactions on Circuits and Systems for Video Technology 19 5 2009 772 777
8. T. Zhang, D. Tao, X. Li, and J. Yang Patch alignment for dimensionality reduction IEEE Transactions on Knowledge and Data Engineering 21 9 2009 1299 1313
9. X. He Laplacian regularized d-optimal design for active learning and its application to image retrieval IEEE Transactions on Image Processing 19 1 2010 254 263
10. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang Face recognition using Laplacian faces IEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 2005 328 340 (Pubitemid 40377326)
11. X. He, M. Ji, H. Bao, Graph embedding with constraints, in: Proceedings of the 2009 International Joint Conference on Artificial Intelligence (IJCAI), Pasadena, CA, July 2009.
12. I.T. Jolliffe Principal Component Analysis 1986 Springer-Verlag New York
13. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs. Fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720 (Pubitemid 127762263)
14. B. Scholkopf, A. Smola, and K.-R. Muller Nonlinear component analysis as a kernel eigenvalue problem Neural Computation 10 5 1998 1299 1319 (Pubitemid 128463674)
15. J. Li, X. Li, and D. Tao KPCA for semantic object extraction in images Pattern Recognition 41 10 2008 3244 3250
16. X. Gao, B. Xiao, D. Tao, and X. Li Image categorization: graph edit distanceedge direction histogram Pattern Recognition 41 10 2008 3179 3191
17. S. Roweis, and L. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326 (Pubitemid 32041578)
18. X. Li, Y. Pang, Y. Yuan, L1-norm-based 2DPCA, IEEE Transactions on Systems, Man, and Cybernetics, Part B, 2010. Digital Object Identifier, doi:10.1109/TSMCB.2009.2035629.
19. Y. Pang, D. Tao, Y. Yuan, and X. Li Binary two-dimensional PCA IEEE Transactions on Systems, Man, and Cybernetics, Part B 38 4 2008 1176 1180
20. Y. Yuan, Y. Pang, J. Pan, and X. Li Scene segmentation based on IPCA for visual surveillance Neurocomputing 72 1012 2009 2450 2454
21. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Computation 15 6 2003 1373 1396 (Pubitemid 37049796)
22. J.B. Tenenbaum, V. Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323 (Pubitemid 32041577)
23. V. Silva, and J.B. Tenenbaum Global versus local methods in nonlinear dimensionality reduction Advances in Neural Information Processing Systems 15 2003 705 712
24. M.E. Tipping, and C.M. Bishop Probabilistic principal component analysis Journal of Royal Statistical Society B 61 3 1999 611 622
25. N.D. Lawrence Gaussian process models for visualization of high dimensional data Advances in Neural Information Processing Systems 16 2004 329 336
26. N.D. Lawrence Probabilistic non-linear principal component analysis with Gaussian process latent variable models Journal of Machine Learning Research 6 2005 1783 1816
27. J.M. Wang, D.J. Fleet, and A. Hertzmann Gaussian process dynamical models for human motion IEEE Transactions on Pattern Recognition and Machine Intelligence 30 2 2008 283 298
28. R. Urtasun, D.J. Fleet, P. Fua, 3D people tracking with Gaussian process dynamical models, in: Proceedings of the Conference on Computer Vision and Pattern Recognition, New York, USA, June 2006, pp. 238245. (Pubitemid 44931336)
29. W.Y. Dai, Q. Yang, G. Xue, Boosting for transfer learning, in: Proceedings of the International Conference on Machine Learning, Oregon, USA, June 2007, pp. 193200.
30. J. Sinno, Y. Qiang, A survey on transfer learning, IEEE Transactions on Knowledge and Data Engineering, preprint
31. S. Si, D. Tao, B. Geng, Bregman divergence based regularization for transfer subspace learning, IEEE Transactions on Knowledge and Data Engineering, 22 (7) (2010) 929942.
32. A. Farhadi, D. Forsyth, R. White, Transfer learning in sign language, in: Proceedings of the Conference on Computer Vision and Pattern Recognition, Minnesota, USA, June 2007, pp. 18.
33. S. Yan, D. Xu, and B. Zhang Graph embedding and extensions: a general framework for dimensionality reduction, neighborhood preserving embedding IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 2007 40 51 (Pubitemid 46415944)
34. X. Li, S. Lin, S. Yan, and D. Xu Discriminant locally linear embedding with high-order tensor data IEEE Transactions on Systems, Man, and Cybernetics, Part B 38 2 2008 342 352 (Pubitemid 351479557)
35. D.J. Bartholomew Latent Variable Models and Factor Analysis 1987 Charles Griffin & Co. Ltd. London
36. M.E. Tipping, M. Svensén, and C.K.I. Williams A fast EM algorithm for latent variable density models Advances in Neural Information Processing Systems 8 1996 465 471
37. C.E. Rasmussen, and C.K.I. Williams Gaussian Processes for Machine Learning 2006 The MIT press Cambridge
38. L.M. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming USSR Computational Mathematics and Physics 7 1967 200 217
39. X. Li, and Y. Pang Deterministic column-based matrix decomposition IEEE Transactions on Knowledge and Data Engineering 22 1 2010 145 149
40. R. Nock, and F. Nielsen On weight clustering IEEE Transactions on Pattern Analysis and Machine Intelligence 28 8 2006 1223 1235
41. L. Cayton, Fast nearest neighbor retrieval for Bregman divergences, in: Proceedings of the International Conference on Machine Learning, Helsinki, Finland, July 2008, pp. 112119.
42. A. Banerjee, S. Merugu, and I.S. Dhillon Clustering with Bregman divergences Journal of Machine Learning Research 6 2005 1705 1749
43. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York
44. M.F. Møller A scaled conjugate gradient algorithm for fast supervised learning Neural Networks 6 4 1993 525 533
45. N.D. Lawrence, M. Seeger, and R. Herbrich Fast sparse Gaussian process methods: the informative vector machine Advances in Neural Information Processing Systems 15 2003 625 632
46. 〈http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase. html〉
47. 〈http://cvc.yale.edu/projects/yalefaces/yalefaces.html〉
48. 〈http://vision.ucsd.edu/leekc/ExtYaleDatabase/ExtYaleB.html〉