Visual Domain Adaptation: A survey of recent advances

IEEE Signal Processing Magazine

Volumn 32, Issue 3, 2015, Pages 53-69

  Patel, Vishal M ^a   Gopalan, Raghuraman ^b   Li, Ruonan ^c   Chellappa, Rama ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; PATTERN RECOGNITION;

DIFFERENT DISTRIBUTIONS; DOMAIN ADAPTATION; EXISTING DOMAINS; TEST TIME; TRAINING DATA; VISUAL RECOGNITION;

SURVEYS;

EID: 85032751052     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2014.2347059     Document Type: Article

References (102)

1. H. Shimodaira, "Improving predictive inference under covariate shift by weighting the log-likelihood function," J. Stat. Plan. Inference, vol. 90, no. 2, pp. 227-244, 2000.
2. A. Torralba and A. A. Efros, "Unbiased look at data set bias," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 1521-1528.
3. A. Khosla, T. Zhou, T. Malisiewicz, A. A. Efros, and A. Torralba, "Undoing the damage of data set bias," in Proc. European Conf. Computer Vision, 2012, pp. 158-171.
4. N. Japkowicz and S. Stephen, "The class imbalance problem: A systematic study," Intell. Data Anal., vol. 6, no. 5, pp. 429-450, 2002.
5. J. J. Heckman, "Sample selection bias as a specification error," Econometric, vol. 47, no. 1, pp. 153-161, 1979.
6. B. Zadrozny, "Learning and evaluating classifiers under sample selection bias," in Proc. Int. Conf. Machine Learning, 2004, pp. 114-121.
7. R. Caruana, "Multitask learning," Machine Learning, vol. 28, no. 1, pp. 41-75, 1997.
8. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng, "Self-taught learning: Transfer learning from unlabeled data," in Proc. Int. Conf. Machine Learning, 2007, pp. 759-766.
9. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning. Cambridge, MA: MIT Press, 2006.
10. A. Sharma, A. Kumar, H. Daume, and D. Jacobs, "Generalized multiview analysis: A discriminative latent space," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012, pp. 2160-2167.
11. J. Jiang, "Domain adaptation in natural language processing," Ph.D. dissertation, University of Illinois at Urbana-Champaign, 2008.
12. V. N. Vapnik, The Nature of Statistical Learning Theory. New York, NY: Springer-Verlag, 1995.
13. M. Sugiyama and K. R. Muller, "Input-dependent estimation of generalization error under covariate shift," Stat. Decisions, vol. 23, no. 4, pp. 249-279, 2005.
14. J. Huang, A. J. Smola, A. Gretton, K. M. Borgwardt, and B. Schlkopf, "Correcting sample selection bias by unlabeled data," in Advances in Neural Information Processing Systems 19, B. Schölkopf, J. Platt, and T. Hoffman, Eds. Cambridge, MA: MIT Press, 2007, pp. 601-608.
15. Y. Lin, Y. Lee, and G. Wahba, "Support vector machines for classification in nonstandard situations," Mach. Learn., vol. 46, nos. 1-3, pp. 191-202, 2002.
16. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowledge Data Eng., vol. 22, no. 10, pp. 1345-1359, 2010.
17. W. Dai, G. Rong Xue, Q. Yang, and Y. Yu, "Transferring naive Bayes classifiers for text classification," in Proc. AAAI Conf. Artificial Intelligence, 2007, pp. 540-545.
18. K. Nigam, A. K. McCallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using EM," Mach. Learn., vol. 39, nos. 2-3, pp. 103-134, May 2000.
19. D. Xing, W. Dai, G.-R. Xue, and Y. Yu, "Bridged refinement for transfer learning," in Proc. European Conf. Principles and Practice of Knowledge Discovery in Databases, 2007, pp. 324-335.
20. J. Jiang and C. Zhai, "Instance weighting for domain adaptation in NLP," in Proc. Annu. Meeting of the Association for Computational Linguistics, 2007, pp. 264-271.
21. R. Raina, "Self-taught learning," Ph.D. dissertation, Stanford University, 2009.
22. H. Wang, F. Nie, and H. Huang, "Robust and discriminative self-taught learning," in Proc. Int. Conf. Machine Learning, vol. 28, no. 3, 2013, pp. 298-306.
23. W. Dai, Q. Yang, G.-R. Xue, and Y. Yu, "Self-taught clustering," in Proc. Int. Conf. Machine Learning, ACM, 2008, pp. 200-207.
24. Y. Jia, M. Salzmann, and T. Darrell, "Factorized latent spaces with structured sparsity," in Advances in Neural Information Processing Systems, J. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. Zemel, and A. Culotta, Eds. Curran Associates, Inc., 2010, pp. 982-990.
25. N. Rasiwasia, J. Costa Pereira, E. Coviello, G. Doyle, G. R. Lanckriet, R. Levy, and N. Vasconcelos, "A new approach to cross-modal multimedia retrieval," in Proc. Int. Conf. Multimedia, ACM, 2010, pp. 251-260.
26. K. Wang, R. He, W. Wang, L. Wang, and T. Tan, "Learning coupled feature spaces for cross-modal matching," in Proc. Int. Conf. Computer Vision, 2013, pp. 2088-2095.
27. A. Sharma and D. Jacobs, "Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 593-600.
28. Y. Jia, M. Salzmann, and T. Darrell, "Learning cross-modality similarity for multinomial data," in Proc. IEEE Int. Conf. Computer Vision, 2011, pp. 2407-2414.
29. J. Yang, R. Yan, and A. G. Hauptmann, "Cross-domain video concept detection using adaptive SVMs." in Proc. ACM Multimedia, 2007, pp. 188-197.
30. L. Duan, I. W. Tsang, D. Xu, and T.-S. Chua, "Domain adaptation from multiple sources via auxiliary classifiers," in Proc. Int. Conf. Machine Learning, 2009, pp. 289-296.
31. H. Daumé III, "Frustratingly easy domain adaptation," in Proc. Conf. Association for Computational Linguistics, 2007, p. 256.
32. W. Li, L. Duan, D. Xu, and I. Tsang, "Learning with augmented features for supervised and semi-supervised heterogeneous domain adaptation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 6, pp. 1134-1148, June 2014.
33. R. Gopalan, R. Li, and R. Chellappa, "Domain adaptation for object recognition: An unsupervised approach," in Proc. IEEE Int. Conf. Computer Vision, 2011, pp. 999-1006.
34. R. Gopalan, R. Li, and R. Chellappa, "Unsupervised adaptation across domain shifts by generating intermediate data representations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 11, pp. 2288-2302, Nov. 2014.
35. J. Hoffman, B. Kulis, T. Darrell, and K. Saenko, "Discovering latent domains for multisource domain adaptation," in Proc. European Conf. Computer Vision, 2012, pp. 702-715.
36. B. Gong, K. Grauman, and F. Sha, "Reshaping visual data sets for domain adaptation," in Proc. Neural Information Processing Systems, 2013, pp. 1286-1294.
37. B. Gong, Y. Shi, F. Sha, and K. Grauman, "Geodesic flow kernel for unsupervised domain adaptation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012, pp. 2066-2073.
38. B. Gong, K. Grauman, and F. Sha, "Learning kernels for unsupervised domain adaptation with applications to visual object recognition," Int. J. Comput. Vis., vol. 109, no. 1-2, pp. 3-27, Aug. 2014.
39. J. Zheng, M.-Y. Liu, R. Chellappa, and P. Phillips, "A Grassmann manifold-based domain adaptation approach," in Proc. Int. Conf. Pattern Recognition, 2012, pp. 2095-2099.
40. A. Shrivastava, S. Shekhar, and V. M. Patel, "Unsupervised domain adaptation using parallel transport on Grasmann manifold," in Proc. IEEE Winter Conf. Applications of Computer Vision, 2014, pp. 277-284.
41. K. Saenko, B. Kulis, M. Fritz, and T. Darrell, "Adapting visual category models to new domains," in Proc. European Conf. Computer Vision, 2010, vol. 6314, pp. 213-226.
42. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon, "Information-theoretic metric learning," in Proc. Int. Conf. Machine Learning, 2007, pp. 209-216.
43. B. Kulis, K. Saenko, and T. Darrell, "What you saw is not what you get: Domain adaptation using asymmetric kernel transforms," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 1785-1792.
44. I.-H. Jhuo, D. Liu, D. Lee, and S.-F. Chang, "Robust visual domain adaptation with low-rank reconstruction," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012, pp. 2168-2175.
45. M. Baktashmotlagh, M. T. Harandi, B. C. Lovell, and M. Salzmann, "Unsupervised domain adaptation by domain invariant projection," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 769-776.
46. B. Fernando, A. Habrard, M. Sebban, and T. Tuytelaars, "Unsupervised visual domain adaptation using subspace alignment," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 2960-2967.
47. Y. Aytar and A. Zisserman, "Tabula rasa: Model transfer for object category detection," in Proc. IEEE Int. Conf. Computer Vision, 2011, pp. 2252-2259.
48. W. Jiang, E. Zavesky, S.-F. Chang, and A. Loui, "Cross-domain learning methods for high-level visual concept classification," in Proc. IEEE Int. Conf. Image Processing, 2008, pp. 161-164.
49. L. Duan, I. W.-H. Tsang, D. Xu, and S. J. Maybank, "Domain transfer SVM for video concept detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009, pp. 1375-1381.
50. A. Bergamo and L. Torresani, "Exploiting weakly-labeled web images to improve object classification: A domain adaptation approach," in Advances in Neural Information Processing Systems, J. Lafferty, C. Williams, J. Shawe-Taylor, R. Zemel, and A. Culotta, Eds. Curran Associates, Inc., 2010, pp. 181-189.
51. L. Bruzzone and M. Marconcini, "Domain adaptation problems: A DASVM classification technique and a circular validation strategy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 770-787, 2010.
52. L. Duan, D. Xu, and I. Tsang, "Domain adaptation from multiple sources: A domain-dependent regularization approach," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 504-518, 2012.
53. A. J. Ma, P. C. Yuen, and J. Li, "Domain transfer support vector ranking for person re-identification without target camera label information," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 3567-3574.
54. L. Duan, D. Xu, and S.-F. Chang, "Exploiting web images for event recognition in consumer videos: A multiple source domain adaptation approach," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012, pp. 1338-1345.
55. M. Gönen and E. Alpaydin, "Multiple kernel learning algorithms," J. Mach. Learn. Res., vol. 12, pp. 2211-2268, July 2011.
56. L. Duan, D. Xu, I.-H. Tsang, and J. Luo, "Visual event recognition in videos by learning from web data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1667-1680, 2012.
57. L. Duan, I. Tsang, and D. Xu, "Domain transfer multiple kernel learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 465-479, 2012.
58. Z. Guo and Z. J. Wang, "Cross-domain object recognition via input-output kernel analysis," IEEE Trans. Image Processing, vol. 22, no. 8, pp. 3108-3119, Aug. 2013.
59. Y. Shi and F. Sha, "Information-theoretical learning of discriminative clusters for unsupervised domain adaptation," in Proc. Int. Conf. Machine Learning, 2012, pp. 1079-1086.
60. J. Hoffman, E. Rodner, J. Donahue, T. Darrell, and K. Saenko, "Efficient learning of domain-invariant image representations," in Proc. Int. Conf. Learning Representations, 2013, pp. 1-9.
61. J. Donahue, J. Hoffman, E. Rodner, K. Saenko, and T. Darrell, "Semi-supervised domain adaptation with instance constraints," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 668-675.
62. B. A. Olshausen and D. J. Fieldt, "Sparse coding with an overcomplete basis set: A strategy employed by v1," Vis. Res., vol. 37, no. 23, pp. 3311-3325, Dec. 1997.
63. R. Rubinstein, A. M. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057, June 2010.
64. Q. Qiu, V. M. Patel, P. Turaga, and R. Chellappa, "Domain adaptive dictionary learning," in Proc. European Conf. Computer Vision, 2012, vol. 7575, pp. 631-645.
65. S. Shekhar, V. M. Patel, H. V. Nguyen, and R. Chellappa, "Generalized domain-adaptive dictionaries," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2013, pp. 361-368.
66. J. Ni, Q. Qiu, and R. Chellappa, "Subspace interpolation via dictionary learning for unsupervised domain adaptation," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 692-699.
67. J. Zheng, R. Chellappa, and P. J. Phillips, "Sparse embedding-based domain adaptation for object recognition," in Proc. IEEE Int. Conf. Computer Vision Workshop on Visual Domain Adaptation and Dataset Bias, 2013, pp. 1-2.
68. H. V. Nguyen, V. M. Patel, N. M. Nasrabadi, and R. Chellappa, "Sparse embedding: A framework for sparsity promoting dimensionality reduction," in Proc. European Conf. Computer Vision, 2012, pp. 414-427.
69. B. Gong, K. Grauman, and F. Sha, "Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation," in Proc. Int. Conf. Machine Learning, 2013, pp. 222-230.
70. B. Gong, F. Sha, and K. Grauman, "Overcoming data set bias: An unsupervised domain adaptation approach," in Proc. Neural Information Processing Systems Workshop on Large Scale Visual Recognition and Retrieval, 2012, pp. 1-5.
71. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
72. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, July 2006.
73. G. Hinton and R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
74. M. Chen, Z. Xu, and K. Q. Weinberger, "Marginalized denoising autoencoders for domain adaptation," in Proc. Int. Conf. Machine Learning, 2012, pp. 767-774.
75. X. Glorot, A. Bordes, and Y. Bengio, "Domain adaptation for large-scale sentiment classification: A deep learning approach," in Proc. Int. Conf. Machine Learning, 2011, pp. 513-520
76. H. Van Nguyen, "Non-linear and sparse representations for multi-modal recognition," Ph.D. dissertation, Univ. Maryland, 2013.
77. S. Chopra, S. Balakrishnan, and R. Gopalan, "DLID: Deep learning for domain adaptation by interpolating between domains," in Proc. ICML Workshop on Challenges in Representation Learning, 2013, pp. 1-8.
78. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell, "Decaf: A deep convolutional activation feature for generic visual recognition," in Proc. Int. Conf. Machine Learning, 2013, pp. 647-655.
79. L. Bo, X. Ren, and D. Fox, "Hierarchical matching pursuit for image classification: Architecture and fast algorithms," in Proc. Neural Information Processing Systems, 2011, pp. 2115-2123.
80. N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar, "Attribute and simile classifiers for face verification," in Proc. IEEE Int. Conf. Computer Vision, Oct. 2009, pp. 365-372.
81. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth, "Describing objects by their attributes," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009, pp. 1778-1785.
82. Y. Wang and G. Mori, "A discriminative latent model of object classes and attributes," in Proc. European Conf. Computer Vision, 2010, pp. 155-168.
83. S. Branson, C. Wah, B. Babenko, F. Schroff, P. Welinder, P. Perona, and S. Belongie, "Visual recognition with humans in the loop," in Proc. European Conf. Computer Vision, pp. 438-451.
84. C. H. Lampert, H. Nickisch, and S. Harmeling, "Learning to detect unseen object classes by between-class attribute transfer," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009, pp. 951-958.
85. A. Kovashka and K. Grauman, "Attribute adaptation for personalized image search," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 3432-3439.
86. T. Tommasi and B. Caputo, "Frustratingly easy NBNN domain adaptation," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 897-904.
87. S. S. F. V. Jain, "Adapting classification cascades to new domains," in Proc. IEEE Int. Conf. Computer Vision, 2013, pp. 105-112.
88. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," in ACM Computing Surveys, Dec. 2003, pp. 399-458.
89. H. Ho and R. Gopalan, "Model-driven domain adaptation on product manifolds for unconstrained face recognition," Int. J. Comput. Vis., vol. 109, no. 1-2, pp. 110-125, Aug. 2014.
90. R. Gross, I. Matthews, J. F. Cohn, T. Kanade, and S. Baker, "Multi-pie," Image Vis. Comput., vol. 28, no. 5, pp. 807-813, 2010.
91. M. Yang, L. Zhang, X. Feng, and D. Zhang, "Fisher discrimination dictionary learning for sparse representation," in Proc. Int. Conf. Computer Vision, 2011, pp. 543-550.
92. G. Griffin, A. Holub, and P. Perona. (2007). Caltech-256 object category data set. California Institute of Technology, Tech. Rep. 7694. [Online]. Available: http://authors.library.caltech.edu/7694
93. K. Gallivan, A. Srivastava, X. Liu, and P. Van Dooren, "Efficient algorithms for inferences on Grassmann manifolds," in Proc. IEEE Workshop Statistical Signal Processing, Sept. 2003, pp. 315-318.
94. R. Rubinstein, M. Zibulevsky, and M. Elad, "Efficient implementation of the k-svd algorithm using batch orthogonal matching pursuit," Technion-Computer Science Department, Tech. Rep. CS-2008-08, Apr. 2008.
95. M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. New York: Springer, 2010.
96. A. Yang, Z. Zhou, A. Balasubramanian, S. Sastry, and Y. Ma, "Fast l1-minimization algorithms for robust face recognition," IEEE Trans. Image Processing, vol. 22, no. 8, pp. 3234-3246, Aug. 2013.
97. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
98. Z. Lin, A. Ganesh, J. Wright, L. Wu, M. Chen, and Y. Ma, "Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix," UIUC Technical Report, Tech. Rep. UILU-ENG-09-2214, July 2009.
99. Z. Lin, M. Chen, L. Wu, and Y. Ma, "The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices," UIUC Tech. Rep. UILU-ENG-09-2215, Oct 2009.
100. S. Boyd and L. Vandenberghe, Convex Optimization. New York: Cambridge Univ. Press, 2004.
101. X. Wang and X. Tang, "Face photo-sketch synthesis and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 1955-1967, Nov. 2009.
102. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: a database for studying face recognition in unconstrained environments," Univ. Massachusetts, Amherst, LFWTech. Rep. 07-49, Oct. 2007.