Joint unsupervised learning of deep representations and image clusters

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5147-5156

  Yang, Jianwei ^a   Parikh, Devi ^a   Batra, Dhruv ^a  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NEURAL NETWORKS; PATTERN RECOGNITION; UNSUPERVISED LEARNING;

CLUSTERING RESULTS; CONVOLUTIONAL NEURAL NETWORK; IMAGE CLUSTERING; IMAGE CLUSTERS; IMAGE DATASETS; LOSS FUNCTIONS; SINGLE MODELS; STATE OF THE ART;

CLUSTERING ALGORITHMS;

EID: 84986281587     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.556     Document Type: Conference Paper

References (64)

1. D. Cai, X. He, X. Wang, H. Bao, and J. Han. Locality preserving nonnegative matrix factorization. In IJCAI, volume 9, pages 1010-1015, 2009.
2. G. Chen. Deep learning with nonparametric clustering. arXiv preprint arXiv:1501.03084, 2015.
3. X. Chen and D. Cai. Large scale spectral clustering with landmark-based representation. In AAAI, 2011.
4. A. Coates and A. Y. Ng. Selecting receptive fields in deep networks. In NIPS, pages 2528-2536, 2011.
5. A. Coates, A. Y. Ng, and H. Lee. An analysis of single-layer networks in unsupervised feature learning. In International conference on artificial intelligence and statistics, pages 215-223, 2011.
6. C. Cortes and V. Vapnik. Support-vector networks. Machine learning, 20(3):273-297, 1995.
7. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the royal statistical society. Series B (methodological), pages 1-38, 1977.
8. C. Ding, T. Li, M. Jordan, et al. Convex and semi-nonnegative matrix factorizations. IEEE TPAMI, 32(1):45-55, 2010.
9. C. Doersch, A. Gupta, and A. A. Efros. Mid-level visual element discovery as discriminative mode seeking. In NIPS, pages 494-502, 2013.
10. C. Doersch, A. Gupta, and A. A. Efros. Unsupervised visual representation learning by context prediction. In ICCV, pages 1422-1430, 2015.
11. A. Dosovitskiy, J. T. Springenberg, M. Riedmiller, and T. Brox. Discriminative unsupervised feature learning with convolutional neural networks. In NIPS, pages 766-774, 2014.
12. Y. Gdalyahu, D. Weinshall, and M. Werman. Selforganization in vision: stochastic clustering for image segmentation, perceptual grouping, and image database organization. IEEE TPAMI, 23(10):1053-1074, 2001.
13. R. Girshick. Fast r-cnn. In ICCV, pages 1440-1448, 2015.
14. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, pages 580-587. IEEE, 2014.
15. I. J. Goodfellow, A. Courville, and Y. Bengio. Spikeand-slab sparse coding for unsupervised feature discovery. arXiv preprint arXiv:1201.3382, 2012.
16. K. C. Gowda and G. Krishna. Agglomerative clustering using the concept of mutual nearest neighbourhood. Pattern recognition, 10(2):105-112, 1978.
17. D. B. Graham and N. M. Allinson. Characterising virtual eigensignatures for general purpose face recognition. In Face Recognition, pages 446-456. Springer, 1998.
18. D. Han and J. Kim. Unsupervised simultaneous orthogonal basis clustering feature selection. In IEEE CVPR, pages 5016-5023, 2015.
19. B. Hariharan, J. Malik, and D. Ramanan. Discriminative decorrelation for clustering and classification. In ECCV, pages 459-472. Springer, 2012.
20. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, pages 346-361. Springer, 2014.
21. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507, 2006.
22. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical report, Technical Report 07-49, University of Massachusetts, Amherst, 2007.
23. H.-C. Huang, Y.-Y. Chuang, and C.-S. Chen. Affinity aggregation for spectral clustering. In CVPR, pages 773-780. IEEE, 2012.
24. A. K. Jain, M. N. Murty, and P. J. Flynn. Data clustering: a review. ACM computing surveys (CSUR), 31(3):264-323, 1999.
25. Y. Jia, C. Huang, and T. Darrell. Beyond spatial pyramids: Receptive field learning for pooled image features. In CVPR, pages 3370-3377. IEEE, 2012.
26. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the ACM International Conference on Multimedia, pages 675-678. ACM, 2014.
27. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images, 2009.
28. A. Krizhevsky and G. E. Hinton. Using very deep autoencoders for content-based image retrieval. In ESANN. Citeseer, 2011.
29. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012.
30. T. Kurita. An efficient agglomerative clustering algorithm using a heap. Pattern Recognition, 24(3):205-209, 1991.
31. Q. V. Le. Building high-level features using large scale unsupervised learning. In ICASSP, pages 8595-8598. IEEE, 2013.
32. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
33. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, pages 609-616. ACM, 2009.
34. T.-H. Lin and H. Kung. Stable and efficient representation learning with nonnegativity constraints. In ICML, pages 1323-1331, 2014.
35. D. G. Lowe. Object recognition from local scaleinvariant features. In ICCV, volume 2, pages 1150-1157. IEEE, 1999.
36. J. MacQueen et al. Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, volume 1, pages 281-297. Oakland, CA, USA., 1967.
37. G. McLachlan and D. Peel. Finite mixture models. John Wiley & Sons, 2004.
38. J. F. Navarro, C. S. Frenk, and S. D. White. A universal density profile from hierarchical clustering. The Astrophysical Journal, 490(2):493, 1997.
39. S. A. Nene, S. K. Nayar, H. Murase, et al. Columbia object image library (coil-20). Technical report, Technical Report CUCS-005-96, 1996.
40. A. Y. Ng, M. I. Jordan, Y. Weiss, et al. On spectral clustering: Analysis and an algorithm. NIPS, 2:849-856, 2002.
41. M. A. Ranzato, F. J. Huang, Y.-L. Boureau, and Y. Le-Cun. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In CVPR, pages 1-8. IEEE, 2007.
42. K. Rematas, B. Fernando, F. Dellaert, and T. Tuytelaars. Dataset fingerprints: Exploring image collections through data mining. In IEEE CVPR, pages 4867-4875, 2015.
43. S. Ren, K. He, R. Girshick, and J. Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In NIPS, pages 91-99, 2015.
44. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. IJCV, pages 1-42, 2014.
45. F. Schroff, D. Kalenichenko, and J. Philbin. Facenet: A unified embedding for face recognition and clustering. In CVPR, pages 815-823, 2015.
46. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312.6229, 2013.
47. J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE TPAMI, 22(8):888-905, 2000.
48. T. Sim, S. Baker, and M. Bsat. The cmu pose, illumination, and expression (pie) database. In FG, pages 46-51. IEEE, 2002.
49. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
50. S. Singh, A. Gupta, and A. Efros. Unsupervised discovery of mid-level discriminative patches. ECCV, pages 73-86, 2012.
51. F. Tian, B. Gao, Q. Cui, E. Chen, and T.-Y. Liu. Learning deep representations for graph clustering. In AAAI, pages 1293-1299, 2014.
52. G. Trigeorgis, K. Bousmalis, S. Zafeiriou, and B. Schuller. A deep semi-nmf model for learning hidden representations. In ICML, pages 1692-1700, 2014.
53. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, pages 1096-1103. ACM, 2008.
54. J. Wang, Y. Song, T. Leung, C. Rosenberg, J. Wang, J. Philbin, B. Chen, and Y. Wu. Learning fine-grained image similarity with deep ranking. In CVPR, pages 1386-1393. IEEE, 2014.
55. X. Wang and A. Gupta. Unsupervised learning of visual representations using videos. In ICCV, pages 2794-2802, 2015.
56. Z. Wang, S. Chang, J. Zhou, and T. S. Huang. Learning a task-specific deep architecture for clustering. In arXiv preprint arXiv:1509.00151, 2015.
57. L. Wolf, T. Hassner, and I. Maoz. Face recognition in unconstrained videos with matched background similarity. In CVPR, pages 529-534. IEEE, 2011.
58. P. Xie and E. Xing. Integrating image clustering and codebook learning. In AAAI, 2015.
59. W. Xu, X. Liu, and Y. Gong. Document clustering based on non-negative matrix factorization. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pages 267-273. ACM, 2003.
60. S. Zafeiriou and M. Petrou. Nonlinear nonnegative component analysis algorithms. IEEE TIP, 19(4):1050-1066, 2010.
61. L. Zelnik-Manor and P. Perona. Self-tuning spectral clustering. In NIPS, pages 1601-1608, 2004.
62. W. Zhang, X.Wang, D. Zhao, and X. Tang. Graph degree linkage: Agglomerative clustering on a directed graph. In ECCV, pages 428-441. Springer, 2012.
63. W. Zhang, D. Zhao, and X. Wang. Agglomerative clustering via maximum incremental path integral. Pattern Recognition, 46(11):3056-3065, 2013.
64. D. Zhao and X. Tang. Cyclizing clusters via zeta function of a graph. In NIPS, pages 1953-1960, 2009.