Nonparametric label propagation using mutual local similarity in nearest neighbors

Computer Vision and Image Understanding

Volumn 131, Issue , 2015, Pages 116-127

  Giordano, D ^a   Kavasidis, I ^a   Palazzo, S ^a   Spampinato, C ^a  

^a UNIVERSITY OF CATANIA   (Italy)

Author keywords

Big data; Data driven approaches; Nearest neighbor; Object classification

Indexed keywords

COMPUTER VISION; VISION;

ANNOTATED DATASETS; DATA-DRIVEN APPROACH; LARGE-SCALE DATASETS; MODEL BASED APPROACH; NEAREST NEIGHBOR SEARCH; NEAREST-NEIGHBORS; NONPARAMETRIC APPROACHES; OBJECT CLASSIFICATION;

BIG DATA;

EID: 84918835799     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2014.06.005     Document Type: Article

References (69)

1. J. Zhang, M. Marszalek, S. Lazebnik, C. Schmid, Local features and kernels for classification of texture and object categories: a comprehensive study, in: Computer Vision and Pattern Recognition, 2006.
2. A. Torralba, R. Fergus, and W.T. Freeman 80 million tiny images: a large data set for nonparametric object and scene recognition IEEE Trans. Patt. Anal. Mach. Intell. 30 11 2008 1958 1970
3. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, L. Fei-Fei, ImageNet: a large-scale hierarchical image database, in: Computer Vision and Pattern Recognition, 2009.
4. J.B. MacQueen Some methods for classification and analysis of multivariate observations Symposium on Mathematical Statistics and Probability vol. 1 1967 University of California Press California, USA 281 297 < http://www.projecteuclid.org/DPubS/Repository/1.0/Disseminate?view=body&id=pdf-1&handle=euclid.bsmsp/1200512992 >
5. K. Beyer, J. Goldstein, R. Ramakrishnan, U. Shaft, When is nearest neighbor meaningful?, in: International Conference on Database Theory, 1999, pp. 217-235.
6. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), vol. 1, 2005, pp. 886-893, doi: http://dx.doi.org/10.1109/CVPR.2005.177 < http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=1467360 >.
7. O. Boiman, E. Shechtman, M. Irani, In defense of nearest-neighbor based image classification, in: 2008 IEEE Conference on Computer Vision and Pattern Recognition, doi: http://dx.doi.org/10.1109/CVPR.2008.4587598.
8. R. Timofte, L. Van Gool, Iterative nearest neighbors for classification and dimensionality reduction, 2012, doi: http://dx.doi.org/10.1109/CVPR.2012.6247960.
9. D. Nister, H. Stewenius, Scalable recognition with a vocabulary tree, in: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), vol. 2, doi: http://dx.doi.org/10.1109/CVPR.2006.264.
10. D. Lowe Distinctive image features from scale invariant keypoints Int. J. Comput. Vision 60 2 2004 91 110 < http://papers2://publication/uuid/8D0FBC3D-56C1-403C-80DA-DABB642ED746 >
11. V. Lepetit, and P. Fua Keypoint recognition using randomized trees IEEE Trans. Patt. Anal. Mach. Intell. 28 9 2006 1465 1479 10.1109/TPAMI.2006.188
12. B. Matei, Y. Shan, H.S. Sawhney, Y. Tan, R. Kumar, D. Huber, and M. Hebert Rapid object indexing using locality sensitive hashing and joint 3D-signature space estimation IEEE Trans. Patt. Anal. Mach. Intell. 28 7 2006 1111 1126 10.1109/TPAMI.2006.148
13. J. Philbin, O. Chum, M. Isard, J. Sivic, A. Zisserman, Object retrieval with large vocabularies and fast spatial matching, in: 2007 IEEE Conference on Computer Vision and Pattern Recognition, doi: http://dx.doi.org/10.1109/CVPR.2007.383172.
14. J. Philbin, O. Chum, M. Isard, J. Sivic, A. Zisserman, Lost in quantization: improving particular object retrieval in large scale image databases, in: 2008 IEEE Conference on Computer Vision and Pattern Recognition, doi: http://dx.doi.org/10.1109/CVPR.2008.4587635.
15. X. Shen, Z. Lin, J. Brandt, S. Avidan, Y. Wu, Object retrieval and localization with spatially-constrained similarity measure and k-NN re-ranking, 2012, doi: http://dx.doi.org/10.1109/CVPR.2012.6248031.
16. H. Jégou, M. Douze, and C. Schmid Hamming embedding and weak geometric consistency for large scale image search Comp. Vis. - ECCV 2008 2008 304 317 doi: http://dx.doi.org/10.1007/978-3-540-88682-2-24 < http://www.springerlink.com/index/t851847815202368.pdf >
17. A. Bosch, A. Zisserman, and X. Munoz Scene classification via pLSA Computer Vision ECCV 2006 2006 Springer 517 530
18. S. Gould, and Y. Zhang Patchmatchgraph: building a graph of dense patch correspondences for label transfer Comp. Vis. - ECCV 2012 2012 439 452
19. J.X.J. Xiao, J. Hays, K. Ehinger, A. Oliva, A. Torralba, SUN database: large-scale scene recognition from abbey to zoo, in: Computer Vision and Pattern Recognition, 2010, doi: http://dx.doi.org/10.1109/CVPR.2010.5539970.
20. X. Cai, H. Wang, H. Huang, and C. Ding Simultaneous image classification and annotation via biased random walk on tri-relational graph Computer Vision - ECCV 2012 2012 Springer 823 836
21. J. Wang, J. Wang, G. Zeng, Z. Tu, R. Gan, S. Li, Scalable k-NN graph construction for visual descriptors, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 1106-1113, doi:10.1109/CVPR.2012.6247790 < http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6247790 >.
22. T. Cover Estimation by the nearest neighbor rule IEEE Trans. Inform. Theory 14 1 1968 50 55 10.1109/TIT.1968.1054098
23. J.H. Freidman, J.L. Bentley, R.A. Finkel, An algorithm for finding best matches in logarithmic expected time, 1977, doi: http://dx.doi.org/10.1145/355744.355745.
24. R. Weber, H.J. Schek, S. Blott, A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces, in: Proceedings of the 24th VLDB Conference New York C, 1998, pp. 194-205 < http://reference.kfupm.edu.sa/content/q/u/a-quantitative-analysis-and-performance-16456.pdf >.
25. S. Arya, D.M. Mount, N.S. Netanyahu, R. Silverman, A.Y. Wu, An optimal algorithm for approximate nearest neighbor searching fixed dimensions, 1998, doi: http://dx.doi.org/10.1145/293347.293348.
26. S. Arya, D. Mount, Algorithms for fast vector quantization, in: Proceedings of DCC '93: Data Compression Conference, doi: http://dx.doi.org/10.1109/DCC.1993.253111.
27. S. Berchtold, D. Keim, H. Kriegel, The X-tree: an index structure for high-dimensional data, in: Proceedings of the 22nd VLDB Conference, 1996, pp. 28-39, doi: http://dx.doi.org/10.1007/BF01231606 .
28. P. Ciaccia, M. Patella, and P. Zezula M-tree: an efficient access method for similarity search in metric spaces Proceedings of the 23rd International Conference on Very Large Data Bases 1997 Morgan Kaufmann 426 435 http://dl.acm.org/citation.cfm?id=645923.671005
29. N. Katayama, S. Satoh, The SR-tree: an index structure for high-dimensional nearest neighbor queries, in: International Conference on Management of Data, vol. 26(2), 1997, p. 369, doi: http://dx.doi.org/10.1145/253260.253347 < http://portal.acm.org/citation.cfm?id=253260.253347 >.
30. K.-I. Lin, H.V. Jagadish, C. Faloutsos, The TV-tree: an index structure for high-dimensional data, 1994, doi: http://dx.doi.org/10.1007/BF01231606.
31. C. Silpa-Anan, R. Hartley, Optimised KD-trees for fast image descriptor matching, in: 2008 IEEE Conference on Computer Vision and Pattern Recognition, doi: http://dx.doi.org/10.1109/CVPR.2008.4587638.
32. J. McNames, A fast nearest-neighbor algorithm based on a principal axis search tree, IEEE Trans. Patt. Anal. Mach. Intell. 23 (9), doi: http://dx.doi.org/10.1109/34.955110.
33. Y.J.Y. Jia, J.W.J. Wang, G.Z.G. Zeng, H.Z.H. Zha, X.-S.H.X.-S. Hua, Optimizing kd-trees for scalable visual descriptor indexing, in: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), doi: http://dx.doi.org/10.1109/CVPR.2010.5540006.
34. P. Ghosh, B.S. Manjunath, K.R. Ramakrishnan, A compact image signature for RTS-invariant image retrieval.
35. R. Salakhutdinov, G. Hinton, Semantic hashing, 2009, doi: http://dx.doi.org/10.1016/j.ijar.2008.11.006.
36. K. He, F. Wen, J. Sun, K-means hashing: an affinity-preserving quantization method for learning binary compact codes, in: 2013 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2013, pp. 2938-2945.
37. A. Torralba, R. Fergus, Y. Weiss, Small codes and large image databases for recognition, in: Conference on Computer Vision and Pattern Recognition, 2008, doi: http://dx.doi.org/10.1109/CVPR.2008.4587633.
38. C. Strecha, A. Bronstein, M. Bronstein, and P. Fua LDAHash: improved matching with smaller descriptors IEEE Trans. Patt. Anal. Mach. Intell. 34 1 2012 66 78 10.1109/TPAMI.2011.103
39. M. Norouzi, A. Punjani, D. Fleet, Fast search in hamming space with multi-index hashing, in: IEEE Computer Vision and Pattern Recognition (CVPR), 2012, pp. 3108-3115, arXiv:1307.2982, doi: http://dx.doi.org/10.1109/CVPR.2012.6248043.
40. H. Jégou, M. Douze, and C. Schmid Product quantization for nearest neighbor search IEEE Trans. Patt. Anal. Mach. Intell. 33 1 2011 117 128 10.1109/TPAMI.2010.57
41. Y. Avrithis, Quantize and Conquer: a dimensionality-recursive solution to clustering, vector quantization, and image retrieval.
42. H.-K. Ahn, Y. Hwang, and B. Han A fast nearest neighbor search algorithm by nonlinear embedding IEEE Conf. Comp. Vis. Patt. Recog. 2012 3053 3060 doi: http://dx.doi.org/10.1109/CVPR.2012.6248036 < http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6248036 >
43. M. Guillaumin, T. Mensink, J. Verbeek, C. Schmid, TagProp: discriminative metric learning in nearest neighbor models for image auto-annotation, in: IEEE 12th International Conference on Computer Vision, 2009.
44. F.K.F. Kang, R.J.R. Jin, R. Sukthankar, Correlated label propagation with application to multi-label learning, in: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), vol. 2, doi: http://dx.doi.org/10.1109/CVPR.2006.90.
45. T.M.T. Mei, Y.W.Y. Wang, X.-S.H.X.-S. Hua, S.G.S. Gong, S.L.S. Li, Coherent image annotation by learning semantic distance, in: 2008 IEEE Conference on Computer Vision and Pattern Recognition, doi: http://dx.doi.org/10.1109/CVPR.2008.4587386.
46. A. Makadia, V. Pavlovic, S. Kumar, A new baseline for image annotation, in: Proceedings of ECCV, 2008, pp. 316-329, doi: http://dx.doi.org/10.1007/978-3-540-88690-7 < http://www.cs.rutgers.edu/vladimir/pub/makadia08eccv.pdf >.
47. Z. Feng, R. Jin, A. Jain, Large-scale image annotation by efficient and robust kernel metric learning, in: Proceedings of International Conference on Computer Vision (ICCV), 2013.
48. M. Guillaumin, J. Verbeek, C. Schmid, Is that you? Metric learning approaches for face identification, in: IEEE 12th International Conference on Computer Vision, 2009.
49. T. Hertz, A. Bar-Hillel, D. Weinshall, Learning distance functions for image retrieval, in: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, 2004.
50. R.J.R. Jin, S.W.S. Wang, Z.-H.Z.Z.-H. Zhou, Learning a distance metric from multi-instance multi-label data, in: 2009 IEEE Conference on Computer Vision and Pattern Recognition, doi: http://dx.doi.org/10.1109/CVPR.2009.5206684.
51. Y. Verma, and C.V. Jawahar Image annotation using metric learning in semantic neighbourhoods Computer Vision - ECCV 2012 2012 Springer 836 849
52. J. Liu, M. Li, Q. Liu, H. Lu, S. Ma, Image annotation via graph learning 42(2) (2009) 218-228, doi: http://dx.doi.org/10.1016/j.patcog.2008.04.012.
53. J. McAuley, and J. Leskovec Image labeling on a network: using social-network metadata for image classification A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, C. Schmid, Computer Vision - ECCV 2012, Lecture Notes in Computer Science vol. 7575 2012 Springer 828 841 < http://arxiv.org/abs/arXiv:1207.3809v1 >, doi: http://dx.doi.org/10.1007/978-3-642-33765-9
54. M. Rubinstein, C. Liu, and W.T. Freeman Annotation propagation in large image databases via dense image correspondence A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, C. Schmid, Computer Vision - ECCV 2012, Lecture Notes in Computer Science vol. 7574 2012 Springer 85 99 doi: http://dx.doi.org/10.1007/978-3-642-33712-3-7
55. H. Fu, Q. Zhang, and G. Qiu Random forest for image annotation Computer Vision - ECCV 2012 2012 Springer 86 99
56. J.L.J. Li, J. Wang, Automatic Linguistic Indexing of Pictures by a statistical modeling approach, IEEE Trans. Patt. Anal. Mach. Intell. 25 (9), doi: http://dx.doi.org/10.1109/TPAMI.2003.1227984.
57. C.Y.C. Yang, M.D.M. Dong, J.H.J. Hua, Region-based image annotation using asymmetrical support vector machine-based multiple-instance learning, in: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), vol. 2, doi: http://dx.doi.org/10.1109/CVPR.2006.250.
58. S. Feng, R. Manmatha, V. Lavrenko, Multiple Bernoulli relevance models for image and video annotation, in: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004, CVPR 2004, vol. 2.
59. J. Jeon, V. Lavrenko, R. Manmatha, Automatic image annotation and retrieval using cross-media relevance models, in: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '03), 2003, pp. 119-126, doi: http://dx.doi.org/10.1145/860435.860459 < http://dl.acm.org/citation.cfm?id=860435.860459 >.
60. V. Lavrenko, R. Manmatha, J. Jeon, A model for learning the semantics of pictures, in: 16th Conference on Advances in Neural Information Processing Systems (NIPS), 2003, pp. 553-560 < http://books.nips.cc/papers/files/nips16/NIPS2003-AA70.pdf >.
61. K. Barnard, D. Forsyth, M.I. Jordan, P. Duygulu, N. de Freitas, and D.M. Blei Matching words and pictures J. Mach. Learn. Res. 3 2003 1107 1135 10.1162/153244303322533214
62. Y. Dong, and S. Xu A new directional weighted median filter for removal of random-valued impulse noise IEEE Sig. Process. Lett. 14 3 2007 193 196 10.1109/LSP.2006.884014
63. V. Lavrenko, R. Manmatha, and J. Jeon A Model for Learning the Semantics of Pictures NIPS 2003 MIT Press
64. D. Metzler, and R. Manmatha An inference network approach to image retrieval Proceedings of the International Conference on Image and Video Retrieval 2004 Springer 42 50
65. G. Carneiro, A. Chan, P. Moreno, and N. Vasconcelos Supervised learning of semantic classes for image annotation and retrieval IEEE Trans. Patt. Anal. Mach. Intell. 29 3 2007 394 410 10.1109/TPAMI.2007.61
66. A. Torralba, R. Fergus, Y. Weiss, Small codes and large image databases for recognition, in: Computer Vision and Pattern Recognition, 2008, doi: http://dx.doi.org/10.1109/CVPR.2008.4587633.
67. A. Andoni, P. Indyk, Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions, in: Symposium on Foundations of Computer Science, 2006, doi: http://dx.doi.org/10.1109/FOCS.2006.49.
68. Y. Weiss, R. Fergus, and A. Torralba Multidimensional spectral hashing European Conference on Computer Vision, LNCS vol. 7576 2012 Springer Berlin/Heidelberg 340 353 http://dx.doi.org/10.1007/978-3-642-33715-4-25
69. P.X. Huang, B.J. Boom, and R.B. Fisher Underwater live fish recognition using a balance-guaranteed optimized tree Proceedings of the 11th Asian Conference on Computer Vision - Volume Part I, ACCV'12 2013 Springer-Verlag Berlin, Heidelberg 422 433