Residual enhanced visual vector as a compact signature for mobile visual search

Signal Processing

Volumn 93, Issue 8, 2013, Pages 2316-2327

  Chen, David ^a   Tsai, Sam ^a   Chandrasekhar, Vijay ^a   Takacs, Gabriel ^b   Vedantham, Ramakrishna ^b   Grzeszczuk, Radek ^b   Girod, Bernd ^a  

^a Stanford University   (United States)

^b NOKIA RESEARCH CENTER   (United States)

Author keywords

Compact signatures; Database compression; Mobile visual search

Indexed keywords

COMPACT SIGNATURES; DATABASE COMPRESSION; DATABASE CONSTRUCTION; EXTERNAL NETWORK; LANDMARK RECOGNITION; MOBILE AUGMENTED REALITY; MOBILE VISUAL SEARCHES; RETRIEVAL ACCURACY;

AUGMENTED REALITY; DATABASE SYSTEMS; IMAGE RETRIEVAL; MOBILE DEVICES; QUERY PROCESSING; RANDOM ACCESS STORAGE; TREES (MATHEMATICS);

SEARCH ENGINES;

EID: 84876295786     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2012.06.005     Document Type: Article

References (53)

1. G. Takacs, V. Chandrasekhar, N. Gelfand, Y. Xiong, W.-C. Chen, T. Bismpigiannis, R. Grzeszczuk, K. Pulli, B. Girod, Outdoors augmented reality on mobile phone using loxel-based visual feature organization, in: ACM Multimedia Information Retrieval, 2008.
2. R. Ji, L.-Y. Duan, J. Chen, H. Yao, Y. Rui, and W. Gao Location discriminative vocabulary coding for mobile landmark search International Journal of Computer Vision 96 2012 290 314
3. G. Schroth, R. Huitl, D. Chen, M. Abu-Alqumsan, A. Al-Nuaimi, and E. Steinbach Mobile visual location recognition IEEE Signal Processing Magazine 28 2011 77 89
4. S.S. Tsai, D. Chen, V. Chandrasekhar, G. Takacs, N.-M. Cheung, R. Vedantham, R. Grzeszczuk, B. Girod, Mobile product recognition, in: ACM International Conference on Multimedia, 2010.
5. Google, Google Goggles, 2011. 〈 http://www.google.com/mobile/goggles 〉.
6. PlinkArt, PlinkArt, 2010. 〈 http://www.androidtapp.com/plinkart 〉.
7. S.S. Tsai, H. Chen, D. Chen, G. Schroth, R. Grzeszczuk, B. Girod, Mobile visual search on printed documents using text and low bit-rate features, in: IEEE International Conference on Image Processing, 2011.
8. P. Belhumeur, D. Chen, S. Feiner, D. Jacobs, W. Kress, H. Ling, I. Lopez, R. Ramamoorthi, S. Sheorey, S. White, L. Zhang, Searching the world's herbaria: a system for visual identification of plant species, in: European Conference on Computer Vision, 2008.
9. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2004 91 110
10. H. Bay, A. Ess, T. Tuytelaars, and L.V. Gool Speeded-up robust features (SURF) Computer Vision and Image Understanding 110 2008 346 359
11. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1615 1630
12. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, Y. Reznik, R. Grzeszczuk, and B. Girod Compressed histogram of gradients: a low bitrate descriptor International Journal of Computer Vision 96 2012 384 399
13. G. Takacs, V.R. Chandrasekhar, S.S. Tsai, D.M. Chen, R. Grzeszczuk, B. Girod, Unified real-time tracking and recognition with rotation-invariant fast features, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010.
14. J. Sivic, A. Zisserman, Video Google: a text retrieval approach to object matching in videos, in: IEEE International Conference on Computer Vision, 2003.
15. D. Nister, H. Stewenius, Scalable recognition with a vocabulary tree, in: IEEE Conference on Computer Vision and Pattern Recognition, 2006.
16. G. Schindler, M. Brown, R. Szeliski, City-scale location recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
17. J. Philbin, O. Chum, M. Isard, J. Sivic, A. Zisserman, Lost in quantization: improving particular object retrieval in large scale image databases, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008.
18. H. Jégou, M. Douze, and C. Schmid Improving bag-of-features for large scale image search International Journal of Computer Vision 87 2010 316 336
19. C. Yeo, P. Ahammad, K. Ramchandran, Rate-efficient visual correspondences using random projections, in: IEEE International Conference on Image Processing, 2008.
20. A. Torralba, R. Fergus, Y. Weiss, Small codes and large image databases for recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008.
21. Y. Weiss, A. Torralba, R. Fergus, Spectral hashing, in: Neural Information Processing Systems, 2008.
22. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, J. Singh, B. Girod, Transform coding of image feature descriptors, in: SPIE Conference on Visual Communications and Image Processing, 2009.
23. D. Chen, S. Tsai, V. Chandrasekhar, G. Takacs, J.P. Singh, B. Girod, Tree histogram coding for mobile image matching, in: IEEE Data Compression Conference, 2009.
24. R. Ji, L.-Y. Duan, J. Chen, H. Yao, Y. Rui, S.-F. Chang, W. Gao, Towards low bit rate mobile visual search with multiple-channel coding, in: ACM International Conference on Multimedia, 2011.
25. H. Jégou, M. Douze, and C. Schmid Product quantization for nearest neighbor search IEEE Transactions on Pattern Analysis and Machine Intelligence 33 2011 117 128
26. M. Calonder, V. Lepetit, C. Strecha, P. Fua, BRIEF: binary robust independent elementary features computer vision, in: European Conference on Computer Vision, 2010.
27. S.S. Tsai, D.M. Chen, G. Takacs, V. Chandrasekhar, J.P. Singh, B. Girod, Location coding for mobile image retrieval, in: International ICST Mobile Multimedia Communications Conference, 2009.
28. Y. Reznik, G. Cordara, M. Bober, Evaluation framework for Compact Descriptors for Visual Search, in: ISO/IEC JTCI/SC29/WG11 N12202.
29. D. Chen, S. Tsai, V. Chandrasekhar, G. Takacs, R. Vedantham, R. Grzeszczuk, B. Girod, Inverted index compression for scalable image matching, in: IEEE Data Compression Conference, 2010.
30. H. Jégou, M. Douze, C. Schmid, P. Pérez, Aggregating local descriptors into a compact image representation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010.
31. F. Perronnin, Y. Liu, J. Sánchez, H. Poirier, Large-scale image retrieval with compressed fisher vectors, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010.
32. M. Brown, G. Hua, and S. Winder Discriminative learning of local image descriptors IEEE Transactions on Pattern Analysis and Machine Intelligence 33 2011 43 57
33. T. Fawcett An introduction to ROC analysis Pattern Recognition Letters 27 2006 861 874
34. J. Swets, Signal Detection Theory and ROC Analysis in Psychology and Diagnostics, Lawrence Erlbaum Associates, Mahwah, NJ, USA, 1996.
35. J. Philbin, A. Zisserman, Oxford Building Data Set, 2007.
36. H. Stewenius, D. Nister, University of Kentucky Benchmark Data Set, 2006.
37. H. Shao, T. Svoboda, L.V. Gool, ZuBuD - Zurich Buildings Data Set, 2003.
38. D. Chen, S. Tsai, B. Girod, Stanford Media Cover Data Set, 2009.
39. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan A multimedia retrieval framework based on semi-supervised ranking and relevance feedback IEEE Transactions on Pattern Analysis and Machine Intelligence 34 2012 723 742
40. H. Wang, S. Yan, D. Xu, X. Tang, T. Huang, Trace ratio versus ratio trace for dimensionality reduction, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
41. M. Wang, X.-S. Hua, R. Hong, J. Tang, G.-J. Qi, and Y. Song Unified video annotation via multigraph learning IEEE Transactions on Circuits and Systems for Video Technology 19 2009 733 746
42. J. Song, Y. Yang, Z. Huang, H.T. Shen, R. Hong, Multiple feature hashing for real-time large scale near-duplicate video retrieval, in: ACM International Conference on Multimedia, 2011.
43. S.S. Tsai, D. Chen, H. Chen, C.-H. Hsu, K.-H. Kim, J. P. Singh, B. Girod, Combining image and text features: a hybrid approach to mobile book spine recognition, in: ACM International Conference on Multimedia, 2011.
44. D. Chen, G. Baatz, K. Koser, S. Tsai, R. Vedantham, T. Pylvanainen, K. Roimela, X. Chen, J. Bach, M. Pollefeys, B. Girod, R. Grzeszczuk, City-scale landmark identification on mobile devices, in: IEEE Conference on Computer Vision and Pattern Recognition, 2011.
45. D. Chen, V. Chandrasekhar, G. Takacs, S. Tsai, M. Makar, R. Vedantham, R. Grzeszczuk, B. Girod, Compact Descriptors for Visual Search: improvements to the test model under consideration with a global descriptor, in: ISO/IEC JTCI/SC29/WG11 M23578.
46. G. Takacs, V. Chandrasekhar, D. Chen, S. Tsai, R. Vedantham, R. Grzeszczuk, B. Girod, Compact Descriptors for Visual Search: Stanford Nokia integrated fast features, in: ISO/IEC JTCI/SC29/WG11 M22553.
47. A. Oliva, and A. Torralba Modeling the shape of the scene: a holistic representation of the spatial envelope International Journal of Computer Vision 42 2001 145 175
48. M. Douze, H. Jégou, H. Sandhawalia, L. Amsaleg, C. Schmid, Evaluation of GIST descriptors for web-scale image search, in: International Conference on Image and Video Retrieval, 2009.
49. D. Chen, N.-M. Cheung, S. Tsai, V. Chandrasekhar, G. Takacs, R. Vedantham, R. Grzeszczuk, B. Girod, Dynamic selection of a feature-rich query frame for mobile video retrieval, in: IEEE International Conference on Image Processing, 2010.
50. V. Chandrasekhar, D. Chen, S. Tsai, N.-M. Cheung, H. Chen, G. Takacs, Y. Reznik, R. Vedantham, R. Grzeszczuk, J. Bach, B. Girod, The Stanford mobile visual search data set, in: ACM Conference on Multimedia Systems, 2011.
51. M. Persin, Document filtering for fast ranking, in: ACM SIGIR Conference on Research and Development in Information Retrieval, 1994.
52. V.N. Anh, O. de Kretser, A. Moffat, Vector-space ranking with effective early termination, in: ACM SIGIR Conference on Research and Development in Information Retrieval, 2001.
53. D. Chen, S. Tsai, R. Vedantham, R. Grzeszczuk, B. Girod, Streaming mobile augmented reality on mobile phones, in: International Symposium on Mixed and Augmented Reality, 2009.