Image search-from thousands to billions in 20 years

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 9, Issue 1 SUPPL, 2013, Pages

  Zhang, Lei ^a   Rui, Yong ^a  

^a MICROSOFT RESEARCH ASIA   (China)

Author keywords

Big data; Content based; Global feature; Image feature; Image knowledge base; Image retrieval; Indexing; Local feature; Review; Visual representation; Web image search

Indexed keywords

BIG DATUM; CONTENT-BASED; GLOBAL FEATURE; IMAGE FEATURES; KNOWLEDGE BASE; LOCAL FEATURE; VISUAL REPRESENTATIONS; WEB IMAGE SEARCH;

DATA PROCESSING; FEATURE EXTRACTION; IMAGE RETRIEVAL; INDEXING (OF INFORMATION); KNOWLEDGE BASED SYSTEMS; RESEARCH; REVIEWS;

SEARCH ENGINES;

EID: 84886906128     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/2490823     Document Type: Conference Paper

References (100)

1. AHONEN, T.,HADID, A., AND PIETIKAINEN,M. 2004. Face recognition with local binary patterns. In Proceedings of the 8th European Conference on Computer Vision. 469-481.
2. AOA. 2006. Good vision throughout life. http://www.aoa.org/x9419.xml.
3. BAY, H., TUYTELAARS, T., AND VAN GOOL, L. 2006. Surf: Speeded up robust features. In Proceedings of the 9th European Conference on Computer Vision. 404-417. (Pubitemid 44029795)
4. BLASER, A. 1979. Database techniques for pictorial applications. In Database Techniques for Pictorial Applications, Lecture Notes in Computer Science, vol. 81, Springer, Berlin.
5. CAO, Y., WANG, C., LI, Z., ZHANG, L., AND ZHANG, L. 2010a. Spatial-bag-of-features. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 3352-3359.
6. CAO, Y.,WANG, C., ZHANG, L., AND ZHANG, L. 2011. Edgel index for large-scale sketch-based image search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 761-768.
7. CAO, Y., WANG, H., WANG, C., LI, Z., ZHANG, L., AND ZHANG, L. 2010b. Mindfinder: Interactive sketch-based image search on millions of images (demo). In Proceedings of the International Conference on Multimedia. ACM, 1605-1608.
8. CHANG, N. AND FU, K. 1980a. Query-by-pictorial-example. IEEE Trans. Softw. Eng. 6, 519-524.
9. CHANG, N. AND FU, K. 1980b. A relational database system for images. In Pictorial Information Systems, Lecture Notes in Computer Science, vol. 80, Springer, Berlin, 288-321.
10. CHANG, S. AND KUNIL, T. 1981. Pictorial data-base systems. Computer 14, 11, 13-21.
11. CHANG, S., YAN, C., DIMITROFF, D., AND ARNDT, T. 1988. An intelligent image database system. IEEE Trans. Softw. Eng. 14, 5, 681-688.
12. CHUM, O., PERDOCH, M., AND MATAS, J. 2009. Geometric min-hashing: Finding a (thick) needle in a haystack. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 17-24.
13. DALAL, N. AND TRIGGS, B. 2005. Histograms of oriented gradients for human detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Vol. 1, IEEE, 886-893. (Pubitemid 43897286)
14. DATAR, M., IMMORLICA, N., INDYK, P., AND MIRROKNI, V. 2004. Locality-sensitive hashing scheme based on p-stable distributions. In Proceedings of the 20th Annual Symposium on Computational Geometry. ACM, 253-262.
15. DATTA, R., JOSHI, D., LI, J., AND WANG, J. 2008. Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv. 40, 2, 5.
16. DENG, J., DONG, W., SOCHER, R., LI, L., LI, K., AND FEI-FEI, L. 2009. Imagenet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 248-255.
17. DONG, W., CHARIKAR, M., AND LI, K. 2008. Asymmetric distance estimation with sketches for similarity search in highdimensional spaces. In Proceedings of the 31st Annual ACM SIGIR Conference. ACM, 123-130.
18. FALOUTSOS, C. AND TAUBIN,G. 1993. The QBIC project: Querying images by content using color, texture, and shape. In Proceedings of the SPIE Conference on Storage and Retrieval for Image and Video Databases. Vol. 1908, 173-187. (Pubitemid 23687802)
19. FAN, X., XIE, X., LI, Z., LI, M., AND MA, W. 2005. Photo-to-search: Using multimodal queries to search the Web from mobile devices. In Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval. ACM, 143-150.
20. FISCHLER, M. AND BOLLES, R. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6, 381-395. (Pubitemid 12444102)
21. GIONIS, A., INDYK, P., ANDMOTWANI, R. 1999. Similarity search in high dimensions via hashing. In Proceedings of the International Conference on Very Large Data Bases. 518-529.
22. GORDO, A. AND PERRONNIN, F. 2011. Asymmetric distances for binary embeddings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 729-736.
23. HARRIS, C. AND STEPHENS, M. 1988. A combined corner and edge detector. In Proceedings of the Alvey Vision Conference. Vol. 15, 50.
24. HAYS, J. AND EFROS, A. 2007. Scene completion using millions of photographs. ACM Trans. Graph. 26.
25. HAYS, J. AND EFROS, A. 2008. IM2GPS: Estimating geographic information from a single image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1-8.
26. HE, J., CHANG, S., RADHAKRISHNAN, R., AND BAUER, C. 2011. Compact hashing with joint optimization of search accuracy and time. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 753-760.
27. HUA, G., BROWN, M., AND WINDER, S. 2007. Discriminant embedding for local image descriptors. In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1-8.
28. JAIN, R. 1993. NSF workshop on visual information management systems. SIGMOD Record 22, 3, 57-75.
29. JING, F.,WANG, C., YAO, Y., DENG, K., ZHANG, L., AND MA, W. 2006. Igroup: Web image search results clustering. In Proceedings of the 14th Annual ACM International Conference on Multimedia. ACM, 377-384. (Pubitemid 47113553)
30. JING, Y., ROWLEY, H., ROSENBERG, C., WANG, J., AND COVELL, M. 2009. Visualizing Web Images via Google image swirl. In Proceedings of the NIPS Workshop on Statistical Machine Learning for Visual Analytics.
31. JING, Y., ROWLEY, H.,WANG, J., TSAI, D., ROSENBERG, C., AND COVELL, M. 2012. Google image swirl: A large-scale content-based image visualization system. In Proceedings of the International World Wide Web Conference. ACM, 539-540.
32. KADIR, T., ZISSERMAN, A., AND BRADY, M. 2004. An affine invariant salient region detector. In Proceedings of the 8th European Conference on Computer Vision. 228-241.
33. KE, Y. AND SUKTHANKAR, R. 2004. PCA-sift: A more distinctive representation for local image descriptors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Vol. 2. IEEE, 506.
34. KOENDERINK, J. 1984. The structure of images. Biol. Cybernet. 50, 5, 363-370. (Pubitemid 14070727)
35. LE, Q.,MONGA, R., DEVIN, M., CORRADO, G., CHEN, K., RANZATO, M., DEAN, J., AND NG, A. 2012. Building high-level features using large scale unsupervised learning. In Proceedings of the 29th International Conference on Machine Learning.
36. LEW, M., SEBE, N., DJERABA, C., AND JAIN, R. 2006. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl. 2, 1, 1-19. (Pubitemid 43890693)
37. LI, B., XIAO, R., LI, Z., CAI, R., LU, B., AND ZHANG, L. 2011. Rank-sift: Learning to rank repeatable local interest points. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1737-1744.
38. LI, J. AND ALLINSON, N. 2008. A comprehensive review of current local features for computer vision. Neurocomputing 71, 10, 1771-1787.
39. LI, X., CHEN, L., ZHANG, L., LIN, F., AND MA, W. 2006. Image annotation by large-scale content-based image retrieval. In Proceedings of the 14th Annual ACM International Conference on Multimedia. ACM, 607-610. (Pubitemid 47113588)
40. LI, Z., XIE, X., ZHANG, L., AND MA, W.-Y. 2007. Searching one billion Web images by content: Challenges and opportunities. In Proceedings of the International Workshop Multimedia Content Analysis and Mining (MCAM). 33-36. (Pubitemid 350270543)
41. LINDEBERG, T. 1994. Scale-space theory: A basic tool for analyzing structures at different scales. J. Appl. Stat. 21, 1-2, 225-270.
42. LINDEBERG, T. 1998. Feature detection with automatic scale selection. Int. J. Comput. Vision 30, 2, 79-116. (Pubitemid 128517917)
43. LIU, C., YUEN, J., AND TORRALBA, A. 2011. Sift flow: Dense correspondence across scenes and its applications. IEEE Trans. Pattern Anal. Machine Intell. 33, 5, 978-994.
44. LIU, T.-Y. 2009. Learning to rank for information retrieval. Found. Trends Info. Retriev. 3, 3, 225-331.
45. LOWE, D. 1999. Object recognition from local scale-invariant features. In Proceedings of the IEEE International Conference on Computer Vision. Vol. 2, IEEE, 1150-1157. (Pubitemid 32079997)
46. MA, W. AND MANJUNATH, B. 1997. Netra: A toolbox for navigating large image databases. In Proceedings of the International Conference on Image Processing. Vol. 1, IEEE, 568-571.
47. MATAS, J., CHUM, O., URBAN, M., AND PAJDLA, T. 2004. Robust wide-baseline stereo from maximally stable extremal regions. Image Vision Comput. 22, 10, 761-767.
48. MIKOLAJCZYK, K. AND SCHMID, C. 2004. Scale & affine invariant interest point detectors. Int. J. Comput. Vision 60, 1, 63-86.
49. MIKOLAJCZYK, K. AND SCHMID, C. 2005. A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Machine Intell. 27, 10, 1615-1630. (Pubitemid 41555406)
50. MIKOLAJCZYK, K., TUYTELAARS, T., SCHMID, C., ZISSERMAN, A., MATAS, J., SCHAFFALITZKY, F., KADIR, T., AND GOOL, L. 2005. A comparison of affine region detectors. Int. J. Comput. Vision 65, 1, 43-72. (Pubitemid 43281159)
51. MILLER, G. 1995. Wordnet: A lexical database for english. Commun. ACM 38, 11, 39-41.
52. MORAVEC,H. 1981. Rover visual obstacle avoidance. In Proceedings of the International Joint Conference on Artificial Intelligence. 785-790.
53. NISTER, D. AND STEWENIUS, H. 2006. Scalable recognition with a vocabulary tree. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Vol. 2. IEEE, 2161-2168. (Pubitemid 44931581)
54. OLIVA, A. AND TORRALBA, A. 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vision 42, 3, 145-175. (Pubitemid 32680801)
55. OLSTON, C. AND NAJORK, M. 2010. Web crawling. Found. Trends Inf. Retriev. 4, 3, 175-246.
56. PENTLAND, A., PICARD, R., AND SCLAROFF, S. 1994. Photobook: Content-based manipulation of image databases. In Proceedings of the SPIE Conference on Storage and Retrieval for Image and Video Databases. Vol. 2185, SPIE.
57. PHILBIN, J., CHUM, O., ISARD, M., SIVIC, J., AND ZISSERMAN, A. 2007. Object retrieval with large vocabularies and fast spatial matching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1-8.
58. QUACK, T.,MONICH, U., THIELE, L., ANDMANJUNATH, B. 2004. Cortina: A system for large-scale, content-basedWeb image retrieval. In Proceedings of the 12th Annual ACM International Conference on Multimedia. ACM, 508-511. (Pubitemid 40211820)
59. ROBINSON, J. 1981. The KDB-tree: A search structure for large multidimensional dynamic indexes. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, 10-18.
60. ROSTEN, E. AND DRUMMOND, T. 2006. Machine learning for high-speed corner detection. In Proceedings of the 9th European Conference on Computer Vision. 430-443. (Pubitemid 44029797)
61. ROSTEN, E., PORTER, R., AND DRUMMOND, T. 2010. Faster and better: A machine learning approach to corner detection. IEEE Trans. Pattern Anal. Machine Intell. 32, 1, 105-119.
62. RUI, Y., HUANG, T., AND CHANG, S. 1999. Image retrieval: Current techniques, promising directions, and open issues. J. Visual Commun. image Represen. 10, 1, 39-62.
63. RUI, Y., HUANG, T., ORTEGA, M., AND MEHROTRA, S. 1998. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circuits Syst. Video Technol. 8, 5, 644-655. (Pubitemid 128743730)
64. SHI, S., ZHANG, H., YUAN, X., ANDWEN, J. 2010. Corpus-based semantic class mining: Distributional vs. pattern-based approaches. In Proceedings of the 23rd International Conference on Computational Linguistics. ACL, 993-1001.
65. SHRIVASTAVA, A.,MALISIEWICZ, T.,GUPTA, A., AND EFROS, A. 2011. Data-driven visual similarity for cross-domain image matching. ACM Trans. Graph. 30, 6.
66. SIVIC, J. AND ZISSERMAN, A. 2003. Video Google: A text retrieval approach to object matching in videos. In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1470-1477.
67. SMEULDERS, A., WORRING, M., SANTINI, S., GUPTA, A., AND JAIN, R. 2000. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Machine Intell. 22, 12, 1349-1380. (Pubitemid 32088465)
68. SMITH, J. AND CHANG, S. 1996. Searching for images and videos on the World-Wide Web. IEEE Multimedia Mag.
69. SMITH, J. AND CHANG, S. 1997. Visualseek: A fully automated content-based image query system. In Proceedings of the 4th ACM International Conference on Multimedia. ACM, 87-98.
70. SUN, Z., WANG, C., ZHANG, L., AND ZHANG, L. 2012. Query-adaptive shape topic mining for hand-drawn sketch recognition. In Proceedings of the 20th ACM International Conference on Multimedia. ACM.
71. TORRALBA, A., FERGUS, R., AND FREEMAN, W. 2008a. 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Machine Intell. 30, 11, 1958-1970.
72. TORRALBA, A., FERGUS, R., AND WEISS, Y. 2008b. Small codes and large image databases for recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1-8.
73. TORRALBA, A.,MURPHY, K., FREEMAN, W., AND RUBIN, M. 2003. Context-based vision system for place and object recognition. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 273-280.
74. TRAPPENBERG, T. P. 2010. Fundamentals of Computational Neuroscience. Oxford University Press.
75. TSAI, D., JING, Y., LIU, Y., ROWLEY, H., IOFFE, S., AND REHG, J. 2011. Large-scale image annotation using visual synset. In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 611-618.
76. TUYTELAARS, T. AND MIKOLAJCZYK, K. 2008. Local invariant feature detectors: A survey. Found. Trends Comput. Graphics Vision 3, 3, 177-280.
77. TUYTELAARS, T. AND VAN GOOL, L. 2004. Matching widely separated views based on affine invariant regions. Int. J. Comput. Vision 59, 1, 61-85.
78. VON AHN, L. AND DABBISH, L. 2004. Labeling images with a computer game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 319-326.
79. VON AHN, L., LIU, R., AND BLUM, M. 2006. Peekaboom: A game for locating objects in images. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 55-64. (Pubitemid 44032086)
80. WANG, B., LI, Z., LI, M., AND MA, W. 2006a. Large-scale duplicate detection for Web image search. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 353-356. (Pubitemid 46679727)
81. WANG, J. AND HUA, X. 2011. Interactive image search by color map. ACM Trans. Intell. Syst. Technol. 3, 1.
82. WANG, J., KUMAR, S., AND CHANG, S. 2010a. Semi-supervised hashing for large scale search. IEEE Trans. Pattern Anal. Machine Intell. 6, 1, 1.
83. WANG, J., LI, J., AND WIEDERHOLD, G. 2001. Simplicity: Semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Machine Intell. 23, 9, 947-963. (Pubitemid 32981615)
84. WANG, X., ZHANG, L., JING, F., AND MA, W. 2006b. Annosearch: Image auto-annotation by search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Vol. 2, IEEE, 1483-1490. (Pubitemid 44931495)
85. WANG, X., ZHANG, L., LIU, M., LI, Y., AND MA, W. 2010b. Arista-image search to annotation on billions of Web photos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2987-2994.
86. WANG, X.-J., XU, Z., ZHANG, L., LIU, C., AND RUI, Y. 2012. Towards indexing representative images on the web. In Proceedings of the 20th ACM International Conference on Multimedia. ACM.
87. WEBER, R., SCHEK, H., AND BLOTT, S. 1998. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In Proceedings of the International Conference on Very Large Data Bases. 194-205.
88. WEISS, Y., TORRALBA, A., AND FERGUS, R. 2008. Spectral hashing. In Proceedings of the Conference on Neural Information Processing Systems.
89. WEN, J.-R. 2009. Encyclopedia of Data Warehousing and Mining 2nd Ed. IGI Global, Chapter Enhancing Web Search through Query Log Mining, 758-763.
90. WITKIN, A. 1983. Scale-space filtering. In Proceedings of the 8th International Joint Conference on Artificial Intelligence. Vol. 2, Morgan Kaufmann Publishers Inc., 1019-1022.
91. WU, Z.,KE, Q., ISARD, M., AND SUN, J. 2009. Bundling features for large scale partial-duplicate Web image search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 25-32.
92. ZHA, Z., YANG, L.,MEI, T.,WANG, M., AND WANG, Z. 2009. Visual query suggestion. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, 15-24.
93. ZHANG, S.,HUANG, Q.,HUA, G., JIANG, S., GAO, W., AND TIAN, Q. 2010. Building contextual visual vocabulary for large-scale image applications. In Proceedings of the International Conference on Multimedia. ACM, 501-510.
94. ZHANG, S., TIAN, Q., HUA, G., HUANG, Q., AND LI, S. 2009a. Descriptive visual words and visual phrases for image applications. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, 75-84.
95. ZHANG, X., LI, Z., ZHANG, L.,MA, W., AND SHUM, H. 2009b. Efficient indexing for large scale visual search. In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1103-1110.
96. ZHANG, X., ZHANG, L., AND SHUM, H. 2012a. Qsrank: Query-sensitive hash code ranking for efficient-neighbor search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2058-2065.
97. ZHANG, X., ZHANG, L.,WANG, X.-J., AND SHUM, H.-Y. 2012b. Finding celebrities in billions of Web images. IEEE Trans. Multimedia 14, 4, 995-1007.
98. ZHANG, Y., JIA, Z., AND CHEN, T. 2011. Image retrieval with geometry-preserving visual phrases. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 809-816.
99. ZHENG, Y., ZHAO, M., SONG, Y., ADAM, H., BUDDEMEIER, U., BISSACCO, A., BRUCHER, F., CHUA, T., AND NEVEN, H. 2009. Tour the world: Building a Web-scale landmark recognition engine. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1085-1092.
100. ZHOU, X. AND HUANG, T. 2003. Relevance feedback in image retrieval: A comprehensive review. Multimedia Syst. 8, 6, 536-544.