JIGSAW: Interactive mobile visual search with multimodal queries

MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops

Volumn , Issue , 2011, Pages 73-82

  Wang, Yang ^a   Mei, Tao ^b   Wang, Jingdong ^b   Li, Houqiang ^a   Li, Shipeng ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

Mobile visual search; Query formulation; User interface

Indexed keywords

COMPOSITE IMAGES; ENTITY EXTRACTIONS; IMAGE QUERY; JIGSAW PUZZLES; MOBILE USERS; MOBILE-PHONE USERS; MULTI-MODAL; MULTI-MODAL QUERIES; MULTI-TOUCH; ON THE GO; PHONE SYSTEMS; QUERY FORMULATION; QUERY IMAGES; SEARCH PERFORMANCE; SIMILAR IMAGE; SMART PHONES; USER INTERACTION; VISUAL QUERY; VISUAL SEARCH;

CELLULAR TELEPHONE SYSTEMS; CHARACTER RECOGNITION; GLOBAL SYSTEM FOR MOBILE COMMUNICATIONS; SPEECH RECOGNITION; TELEPHONE SETS; USER INTERFACES;

SEARCH ENGINES;

EID: 84455161814     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2072298.2072310     Document Type: Conference Paper

References (32)

1. http://www.pwc.com/gx/en/communications/review/features/mobile-data. jhtml.
2. H. Bay, T. Tuytelaars, and L. Van Gool. SURF: speeded-up robust features. In Proc. of ECCV, pages 346-359, 2008.
3. Y. Cao, H. Wang, C. Wang, Z. Li, L. Zhang, and L. Zhang. MindFinder: interactive sketch-based image search on millions of images. In Proc. of ACM International Conference on Multimedia, pages 1605-1608, 2010.
4. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, R. Grzeszczuk, and B. Girod. CHoG: Compressed histogram of gradients-a low bit-rate feature descriptor. Proc. of IEEE International Conference on Computer Vision and Pattern Recognition, pages 2504-2511, 2009.
5. V. R. Chandrasekhar, S. S. Tsai, G. Takacs, D. M. Chen, N. M. Cheung, Y. Reznik, R. Vedantham, R. Grzeszczuk, and B. Girod. Low latency image retrieval with progressive transmission of CHoG descriptors. In Proc. of ACM Multimedia Workshop on Mobile Cloud Media Computing, pages 41-46, 2010.
6. K. Church, B. Smyth, P. Cotter, and K. Bradley. Mobile information access: A study of emerging search behavior on the mobile internet. ACM Transactions on the Web, 1(1), May 2007.
7. J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-Fei. Imagenet: a large-scale hierarchical image database. 2009.
8. Digimarc Discover. "https://www.digimarc.com/discover/".
9. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1):59-70, 2007.
10. B. Frey and D. Dueck. Clustering by passing messages between data points. Science, 315(5814):972-976, 2007.
11. GazoPa. http://www.gazopa.com/.
12. Google Goggles. http://www.google.com/mobile/goggles/.
13. G. Griffin, A. Holub, and P. Perona. Caltech-256 object category dataset. 2007.
14. M. Jia, X. Fan, X. Xie, M. Li, and W. Ma. Photo-to-Search: Using camera phones to inquire of the surrounding world. In Proc. of Mobile Data Management, 2006.
15. X. Li. Understanding the semantic structure of noun phrase queries. In Proc. of Annual Meeting of the Association for Computational Linguistics, pages 1337-1345, 2010.
16. LinkMe Mobile. http://www.snapnow.co.uk/.
17. Y. Liu, T. Mei, and X.-S. Hua. CrowdReranking: exploring multiple search engines for visual search reranking. In Proc. of ACM SIGIR conference on Research and Development in Information Retrieval, pages 500-507, 2009.
18. D. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91-110, 2004.
19. Y.-F. Ma and H.-J. Zhang. Contrast-based image attention analysis by using fuzzy growing. In Proc. of ACM Multimedia, pages 374-381, Nov 2003.
20. G. Miller. WordNet: a lexical database for English. Communications of the ACM, 38(11):39-41, 1995.
21. D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In Proc. of IEEE International Conference on Computer Vision and Pattern Recognition, pages 2161-2168, 2006.
22. NOKIA Point and Find. http://pointandfind.nokia.com/.
23. L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proc. of the IEEE, 77(2):257-286, 1989.
24. S. Sekine, K. Sudo, and C. Nobata. Extended named entity hierarchy. In Proc. of LREC-2002, 2002.
25. Smart Visual™ Kooaba. http://www.kooaba.com/.
26. SnapTell. http://www.snaptell.com/.
27. G. Takacs, Y. Xiong, R. Grzeszczuk, and et al. Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In Proc. of ACM International Conference on Multimedia Information Retrieval, pages 427-434, 2008.
28. TinEye. http://www.tineye.com/.
29. J. Wang and X.-S. Hua. Interactive image search by color map. ACM Trans. on Intelligent Systems and Technology, 3(1), 2012.
30. Xcavator. http://www.xcavator.net/.
31. H. Xu, J. Wang, X. Hua, and S. Li. Image search by concept map. In Proc. of ACM SIGIR conference on Research and development in information retrieval, pages 275-282, 2010.
32. W.-K. Yang, A. Cho, D.-S. Jeong, and W.-G. Oh. Image description and matching scheme for identical image searching. Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns, Computation World, pages 669-674, 2009.