Listen, look, and gotcha: Instant video search with mobile phones by layered audio-video indexing

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Volumn , Issue , 2013, Pages 887-896

  Liu, Wu ^a,c   Mei, Tao ^b   Zhang, Yongdong ^a   Li, Jintao ^a   Li, Shipeng ^b  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Audio video signatures; Instant search; Layered audio video indexing; Mobile video search; Progressive query process

Indexed keywords

AUDIO-VIDEO SIGNATURES; INSTANT SEARCH; MOBILE VIDEO; PROGRESSIVE QUERIES; VIDEO INDEXING;

CELLULAR TELEPHONES; MOBILE DEVICES; MOBILE PHONES; MOBILE TELECOMMUNICATION SYSTEMS; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

INDEXING (OF INFORMATION);

EID: 84887481528     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2502081.2502084     Document Type: Conference Paper

References (30)

1. H. Bay, A. Ess, T. Tuytelaars, and L. J. V. Gool. Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding, 110(3):346-359, 2008.
2. V. Chandrasekhar, G. Takacs, D. M. Chen, S. S. Tsai, R. Grzeszczuk, and B. Girod. Chog: Compressed histogram of gradients a low bit-rate feature descriptor. In CVPR, pages 2504-2511, 2009.
3. D. M. Chen, N.-M. Cheung, S. S. Tsai, V. Chandrasekhar, G. Takacs, R. Vedantham, R. Grzeszczuk, and B. Girod. Dynamic selection of a feature-rich query frame for mobile video retrieval. In ICIP, pages 1017-1020, 2010.
4. B. Girod, V. Chandrasekhar, D. M. Chen, N.-M. Cheung, R. Grzeszczuk, Y. A. Reznik, G. Takacs, S. S. Tsai, and R. Vedantham. Mobile visual search. IEEE Signal Process. Mag., 28(4):61-76, 2011.
5. J. He, J. Feng, X. Liu, T. Cheng, T.-H. Lin, H. Chung, and S.-F. Chang. Mobile product search with bag of hash bits and boundary reranking. In CVPR, pages 3005-3012, 2012.
6. J. Huber, J. Steimle, and M. Mühlhäuser. Mobile interaction techniques for interrelated videos. In CHI Extended Abstracts, pages 3535-3540, 2010.
7. IntoNow. http://www.intonow.com/.
8. R. Ji, L.-Y. Duan, J. Chen, H. Yao, Y. Rui, S.-F. Chang, and W. Gao. Towards low bit rate mobile visual search with multiple-channel coding. In ACM Multimedia, pages 573-582, 2011.
9. H. Liu, T. Mei, J. Luo, H. Li, and S. Li. Finding perfect rendezvous on the go: Accurate mobile visual localization and its applications to routing. In ACM Multimedia, pages 9-18, 2012.
10. Y. Liu, W. Zhao, C.-W. Ngo, C. Xu, and H. Lu. Coherent bag-of audio words model for efficient large-scale video copy detection. In CIVR, pages 89-96, 2010.
11. Q. Lv, W. Josephson, Z. Wang, M. Charikar, and K. Li. Multi-probe lsh: Efficient indexing for high-dimensional similarity search. In VLDB, pages 950-961, 2007.
12. M. Muja and D. G. Lowe. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Application, pages 331-340, 2009.
13. M. Muja and D. G. Lowe. Fast matching of binary features. In Proceedings of International Conference on Computer and Robot Vision, pages 404-410, 2012.
14. M. Norouzi and D. J. Fleet. Minimal loss hashing for compact binary codes. In ICML, pages 353-360, 2011.
15. M. Norouzi, A. Punjani, and D. J. Fleet. Fast search in hamming space with multi-index hashing. In CVPR, pages 3108-3115, 2012.
16. S. Paisitkriangkrai, T. Mei, J. Zhang, and X.-S. Hua. Scalable clip-based near-duplicate video detection with ordinal measure. In CIVR, pages 121-128, 2010.
17. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. In CVPR, 2007.
18. L. Shang, L. Yang, F. Wang, K.-P. Chan, and X.-S. Hua. Real-time large scale near-duplicate web video retrieval. In ACM Multimedia, pages 531-540, 2010.
19. H. T. Shen, J. Shao, Z. Huang, and X. Zhou. Effective and efficient query processing for video subsequence identification. IEEE Trans. Knowl. Data Eng., 21(3):321-334, 2009.
20. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In ICCV, pages 1470-1477, 2003.
21. C. Snoek, M. Worring, and A. W. M. Smeulders. Early versus late fusion in semantic video analysis. In ACM Multimedia, pages 399-402, 2005.
22. TRECVID 2011. http://www-nlpir.nist.gov/projects/tv2011/.
23. K.-Y. Tseng, Y.-L. Lin, Y.-H. Chen, and W. H. Hsu. Sketch-based image retrieval on mobile devices using compact hash bits. In ACM Multimedia, pages 913-916, 2012.
24. VideoSurf.http://www.videosurf.com/mobile.
25. A. Wang. An industrial strength audio search algorithm. In ISMIR, pages 7-13, 2003.
26. Y. Weiss, A. Torralba, and R. Fergus. Spectral hashing. In NIPS, pages 1753-1760, 2008.
27. G.-L. Wu, Y.-C. Su, T.-H. Chiu, L.-C. Hsieh, and W. H. Hsu. Scalable mobile video question-answering system with locally aggregated descriptors and random projection. In ACM Multimedia, pages 647-650, 2011.
28. X. Wu, C.-W. Ngo, A. G. Hauptmann, and H.-K. Tan. Real-time near-duplicate elimination for web video search with content and context. IEEE Transactions on Multimedia, 11(2):196-207, 2009.
29. Y. Wu, S. Lu, T. Mei, J. Zhang, and S. Li. Local visual words coding for low bit rate mobile visual search. In ACM Multimedia, pages 989-992, 2012.
30. X. Yang and K.-T. T. Cheng. Accelerating surf detector on mobile devices. In ACM Multimedia, pages 569-578, 2012.