Robust spatial matching for object retrieval and its parallel implementation on GPU

IEEE Transactions on Multimedia

Volumn 13, Issue 6, 2011, Pages 1308-1318

  Wang, Wenying ^a,b   Zhang, Dongming ^a   Zhang, Yongdong ^a   Li, Jintao ^a   Gu, Xiaoguang ^a  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b NANJING RESEARCH INSTITUTE OF ELECTRONICS TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

AFFINE TRANSFORMATION ESTIMATION; AFFINE TRANSFORMATIONS; COVARIANT; GRAPHICS PROCESSING UNIT; GRAVITY VECTORS; LOCAL REGION; MEMORY ACCESS; OBJECT RETRIEVAL; PARALLEL IMPLEMENTATIONS; REAL-TIME APPLICATION; SPATIAL MATCHING;

OPTICS; PROGRAM PROCESSORS;

COMPUTER GRAPHICS EQUIPMENT;

EID: 82055208445     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2165053     Document Type: Article

References (40)

1. R. Datta, D. Joshi, J. Li, and J. Z. Wang, "Image retrieval: Ideas, influences, and trends of the new age," ACM Comput. Surv. (CSUR), vol. 40, p. 60, 2008.
2. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 888-905, 2000.
3. J. Malik, S. Belongie, T. K. Leung, and J. Shi, "Contour and texture analysis for image segmentation," Int. J. Comput. Vis., vol. 42, pp. 7-27, 2001. (Pubitemid 32720090)
4. S. X. Yu and J. Shi, "Segmentation given partial grouping constraints," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, pp. 173-183, 2004.
5. Y. Deng, B. S. Manjunath, C. Kenney, M. S. Moore, and H. Shin, "An efficient color representation for image retrieval," IEEE Trans. Image Process., vol. 10, pp. 140-147, 2001.
6. J. Portilla and E. Simoncelli, "A parametric texture model based on joint statistics of complex wavelet coefficients," Int. J. Comput. Vis., vol. 40, pp. 49-71, 2000. (Pubitemid 32083683)
7. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. HUang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, "Query by image and video content: The QBIC system," IEEE Comput., vol. 28, pp. 23-32, 1995.
8. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, pp. 509-522, 2002. (Pubitemid 34448769)
9. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. V. Gool, "A comparison of affine region detectors," Int. J. Comput. Vis., vol. 65, pp. 43-72, 2006. (Pubitemid 43281159)
10. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 10, pp. 1615-1630, 2005. (Pubitemid 41555406)
11. C. Schmid and R. Mohr, "Local grayvalue invariants for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, pp. 530-535, 1997. (Pubitemid 127762247)
12. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. Conf. Computer Vision and Pattern Recognition,Minneapolis, MN, 2007, pp. 1-8.
13. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Lost in quantization: Improving particular object retrieval in large scale image databases," in Proc. CVPR, 2008.
14. G. Csurka, C. Dance, L. X. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. ECCV Int. Workshop Statistical Learning in Computer Vision, 2004.
15. O. Chum, M. Perdoch, and J. Matas, "Geometric min-Hashing-finding a (thick) needle in a Haystack," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, 2009, pp. 17-24.
16. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, New York, 2006, pp. 2161-2168. (Pubitemid 44931581)
17. M. Perd'och, O. Chum, and J. Matas, "Efficient representation of local geometry for large scale object retrieval," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, 2009.
18. G. Carneiro and A. D. Jepson, "Flexible spatial configuration of local image features," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, pp. 2089-2104, 2007. (Pubitemid 350124059)
19. J. Sivic and A. Zisserman, "Efficient visual search of videos cast as text retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, pp. 591-606, 2009.
20. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," Image Vis. Comput., vol. 22, pp. 761-767, 2004.
21. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. Int. Conf. Computer Vision, Kerkyra, Greece, 1999, pp. 1150-1157.
22. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. Int. Conf. Computer Vision,Washington, DC, 2003, pp. 1470-1477.
23. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, pp. 91-110, 2004.
24. K. Mikolajczyk and C. Schmid, "Scale & affine invariant interest point detectors," Int. J. Comput. Vis., vol. 60, pp. 63-86, 2004.
25. J. Meng, J. Yuan, Y. Jiang, N. Narasimhan, V. Vasudevan, and Y. Wu, "Interactive visual object search through mutual information maximization," in Proc. ACM Multimedia, 2010, pp. 1147-1150.
26. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate web image search," in Proc. ACM Multimedia, 2010, pp. 511-520.
27. C. H. Lampert, "Detecting objects in large image collections and videos by efficient subimage retrievalPro," in Proc. Int. Conf. Computer Vision, 2009.
28. Q.-F. Zheng, W.-Q.Wang, and W. Gao, "Effective and efficient objectbased image retrieval using visual phrases," in Proc. ACM Int. Conf. Multimedia, Santa Barbara, CA, 2006, pp. 77-80. (Pubitemid 47113508)
29. J. Yuan, Y.Wu, and M. Yang, "Discovery of collocation patterns: From visual words to visual phrases," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Minneapolis, MN, 2007, pp. 1-8.
30. O. Chum and J. Matas, "Locally optimized RANSAC," presented at the DAGM Symp. Magdeburg, 2003.
31. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, pp. 381-395, 1981.
32. "NVIDIA CUDA Programming Guide Version 2.2," NVIDIA, 2008. [Online]. Available: http://www.nvidia.com/object/cuda-get.html.
33. J. D. Owens, D. Luebke, N. Govindaraju, M. Harris, J. Krüger, A. E. Lefohn, and T. J. Purcell, "A survey of general-purpose computation on graphics hardware," in Proc. Computer Graphics Forum, 2007, vol. 26, pp. 80-113. (Pubitemid 46481097)
34. F. James and M. Steve, "Computer vision signal processing on graphics processing units," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, Montreal, QC, Canada, 2004, pp. 351-358.
35. Sudipta, N. Sinha, and J.-M. Frahm, GPU-Based Video Feature Tracking and Matching, Dept. Comput. Sci., UNC. Chapel Hill, 2006.
36. W. Fang, K. K. Lau, M. Lu, X. Xiao, C. K. Lam, P. Y. Yang, B. He, Q. Luo, P. V. Sander, and K. Yang, Parallel Data Mining on Graphics Processors, The Hong Kong University of Science and Technology, 2008.
37. C. Terboven, T. Deselaers, C. Bischof, and H. Ney, "Shared-memory parallelization for content-based image retrieval," in Proc. Eur. Conf. Computer Vision, 2006.
38. D. H. Ballarda, "Generalizing the Hough transform to detect arbitrary shapes," Pattern Recognit., vol. 13, pp. 111-122, 1981.
39. M. Harris, 2008, Optimizing Parallel Reduction in CUDA. [Online]. Available: http://developer.download.nvidia.com/compute/cuda/1-1/Website/ projects/reduction/doc/reduction.pdf.
40. M. Harris, S. Sengupta, and J. D. Owens, "Parallel prefix sum (scan) with cuda," presented at the GPU Gems 3, Addison Wesley, 2007.