Overview of the MPEG-CDVS standard

IEEE Transactions on Image Processing

Volumn 25, Issue 1, 2016, Pages 179-193

  Duan, Ling Yu ^a   Chandrasekhar, Vijay ^b   Chen, Jie ^a   Lin, Jie ^d   Wang, Zhe ^a   Huang, Tiejun ^a   Girod, Bernd ^c   Gao, Wen ^a  

^a PEKING UNIVERSITY   (China)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c Stanford University   (United States)

^d NONE

Author keywords

Compact descriptors; Feature compression; MPEG CDVS; Visual search

Indexed keywords

IMAGE ENHANCEMENT; IMAGE RETRIEVAL; MOTION PICTURE EXPERTS GROUP STANDARDS;

DESCRIPTORS; FEATURE COMPRESSION; MOVING PICTURES EXPERTS GROUPS; MPEG-CDVS; RETRIEVAL APPLICATIONS; STANDARDIZATION PROCESS; TECHNICAL FEATURES; VISUAL SEARCH;

ISO STANDARDS;

EID: 85006146107     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2500034     Document Type: Review

References (69)

1. (2009). Google-Goggles. [Online]. Available: http://www.google.com/mobile/goggles/
2. Amazon. (2011). Amazon Flow. [Online]. Available: http://a9.amazon.com/-/company/flow.jsp
3. Layar. (2010). Layar. [Online]. Available: http://www.layar.com
4. B. Girod et al., “Mobile visual search,” IEEE Signal Process. Mag., vol. 28, no. 4, pp. 61–76, Jul. 2011.
5. V. Chandrasekhar et al., “Compressed histogram of gradients: A low-bitrate descriptor,” Int. J. Comput. Vis., vol. 96, no. 3, pp. 384–399, Jan. 2012.
6. D. M. Chen and B. Girod, “Memory-efficient image databases for mobile visual search,” IEEE MultiMedia, vol. 21, no. 1, pp. 14–23, Jan./Mar. 2014.
7. D. M. Chen, S. S. Tsai, V. Chandrasekhar, G. Takacs, J. Singh, and B. Girod, “Tree histogram coding for mobile image matching,” in Proc. IEEE Data Compress. Conf. (DCC), Snowbird, UT, USA, Mar. 2009, pp. 143–152.
8. R. Ji et al., “Towards low bit rate mobile visual search with multiple-channel coding,” in Proc. 19th ACM Int. Conf. Multimedia (MM), New York, NY, USA, 2011, pp. 573–582. [Online]. Available: http://doi.acm.org/10.1145/2072298.2072372
9. R. Ji et al., “Location discriminative vocabulary coding for mobile landmark search,” Int. J. Comput. Vis., vol. 96, no. 3, pp. 290–314, Feb. 2012.
10. V. Chandrasekhar et al., “Comparison of local feature descriptors for mobile visual search,” in Proc. IEEE Int. Conf. Image Process. (ICIP), Hong Kong, Sep. 2010, pp. 3885–3888.
11. Y. Reznik et al., Evaluation Framework for Compact Descriptors for Visual Search, document ISO/IEC JTC1/SC29/WG11/N12202.
12. Y. Reznik et al., Call for Proposals for Compact Descriptors for Visual Search, document ISO/IEC JTC1/SC29/WG11/Output/N12201, Jul. 2011.
13. Y. Reznik et al., Compact Descriptors for Visual Search: Requirements (Draft) document ISO/IEC JTC1/SC29/WG11/N11531, Jul. 2010.
14. S. Paschalakis et al., Information Technology—Multimedia Content Description Interface—Part 13: Compact Descriptors for Visual Search, document ISO/IEC 15938-13:2015, Aug. 2015.
15. V. R. Chandrasekhar et al., “The Stanford mobile visual search data set,” in Proc. ACM Multimedia Syst. Conf. (MMSys), San Jose, CA, USA, Feb. 2011, pp. 117–122.
16. M. J. Huiskes, B. Thomee, and M. S. Lew, “New trends and ideas in visual concept detection: The MIR flickr retrieval evaluation initiative,” in Proc. ACM Int. Conf. Multimedia Inf. Retr., New York, NY, USA, 2010, pp. 527–536.
17. J. Chen, L.-Y. Duan, F. Gao, J. Cai, A. C. Kot, and T. Huang, “A low complexity interest point detector,” IEEE Signal Process. Lett., vol. 22, no. 2, pp. 172–176, Feb. 2015.
18. G. Francini, S. Lepsøy, and M. Balestri, “Selection of local features for visual search,” Signal Process., Image Commun., vol. 28, no. 4, pp. 311–322, Apr. 2013.
19. S. Paschalakis et al., CDVS CE2: Local Descriptor Compression Proposal, document ISO/IEC JTC1/SC29/WG11/M25929, Jul. 2012.
20. S. S. Tsai et al., “Improved coding for image feature location information,” Proc. SPIE, vol. 8499, pp. 84991E-1–84991E-11, Aug. 2012.
21. J. Lin, L.-Y. Duan, Y. Huang, S. Luo, T. Huang, and W. Gao, “Rate-adaptive compact Fisher codes for mobile visual search,” IEEE Signal Process. Lett., vol. 21, no. 2, pp. 195–198, Feb. 2014.
22. D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vis., vol. 60, no. 2, pp. 91–110, Nov. 2004.
23. G. Francini, S. Lepsoy, and M. Balestri, CDVS: Telecom Italia’s Response to CE1—Interest Point Detection, document ISO/IEC JTC1/SC29/WG11/M31369, 2013.
24. J. Chen et al., CDVS CE1: A Low Complexity Detector ALP_BFLoG, document ISO/IEC JTC1/SC29/WG11/M33159, 2014.
25. F. Wang, L.-Y. Duan, J. Chen, T. Huang, and W. Gao, Peking University Response to CE2: Frequency Domain Interest Point Detector, document ISO/IEC JTC1/SC29/WG11/M28891, 2013.
26. J. Chen et al., PKU Response to CE1: Improved BFLoG Interest Point Detector, document ISO/IEC JTC1/SC29/WG11/M31398, Oct. 2013.
27. I. Guyon and A. Elisseeff, “An introduction to variable and feature selection,” J. Mach. Learn. Res., vol. 3, pp. 1157–1182, Jan. 2003.
28. G. Francini et al., Telecom Italia’s Response to the MPEG CfP for Compact Descriptor for Visual Search, document ISO/IEC JTC1/SC29/WG11/M22672, Nov. 2011.
29. S. S. Tsai et al., “Fast geometric re-ranking for image-based retrieval,” in Proc. IEEE Int. Conf. Image Process. (ICIP), Hong Kong, Sep. 2010, pp. 1029–1032.
30. J. Lin, L.-Y. Duan, T. Huang, and W. Gao, “Robust Fisher codes for large scale image retrieval,” in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), Vancouver, BC, Canada, May 2013, pp. 1513–1517.
31. H. Jégou, M. Douze, and C. Schmid, “Product quantization for nearest neighbor search,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117–128, Jan. 2011.
32. G. Francini, S. Lepsøy, and M. Balestri, Telecom Italia Response to the CDVS Core Experiment 2, document ISO/IEC JTC1 SC29 WG11 Input M24737, Apr. 2012.
33. Description of Test Model Under Consideration, document ISO/IEC JTC1 SC29 WG11 N12367, Dec. 2011.
34. J. Chen, Peking University Response to CE2—Local Descriptor Compression, document ISO/IEC JTC1/SC29/WG11/M26727, Oct. 2012.
35. S. Paschalakis et al., CDVS CE2: Local Descriptor Compression Proposal, document ISO/IEC JTC1/SC29/WG11/M25929, Jul. 2012.
36. S. Paschalakis et al., CDVS CE2: Local Descriptor Compression, document ISO/IEC JTC1/SC29/WG11/M28179, Jan. 2013.
37. V. Chandrasekhar, G. Takacs, D. M. Chen, S. S. Tsai, and B. Girod, “Transform coding of image feature descriptors,” Proc. SPIE, vol. 7257, pp. 725710-1–725710-9, Jan. 2009.
38. V. Chandrasekhar, G. Takacs, D. M. Chen, S. S. Tsai, M. Makar, and B. Girod, “Feature matching performance of compact descriptors for visual search,” in Proc. IEEE Data Compress. Conf. (DCC), Snowbird, UT, USA, Mar. 2014, pp. 3–12.
39. S. S. Tsai, D. M. Chen, G. Takacs, V. Chandrasekhar, J. P. Singh, and B. Girod, “Location coding for mobile image retrieval,” in Proc. Int. Mobile Multimedia Commun. Conf. (MobiMedia), London, U.K., Sep. 2009, p. 8.
40. Z. Wang et al., CDVS Core Experiement 3: Standford/Peking/Huawei Contribution, document ISO/IEC JTC1/SC29/WG11/M25883, Jul. 2012.
41. G. Francini et al., CDVS: Improved Image Comparison by Weighted Matching, document ISO/IEC JTC1/SC29/WG11/M25795, Jul. 2012.
42. V. Chandrasekhar et al., “Compressing feature sets with digital search trees,” in Proc. IEEE Int. Workshop Mobile Vis. (IWMV), Int. Conf. Comput. Vis. (ICCV), Barcelona, Spain, Nov. 2011, pp. 32–39.
43. V. Chandrasekhar, S. S. Tsai, Y. Reznik, G. Takacs, D. M. Chen, and B. Girod, “Compressing a set of CHoG features,” Proc. SPIE, vol. 8135, pp. 813517-1–813517-12, Sep. 2011.
44. Y. A. Reznik, “Coding of sets of words,” in Proc. IEEE Data Compress. Conf. (DCC), Snowbird, UT, USA, Mar. 2011, pp. 43–52.
45. H. Jégou, M. Douze, C. Schmid, and P. Perez, “Aggregating local descriptors into a compact image representation,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), San Francisco, CA, USA, Jun. 2010, pp. 3304–3311.
46. F. Perronnin and C. Dance, “Fisher kernels on visual vocabularies for image categorization,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Minneapolis, MN, USA, Jun. 2007, pp. 1–8.
47. F. Perronnin, J. Sánchez, and T. Mensink, “Improving the Fisher kernel for large-scale image classification,” in Proc. Eur. Conf. Comput. Vis. (ECCV), Heraklion, Greece, Sep. 2010, pp. 143–156.
48. F. Perronnin, Y. Liu, J. Sanchez, and H. Poirier, “Large-scale image retrieval with compressed Fisher vectors,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), San Francisco, CA, USA, Jun. 2010, pp. 3384–3391.
49. J. Sánchez, F. Perronnin, T. Mensink, and J. Verbeek, “Image classification with the Fisher vector: Theory and practice,” Int. J. Comput. Vis., vol. 105, no. 3, pp. 222–245, Jan. 2013.
50. D. Nister and H. Stewenius, “Scalable recognition with a vocabulary tree,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), New York, NY, USA, Jun. 2006, pp. 2161–2168.
51. J. Lin et al., Peking University Response to CE1: Performance Improvements of the Scalable Compressed Fisher Codes (SCFV), document ISO/IEC JTC1/SC29/WG11/M28061, Jan. 2013.
52. J. Lin et al., Peking Scalable Low-Memory Global Descriptor SCFV, document ISO/IEC JTC1/SC29/WG11/M26726, Oct. 2012.
53. J. Lin et al., Peking University Response to CE2: The Improved SCFV Global Descriptor, document ISO/IEC JTC1/SC29/WG11/M32261, Jan. 2014.
54. Z. Wang et al., Response to CE2: Improved SCFV, document ISO/IEC JTC1/SC29/WG11/M33189, 2014.
55. M. Balestri et al., CDVS: ETRI and TI’s Response to CE1—An Invariant Low Memory Implementation of the ALP Detector With a Simplified Usage Interface, document ISO/IEC JTC1/SC29/WG11/M31987, 2014.
56. T. S. Jaakkola and D. Haussler, “Exploiting generative models in discriminative classifiers,” in Proc. Adv. Neural Inf. Process. Syst., 1999, pp. 487–493.
57. D. Chen et al., Compact Descriptors for Visual Search: Improvements to the Test Model Under Consideration With a Global Descriptor, document ISO/IEC JTC1/SC29/WG11/M23578, Feb. 2012.
58. D. M. Chen et al., “Residual enhanced visual vector as a compact signature for mobile visual search,” in Signal Process., vol. 93, no. 8, pp. 2316–2327, Aug. 2013.
59. D. M. Chen et al., “Residual enhanced visual vectors for on-device image matching,” in Proc. Asilomar Conf. Signals, Syst., Comput., Monterey, CA, USA, Nov. 2011, pp. 850–854.
60. M. Bober, S. Husain, S. Paschalakis, and K. Wnukowicz, Improvements to TM6 With a Robust Visual Descriptor—Proposal From University of Surrey and Visual Atoms, document ISO/IEC JTC1/SC29/WG11/M30311, 2013.
61. Y. Gong and S. Lazebnik, “Iterative quantization: A procrustean approach to learning binary codes,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Washington, DC, USA, Jun. 2011, pp. 817–824.
62. MPEG CDVS (Compact Descriptors for Visual Search) Dataset. [Online]. Available: http://pacific.tilab.com/www/datasets/download/Dataset-20120210/, accessed Nov. 17, 2015.
63. MPEG CDVS (Compact Descriptors for Visual Search) Benchmark. Stanford Digital Repository. [Online]. Available: http://purl.stanford.edu/qy869qz5226, accessed Nov. 17, 2015.
64. S. Lepsøy, G. Francini, G. Cordara, and P. P. B. de Gusmao, “Statistical modelling of outliers for fast visual search,” in Proc. IEEE Workshop Vis. Content Identificat. Search (VCIDS), Barcelona, Spain, Jul. 2011, pp. 1–6.
65. Z. Wang et al., An Indexing Structure to Speed Up Retrieval, document ISO/IEC JTC1/SC29/WG11/M28893, Apr. 2013.
66. X. Xin et al., CDVS: 2-Way SIFT Matching to Improve Image Matching Accuracy, document ISO/IEC JTC1/SC29/WG11/M29359, Apr. 2013.
67. D. Pau et al., CDVS: STM Response to Interest Point Detector CE1, document ISO/IEC JTC1/SC29/WG11/M30233, Jul. 2013.
68. Z. Wang, L.-Y. Duan, J. Lin, T. Huang, W. Gao, and M. Bober, “Component hashing of variable-length binary aggregated descriptors for fast image search,” in Proc. IEEE Int. Conf. Image Process. (ICIP), Paris, France, Sep. 2014, pp. 2217–2221.
69. L.-Y. Duan, J. Lin, Z. Wang, T. Huang, and W. Gao, “Weighted component hashing of binary aggregated descriptors for fast visual search,” IEEE Trans. Multimedia, vol. 17, no. 6, pp. 828–842, Jun. 2015.