A novel rate control framework for SIFT/SURF feature preservation in H.264/AVC video compression

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 25, Issue 6, 2015, Pages 958-972

  Chao, Jianshu ^a   Huitl, Robert ^a   Steinbach, Eckehard ^a   Schroeder, Damien ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Bag of features (BoFs); Evaluation; H.264 Advanced Video Coding (AVC); Rate control; Scale invariant feature transform (SIFT); Speeded up robust feature (SURF)

Indexed keywords

ALGORITHMS; CODES (SYMBOLS); FEATURE EXTRACTION; IMAGE MATCHING; MOTION PICTURE EXPERTS GROUP STANDARDS; SEARCH ENGINES; VIDEO SIGNAL PROCESSING;

BAG OF FEATURES; EVALUATION; H.264/ADVANCED VIDEO CODING; RATE CONTROLS; SCALE INVARIANT FEATURE TRANSFORMS; SPEEDED UP ROBUST FEATURES;

IMAGE CODING;

EID: 84951813603     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2367354     Document Type: Article

References (49)

1. A. Vetro, H. Sun, and Y. Wang, "MPEG-4 rate control for multiple video objects," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 1, pp. 186-199, Feb. 1999.
2. Z. Li, F. Pan, K. P. Lim, G. Feng, X. Lin, and S. Rahardja, Adaptive Basic Unit Layer Rate Control for JVT, document JVT-G012-rl, Pattaya, Thailand, Mar. 2003.
3. A. Leontaris and A. M. Tourapis, Rate Control Reorganization in the JM Reference Software, document JVT-W042, San Jose, CA, USA, Apr. 2007.
4. H.-M. Hu, B. Li, W. Lin, W. Li, and M.-T. Sun, "Region-based rate control for H.264/AVC for low bit-rate applications," IEEE Trans. Circuits Syst. Video Techn., vol. 22, no. 11, pp. 1564-1576, Nov. 2012.
5. T. S. Ou, Y.-H. Huang, and H. H. Chen, "SSIM-based perceptual rate control for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 5, pp. 682-691, May 2011.
6. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
7. H.264/AVC JM Reference Software. [Online]. Available: http://iphome.hhi.de/suehring/tml/
8. D. Agrafiotis, D. R. Bull, C. Canagarajah, and N. Kamnoonwatana, "Multiple priority region of interest coding with H.264," in Proc. IEEE Int. Conf. Image Process., Oct. 2006, pp. 53-56.
9. J.-C. Chiang, C.-S. Hsieh, G. Chang, F.-D. Jou, and W.-N. Lie, "Regionof- interest based rate control scheme with flexible quality on demand," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2010, pp. 238-242.
10. D. Zhang, K. N. Ngan, and Z. Chen, "A two-pass rate control algorithm for H.264/AVC high definition video coding," Signal Process., Image Commun., vol. 24, no. 5, pp. 357-367, 2009.
11. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vis. Conf., 1988, pp. 147-151.
12. E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," in Proc. 9th Eur. Conf. Comput. Vis., Graz, Austria, May 2006, pp. 430-443.
13. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
14. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. Brit. Mach. Vis. Conf., Cardiff, U.K., Sep. 2002, pp. 384-396.
15. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," in Proc. 9th Eur. Conf. Comput. Vis., Graz, Austria, May 2006, pp. 404-417.
16. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
17. J. Chao, A. Al-Nuaimi, G. Schroth, and E. Steinbach, "Performance comparison of various feature detector-descriptor combinations for content-based image retrieval with JPEG-encoded query images," in Proc. IEEE 15th Int. Workshop Multimedia Signal Process., Pula, Italy, Sep./Oct. 2013, pp. 029-034.
18. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, R. Grzeszczuk, and B. Girod, "CHoG: Compressed histogram of gradients a low bit-rate feature descriptor," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, Jun. 2009, pp. 2504-2511.
19. L. Baroffio, M. Cesana, A. Redondi, M. Tagliasacchi, and S. Tubaro, "Coding visual features extracted from video sequences," IEEE Trans. Image Process., vol. 23, no. 5, pp. 2262-2276, May 2014.
20. A. Redondi, L. Baroffio, M. Cesana, and M. Tagliasacchi, "Compressthen- analyze vs. analyze-then-compress: Two paradigms for image analysis in visual sensor networks," in Proc. IEEE 15th Int. Workshop Multimedia Signal Process. (MMSP), Sep./Oct. 2013, pp. 278-282.
21. A. Redondi, L. Baroffio, J. Ascenso, M. Cesano, and M. Tagliasacchi, "Rate-accuracy optimization of binary descriptors," in Proc. 20th IEEE Int. Conf. Image Process., Sep. 2013, pp. 2910-2914.
22. Test Model 10: Compact Descriptors for Visual Search, document ISO/IEC, Apr. 2014.
23. M. Makar, C.-L. Chang, D. Chen, S. S. Tsai, and B. Girod, "Compression of image patches for local feature extraction," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Taipei, Taiwan, Apr. 2009, pp. 821-824.
24. M. Makar, H. Lakshman, V. Chandrasekhar, and B. Girod, "Gradient preserving quantization," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 2505-2508.
25. M. Makar, S. S. Tsai, V. Chandrasekhar, D. Chen, and B. Girod, "Interframe coding of canonical patches for low bit-rate mobile augmented reality," Int. J. Semantic Comput., vol. 7, no. 1, pp. 5-24, 2013.
26. L. Duan, X. Liu, J. Chen, T. Huang, and W. Gao, "Optimizing JPEG quantization table for low bit rate mobile visual search," in Proc. Vis. Commun. Image Process., San Diego, CA, USA, Nov. 2012, pp. 1-6.
27. J. Chao, H. Chen, and E. Steinbach, "On the design of a novel JPEG quantization table for improved feature detection performance," in Proc. 20th IEEE Int. Conf. Image Process., Melbourne, VIC, Australia, Sep. 2013, pp. 1675-1679.
28. J. Chao and E. Steinbach, "Preserving SIFT features in JPEG-encoded images," in Proc. 18th IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 301-304.
29. J. Chao and E. Steinbach, "SIFT feature-preserving bit allocation for H.264/AVC video compression," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 709-712.
30. C. Schmid, R. Mohr, and C. Bauckhage, "Evaluation of interest point detectors," Int. J. Comput. Vis., vol. 37, no. 2, pp. 151-172, Jun. 2000.
31. K. Mikolajczyk et al., "A comparison of affine region detectors," Int. J. Comput. Vis., vol. 65, nos. 1-2, pp. 43-72, Nov. 2005.
32. M. Calonder, V. Lepetit, C. Strecha, and P. Fua, "BRIEF: Binary robust independent elementary features," in Proc. 11th Eur. Conf. Comput. Vis., Crete, Greece, Oct. 2010, pp. 778-792.
33. S. Leutenegger, M. Chli, and R. Y. Siegwart, "BRISK: Binary robust invariant scalable keypoints," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 2548-2555.
34. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Comput. Vis., Nice, France, Oct. 2003, pp. 1470-1477.
35. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., New York, NY, USA, Jun. 2006, pp. 2161-2168.
36. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
37. G. Schindler, M. Brown, and R. Szeliski, "City-scale location recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-7.
38. H. Jégou, M. Douze, and C. Schmid, "Improving bag-of-features for large scale image search," Int. J. Comput. Vis., vol. 87, no. 3, pp. 316-336, Feb. 2010.
39. G. Schroth, A. Al-Nuaimi, R. Huitl, F. Schweiger, and E. Steinbach, "Rapid image retrieval for mobile location recognition," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Prague, Czech Republic, May 2011, pp. 2320-2323.
40. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
41. H. Jégou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. 10th Eur. Conf. Comput. Vis., Marseille, France, Oct. 2008, pp. 304-317.
42. O. Chum, T. Werner, and J. Matas, "Epipolar geometry estimation via RANSAC benefits from the oriented epipolar constraint," in Proc. 17th Int. Conf. Pattern Recognit., Cambridge, U.K., Aug. 2004, pp. 112-115.
43. OpenCV Version 2.4.3. [Online]. Available: http://opencv.willowgarage.com/wiki/
44. CIF Format Video Sequences. [Online]. Available: http://trace.eas.asu.edu/yuv/, accessed Nov. 2012.
45. 720p Format Video Sequences. [Online]. Available: ftp://ftp.ldv.ei.tum.de/videolab/public/SVT-Test-Set/720p/, accessed Nov. 2012.
46. K. P. Lim, G. Sullivan, and T. Wiegand, Text Description of Joint Model Reference Encoding Methods and Decoding Concealment Methods, document JVT-O079, Busan, Korea, Apr. 2005.
47. Z. G. Li et al., "Adaptive rate control for H.264," J. Vis. Commun. Image Represent., vol. 17, no. 2, pp. 376-406, Apr. 2006.
48. Methodology for the Subjective Assessment of Video Quality in Multimedia Applications, document Rec. ITU-R BT.1788, 2007.
49. Subjective Video Quality Assessment Methods for Multimedia Applications, document Rec. ITU-T P.910, 2008.