Visual attention guided bit allocation in video compression

Image and Vision Computing

Volumn 29, Issue 1, 2011, Pages 1-14

  Li, Zhicheng ^a,b   Qin, Shiyin ^a   Itti, Laurent ^b  

^a BEIHANG UNIVERSITY   (China)

^b University of Southern California   (United States)

Author keywords

Eye tracking; Video compression; Video subjective quality; Visual attention

Indexed keywords

CONSTRAINED OPTIMIZATION; GLOBAL OPTIMIZATION; MATHEMATICAL MODELS; VIDEO RECORDING;

AREA UNDER THE CURVES; BIT ALLOCATION; BIT RATES; BIT-ALLOCATION STRATEGY; CLOSED FORM; CONSTRAINED GLOBAL OPTIMIZATION; ENCODED VIDEOS; EYE-TRACKING; GUIDANCE MAP; PREDICTION MODEL; SALIENCY MAP; SUBJECTIVE QUALITY; VIDEO COMPRESSION; VIDEO FRAME; VIDEO SEQUENCES; VISUAL ATTENTION;

IMAGE COMPRESSION;

EID: 77957702893     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2010.07.001     Document Type: Article

References (45)

1. T. Weigand, G.J. Sullivan, and A. Luthra Draft ITU-T recommendation H.264 and final draft international standard 14496-10 advanced video coding Joint Video Teams of ISO/IECJTCI/SC29/WG11 and ITU-T SG/16/Q.6Doc.JVT-G050r, Geneva, Switzerland 2003 May
2. T. Wiegand, G.J. Sullivan, G. Bjntegaard, and A. Luthra Overview of the H.264/AVC video coding standard IEEE Trans. Circuits and Syst. Video Technol vol. 13 July 2003 560 576
3. B. Wandell Foundations of Vision 1995 Sinauer Sunderland, MA
4. P.T. Kortum, and W.S. Geisler Implementation of a foveated image coding system for bandwidth reduction of video images Proc. SPIE vol. 2657 1996 350 360
5. N. Doulamis, A. Doulamis, D. Kalogera, and S. Kollias Improving the performance of MPEG coders using adaptive regions of interest IEEE Trans. On Circuits syst. Video Technol vol. 8 1998 928 934
6. S. Lee, A.C. Bovik, and Y.Y. Kim Low delay foveated visual communications over wireless channels Proc. IEEE Int. Conf. Image Processing 1999 90 94
7. U. Rauschenbach, and H. Schumann Demand-driven image transmission with levels of detail and region s of interest Comput. Graph vol. 23, no. 6 1999 857 866
8. D.J. Parkhurst, and E. Niebur Variable-resolution displays: a theoretical, practical, and behavioral evalutation Human Factors vol. 44, no. 4 2002 611 629
9. M. Chi, M. Chen, C. Yeh, and J. Jhu Region-of-interest video coding based on rate and distortion variations for H.263+ Image Communication vol. 23, no. 2 2008 127 142
10. O. Hershler, and S. Hochstein At first sight: a high-level pop out effects for faces Vision Research vol. 45, no. 13 2005 1707 1724
11. M. Cerf, J. Harel, W. Einhauser, and C. Koch Predicting human gaze using low-level saliency combined with face detection Advances in neural information processing systems vol. 20 2008 241 248
12. K.C. Lai, S.C. Wong, and K. Lun A rate control algorithm using human visual system for video conferencing systems Proc. Int. Conf. Signal Processing vol. 1 Aug. 2002 656 659
13. L. Tong, and K.R. Rao Region-of-interest based rate control for low-bit-rate video conferencing Journal of Electronic Imaging vol. 15, no. 3 July, 2006
14. L. S. Karlsson, "Spatio-temporal pre-processing methods for region-of-interest video coding," PhD dissertation, Sundsvall, Sweden, 2007.
15. C.-W. Tang, C.-H. Chen, Y.-H. Yu, and C.-J. Tsai Visual sensitivity guided bit allocation for video coding IEEE Trans. Multimedia vol. 8 Feb. 2006 11 18
16. K. Minoo, and T.Q. Nguyen Perceptual video coding with H.264 Proc. 39th Asilomar Conf. Signals, Systems, and Computers Nov. 2005
17. C. Huang, and C. Lin A novel 4-D perceptual quantization modeling for H.264 bit-rate control IEEE Trans. On Multimedia vol. 9, no. 6 2007 1113 1124
18. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 20 Nov. 1998 1254 1259
19. L. Itti, and C. Koch Computational modeling of visual attention Nature Reviews, Neuroscience vol. 2 Mar, 2001 194 203
20. T. Liu, N. Zheng, W. Ding, and Z. Yuan Video attention: learning to detect a salient object sequence Proc. ICPR 2008 1 4
21. L. Itti Automatic foveation for video compression using a neurobiological model of visual attention IEEE Trans. on Image Processing vol. 13, no. 10 2004 1304 1318
22. L. Itti Automatic attention-based prioritization of unconstrained video for compression Proc. SPIE Human Vision and Electronic Imaging vol. 5292 2004 272 283
23. W. Lai, X. Gu, R. Wang, W. Ma, and H. Zhang A content-based bit allocation model for video streaming Proc. IEEE international Conference on Multimedia and Expo 2004 ICME)
24. Z. Chen, G. Qiu, Y. Lu, L. Zhu, Q. Chen, X. Gu, and W. Charles Improving video coding at scene cuts using attention based adaptive bit allocation Proc. ISCAS 2007 3634 3638
25. M. Jiang, and N. Ling On Lagrange multiplier and quantizer adjustment for H.264 frame layer video rate control IEEE Trans. Circuits and Syst. Video Technol vol. 16, no. 5 2006 663 669
26. S. Lee, M.S. Pattechis, and A.C. Bovik Foveated video compression with optimal rate control IEEE Trans. on Image Processing vol. 10, no. 7 2001 977 992
27. Y. Sun, I. Ahmad, D. Li, and Y. Zhang Region-based rate control and bit allocation for wireless video transmission IEEE Trans. on Multimedia vol. 8, no. 1 2006 1 10
28. Y. Liu, Z. Li, and Y.C. Soh Region-of-interest based resource allocation for conversational video communications of H.264/AVC IEEE Trans. Circuits and Syst. Video Technol vol. 18, no. 1 2008 134 139
29. Z. Li, and L. Itti Visual attention guided video compression Proc. Vision Science Society Annual Meeting (VSS08) May, 2008
30. N. Wang, Q. Zhang, and G. Li Objective quality evaluation of digital video Proc. PCCAS 2000 791 794
31. A.A. Webster, C.T. Jones, M.H. Pinson, S.D. Voran, S. Wolf, A.A. Webster, C.T. Jones, M.H. Pinson, S.D. Voran, and S. Wolf Objective video quality assessment system based on human perception Proc. SPIE vol. 1913 1993 15 26
32. A.B. Watson, J. Hu, and J.F. McGowan Digital video quality metric based on human vision Journal of Electronic Imaging vol. 10, no. 1 2001 20 29
33. "Tutorial: objective perceptual assessment of video quality: full reference television,", ITU-T Technical tutorials, 2005.
34. http://ilab.usc.edu/toolkit.
35. J.M. Wolfe Visual memory: what do you know about what you saw? Current Biology vol. 8 1998 303 304
36. A.M. Treisman, and G. Gelade A feature-integration theory of attention Cognition Psychology vol. 12 1980 97 136
37. L. Itti, and C. Koch Feature combination strategies for saliency-based visual attention systems Journal of Electronic Imaging vol. 10 Jan. 2001 161 169
38. Y. Wang, J. Ostermann, and Y. Zhang Video Processing and Communication Pearson Education 2002
39. H.S. Malvar, L.W. He, and R. Cutler High-quality linear interporlation for demosaicing of bayer-patterned color images Proc. ICASSP 2004 485 488
40. D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph Journal of Mathematical Psychology vol. 12 1975 375 387
41. M. Vranjes, S. Rimac-Drlje, and D. Zagar Subjective and objective quality evaluation of the H.264/AVC coded video Proc. Systems, Signals and Image Processing 2008
42. A.B. Watson Toward a perceptual video quality metric Human Vision, Visual Processing, and Digital Display vol. 3299 1998 139 147
43. K. Ehinger, B. Hidalgo-Sotelo, A. Torralba, and A. Oliva Modeling search for people in 900 scenes: a combined source model of eye guidance Visual Cognition vol. 17, no. 6&7 2009 945 978
44. Z. Li, and L. Itti Gist based top-down templates for gaze prediction Proc. Vision Science Society Annual Meeting 2009 VSS09
45. J. Peters, and L. Itti Beyond bottom-up: incorporating task-dependent influences into a computational model of spatial attention Proc. CVPR 2007