Robust region-of-interest determination based on user attention model through visual rhythm analysis

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 7, 2009, Pages 1025-1038

  Chi, Ming Chieh ^a   Yeh, Chia Hung ^b   Chen, Mei Juan ^a  

^a NATIONAL DONG HWA UNIVERSITY   (Taiwan)

^b NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

Author keywords

Content analysis; Feature extraction; Region of interest (ROI); User attention; Visual rhythm

Indexed keywords

AUTOMATIC DETERMINATION; CAMERA MOTIONS; CONTENT ANALYSIS; FLEXIBLE MACROBLOCK ORDERING; H.264/AVC VIDEO CODING; HARDWARE DESIGN; MOVING OBJECTS; PRE-PROCESSING STEP; REAL-TIME APPLICATION; REGION OF INTEREST; REGION-OF-INTEREST (ROI); SAMPLING LINES; SIMPLE METHOD; TEMPORAL INFORMATION; USER ATTENTION; VIDEO DATA; VIDEO PROCESSING; VIDEO SEQUENCES; VISUAL RHYTHM;

COMPUTATIONAL COMPLEXITY; IMAGE CODING; MOTION ESTIMATION; MOTION PICTURE EXPERTS GROUP STANDARDS; VIDEO RECORDING; VISUAL COMMUNICATION;

FEATURE EXTRACTION;

EID: 68249112310     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2022822     Document Type: Article

References (27)

1. M. Soriano, B. Martinkauppi, S. Huovinen, and M. Laaksonen, "Skin detection in video under changing illumination conditions," in Proc. IEEE Int. Conf. Pattern Recognition, vol. 1. Barcelona, Spain, Sep. 2000, pp. 839-842.
2. M.-J. Chen, M.-C. Chi, C.-T. Hsu, and J.-W. Chen, "ROI video coding based on H.263+ with robust skin-color detection technique," IEEE Trans. Consumer Electron., vol. 49, no. 3, pp. 724-730, Aug. 2003.
3. P.-T. Pham-Ngoc and K.-H. Jo, "Color-based face detection using combination of modified local binary patterns and embedded hidden markov models," in Proc. Int. Joint Conf. SICE-ICASE, Busan, South Korea, Oct. 2006, pp. 5598-5603.
4. F. Tsalakanidou, S. Malassiotis, and M. G. Strintzis, "Face localization and authentication using color and depth images," IEEE Trans. Image Process., vol. 14, no. 2, pp. 152-168, Feb. 2005.
5. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
6. G. Agarwal, A. Anbu, and A. Sinha, "A fast algorithm to find the region-of-interest in the compressed mpeg domain," in Proc. IEEE Conf. Multimedia Expo, vol. 2. Jul. 2003, pp. 133-136.
7. C.-C. Ho, W.-H. Cheng, T.-J. Pan, and J.-L. Wu, "A user-attention based focus detection framework and its applications," in Proc. IEEE Int. Conf. Pacific-Rim Conf. Multimedia, vol. 3. Dec. 2003, pp. 1315-1319.
8. W.-H. Cheng, W.-T. Chu, J.-H. Kuo, and J.-L. Wu, "Automatic video region-of-interest determination based on user attention model," in Proc. IEEE Int. Symp. Circuits Syst., vol. 4. May 2005, pp. 3219-3222.
9. Y.-F. Ma, X.-S. Hua, L. Lu, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005.
10. Y. Liu, Z.-G. Li, Y.-C. Soh, and M.-H. Loke, "Conversational video communication of H.264/AVC with region-of-interest concern," in Proc. IEEE Int. Conf. Image Process., Atlanta, GA, Oct. 2006, pp. 3129-3132.
11. S.-H. Lee, J. Moon, and M. Lee, "A region-of-interest based image segmentation method using a biologically motivated selective attention model," in Proc. IEEE Int. Joint Conf. Neural Network., Vancouver, BC, Jul. 2006, pp. 1413-1420.
12. D.-D. Zhang, H.-Q. Lu, M.-Y. Duan, and Q. Zhao, "Automatic salient regions of interest extraction based on edge and region integration," in Proc. IEEE Int. Symp. Ind. Electron., vol. 1. Montreal, QC, Jul. 2006, pp. 620-623.
13. M. G. Chung, J. Lee, H. Kim, S. M.-H. Song, and W. M. Kim, "Automatic video segmentation based on spatio-temporal features," Korea Telecom. J., vol. 4, no. 1, pp. 4-14, Dec. 1999.
14. H. Kim, J. Lee, and S. M.-H. Song, "An efficient graphical shot verifier incorporating visual rhythm," in Proc. IEEE Int. Conf. Multimedia Comput. Syst., vol. 1. Florence, Italy, Jun. 1999, pp. 827-834.
15. S. J. F. Guimaraes, A. de Albuquerque Araujo, M. Couprie, and N. J. Leite, "An approach to detect video transitions based on mathematical morphology," in Proc. IEEE Int. Conf. Image Process., vol. 2. Sep. 2003, pp. 1021-1025.
16. S. J. F. Guimaraes, A. de Albuquerque Araujo, M. Couprie, and N. J. Leite, "Video fade detection by discrete line identification," in Proc. Int. Conf. Pattern Recognition, vol. 2. Aug. 2002, pp. 1013-1016.
17. F. N. Bezerra and N. J. Leite, "Video transition detection using string matching: Preliminary results," in Proc. Brazilian Symp. Comput. Graph. Image Process., Oct. 2003, pp. 339-346.
18. S. J. F. Guimaraes, A. de Albuquerque Araujo, M. Couprie, and N. J. Leite, "An approach to detect video transitions based on mathematical morphology," in Proc. IEEE Int. Conf. Image Process., vol. 2. 2003, pp. 1021-1024.
19. M.-C. Chi, C.-H. Yeh, M.-J. Chen, and C.-T. Hsu, "Robust region-of-interest determination based on user attention model through visual rhythm analysis," in Proc. IEEE Int. Conf. Comput. Commun. Netw., Aug. 2007, pp. 1143-1148.
20. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002.
21. N. Otsu, "A threshold selection method from gray level histograms," IEEE Trans. Syst., Man Cybern., vol. 9, no. 1, pp. 62-66, Mar. 1979.
22. N. Otsu, "An automatic threshold selection method based on discriminant and least squares criteria," Trans. IEICE Japan, vol. J63-D. no. 4, pp. 349-356, 1980.
23. M. Sezgin and B. Sankur, "Survey over image thresholding techniques and quantitative performance evaluation," J. Electron. Imaging, vol. 13, no. 1, pp. 146-165, Jan. 2004.
24. M.-C. Chi, C.-H. Yeh, M.-J. Chen, and J.-A. Jhu, "Region-of-interest video coding based on rate and distortion variations for H.263+," Signal Process.: Image Commun., vol. 23, no. 2, pp. 127-142, Feb. 2008.
25. S. Rao and N. Jayant, "Optimizing algorithms for region-of-interest video compression, with application to mobile telehealth," in Proc. IEEE Int. Conf. Multimedia Expo, Toronto, ON, Jul. 2006, pp. 513-516.
26. JM 13.2, ISO/IECMPEG and ITU-T VCEG Joint Video Team [Online]. Available: http://www//iphome.hhi.de/suehring/tml/
27. P.-H. Wu and H. H. Chen, "Frame-layer constant-quality rate control of regions of interest for multiple encoders with single video stream," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 7, pp. 857-867, Jul. 2007.