Predictive real-time perceptual compression based on eye-gaze-position analysis

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 4, Issue 3, 2008, Pages

  Komogortsev, Oleg V ^a,c   Khan, Javed I ^b  

^a TEXAS STATE UNIVERSITY   (United States)

^b KENT STATE UNIVERSITY   (United States)

^c Texas State University   (United States)

Author keywords

Human visual system; Real time multimedia compression

Indexed keywords

FEED BACK LOOPS; HUMAN VISUAL SYSTEM; MULTIMEDIA COMPRESSION; NETWORK COMMUNICATIONS; PERCEPTUAL COMPRESSION; POSITION ANALYSIS; REAL-TIME MULTIMEDIA COMPRESSION;

DATA COMPRESSION; TOPOLOGY; VIDEO SIGNAL PROCESSING;

MULTIMEDIA SYSTEMS;

EID: 52949094227     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/1386109.1386116     Document Type: Article

References (27)

1. ASL. 2001. Eyenal (Eye-Analysis) software Manual Windows version for use with ASL Series 5000 and ETS-PC Eye Tracking Systems. Applied Science Group, Inc.
2. BABCOCK, J. S., PELZ, J. B., AND FAIRCHILD, M. D. 2003. Eye tracking observers during color image evaluation tasks. In Proceedings of SPIE 5007, 218-230.
3. BERGSTROM, P. 2003. Eye movement controlled image coding. RhD dissertation. Electrical Engineering, Linkoping University, Linkoping, Sweden.
4. CARMY, R. AND ITTI, L. 2006. Casual saliency effects during natural vision. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 1-18.
5. GORMEN, T., LEISERSON, C., AND RIVEST, R. 1990. Introduction to Algorithms. MIT Press/McGraw-Hill, Cambridge, MA.
6. DALY, S. 1998. Engineering observations from spatiovelocity and spatiotemporal visual models. In Proceedings of SPIE 3299, 180-191.
7. DALY, S., MATTHEWS, K., AND RIBAS-CORBERA, J. 2001. As plain as the noise on your face: Adaptive video compression using face detection and visual eccentricity models. J. Electron. Imag. 10, 1, 30-46.
8. DUCHOWSKI, A. T. 2000. Acuity-matching resolution degradation through wavelet coefficient scaling. IEEE Trans. Image Process. 9, 8, 1437-1440.
9. DUCHOWSKI, A. T. 2003. Eye Tracking Methodology: Theory and Practice. Springer-Verlag, London, U.K.
10. DUCHOWSKI, A. T. AND MCCORMICK, B. H. 1995. Preattentive considerations for gaze-contingent image processing. In Proceedings of SPIE 2411, 128-139.
11. DUCHOWSKI, A. T. AND MURPHY, H. 2001. Gaze-contingent level of detail rendering. In Proceedings of EuroGraphics. EuroGraphics Association.
12. GEISLER, W. S. AND PERRY, J. S. 1998. Real-time foveated multiresolution system for low-bandwidth video communication. In Proceedings of SPIE 3299, 294-305.
13. IRWIN, D. 1992. Visual memory within and across fixations. In Eye Movements and Visual Cognition (Springer Series in Neuropsychology), K. Raymer, Ed. Springer-Verlag, New York, 146-165.
14. KHAN J. I., YANG, S. S., PATEL, D., KOMOGORTSEV, O., OH, W., GUO, Z., GU, Q., AND MAIL, R 2002. Resource adaptive netcentric systems on active network: A self-organizing video stream that automorphs itself while in transit via a quasi-active network. In Proceedings of the 2002 DARPA Active Networks Conference and Exposition (DANCE'02). IEEE Computer Society Press, Los Alamitos, CA, 409-426.
15. KHAN, J. AND KOMOGORTSEV, O. V. 2006. A hybrid scheme for perceptual object window design with joint scene analysis and eye-gaze tracking for media encoding based on perceptual attention. J. Electron. Imag. 15, 2, 023018-01-023018-12.
16. KOMOGORTSEV, O. 2007. Perceptual Test Video Set. Retrieved November 5, 2007, from http://www.cs.txstate.edu/~ok11/videosetpercept.htm
17. KOMOGORTSEV, O. V. AND KHAN, J. 2006. Perceptual attention focus prediction for multiple viewers in case of multimedia perceptual compression with feedback delay. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 101-108.
18. KOMOGORTSEV, O. V. AND KHAN, J. 2004. Predictive perceptual compression for real time video communication. In Proceedings of the 12th ACM International conference on Multimedia (ACM MM 04). ACM, New York, 220-227.
19. KORTUM, P. AND GEISLER, W. 1996. Implementation of a foveated image coding system for image bandwidth reduction. In Proceedings of SPIE 2657, 350-360.
20. KUYEL, T., GEISLER, W., AND GHOSH, J. 1998. Retinally reconstructed images (RRIs): Digital images having a resolution match with the human eye. In Proceedings of SPIE 3299, 603-614.
21. LEE, S., PATTICHIS, M., AND BOVOK, A. 2001. Foveated video compression with optimal rate control. IEEE Trans. Image Process., 10, 7, 977-992.
22. PETERS, R. AND ITTI, L., 2006. Computational mechanism for gaze direction in interactive visual environments. In Proceedings of Symposium on Eye Tracking Research and Applications (ETRA), 27-32.
23. SHEBILSKE, W. L. AND FISHER, D. F. 1983. Understanding extended discourse through the eyes: How and why. In Eye Movements and Psychological Functions: International Views, R. Groner, C. Menz, D. Fisher, and R. Monty, Eds. Lawrence Erlbaum Associates, Hillsdale, NJ, 303-314.
24. STELMACH, L. B. AND TAM, W. J. 1994. Processing image sequences based on eye movements. In Proceedings of SPIE 2179, 90-98.
25. TOBII. 2006. Tobii Eye Tracker ClearView analysis software. User Manual. Tobii technology.
26. YANOFF, M. AND DURKER, J. 1999. Ophthalmology. Mosby International Ltd.
27. YARBUS, L. 1967. Eye movements and vision. Institute for Problems of Information Transmission Academy of Sciences of the USSR, Moscow, USSR.