Bottom-up spatiotemporal visual attention model for video analysis

IET Image Processing

Volumn 1, Issue 2, 2007, Pages 237-248

  Rapantzikos, K ^a   Tsapatsoulis, N ^b   Avrithis, Y ^a   Kollias, S ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

^b UNIVERSITY OF CYPRUS   (Cyprus)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONTENT BASED RETRIEVAL; MATHEMATICAL MODELS; VIDEO SIGNAL PROCESSING;

COMPUTATIONAL VISUAL ATTENTION (VA); HUMAN VISUAL SYSTEM (HVS); SPATIOTEMPORAL VISUAL ATTENTION; VIDEO SEQUENCES;

IMAGE CODING;

EID: 34249885854     PISSN: 17519659     EISSN: None     Source Type: Journal    
DOI: 10.1049/iet-ipr:20060040     Document Type: Article

References (50)

1. Tsotsos, J.K., Culhane, S.M., Wai, W.Y.K., Lai, Y., Davis, N., and Nuflo, F.: ' Modeling visual attention via selective tuning ', Artif. Intell., 1995, 78, p. 507-545 10.1016/0004-3702(95)00025-9 0004-3702
2. Koch, C., and Ullman, S.: ' Shifts in selective visual attention: towards the underlying neural circuitry ', Hum. Neurobiol., 1985, 4, p. 219-227
3. Dickmanns, E.: ' Expectation-based dynamic scene understanding ', Blake, Yuille, Active vision, (MIT Press, Cambridge, MA, 1992), p. 303-335
4. Baluja, S., and Pomerleau, D.A.: ' Expectation-based selective attention for the visual monitoring and control of a robot vehicle ', Robot. Auton. Syst., 1997, 22, p. 329-344 0921-8890
5. Pashler, H.: ' Attention and performance ', Annu. Rev. Psychol., 2001, 52, p. 629-651
6. Rutishauer, U., Walther, D., Koch, C., and Perona, P.: ' Is bottom-up attention useful for object recognition? ', CVPR'04, July, 2004, p. 37-44
7. Torralba, A.: ' Contextual priming for object detection ', Int. J. Comput. Vis., 2003, 53, (2), p. 169-191 0920-5691
8. Rapantzikos, K., and Tsapatsoulis, N.: ' Enhancing the robustness of skin-based face detection schemes through a visual attention architecture ', Proc. of the IEEE International Conf. on Image Processing (ICIP), September, 2005, Genova, Italy
9. Horn, B., and Shunck, B.: ' Determining optical flow ', Artif. Intell., 1981, 17, p. 185-203 0004-3702
10. Barron, J.L., Fleet, D.J., and Beauchemin, S.S.: ' Systems and experiment performance of optical flow techniques ', Int. J. Comput. Vis., 1994, 12, p. 43-77 10.1007/BF01420984 0920-5691
11. Adelson, E.H., and Bergen, J.: ' Spatiotemporal energy models for the perception of motion ', J. Opt. Soc. Am., 1985, 2, (2), p. 284-299 0030-3941
12. Bolles, C.R., and Baker, H.H.: ' Generalizing epipolar-plane image analysis on the spatio-temporal surface ', Int. J. Comput. Vis., 1989, 3, p. 33-49 0920-5691
13. Bolles, C.R., Baker, H.H., and Mariont, D.H.: ' Epipolar-plane image analysis: An approach to determining structure from motion ', Int. J. Comput. Vis., 1987, 1, p. 7-55 10.1007/BF00128525 0920-5691
14. Liu, F., and Picard, R.W.: ' Finding periodicity in space and time ', Proc. IEEE Int. Conf. Comput. Vis., 1998, p. 376-383
15. Joly, P., and Kim, H.K.: ' Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images ', Signal Process. Image Commun., 1996, 8, p. 295-307 0923-5965
16. Jähne, B.: ' Spatio-temporal image processing: theory and scientific applications ', (Springer-Verlag, New York, 1991)
17. Ngo, C.-W., Pong, T.-C., and Zhang, H.-J.: ' Motion analysis and segmentation through spatio-temporal slices processing ', IEEE Trans. Image Process., 2003, 12, (3), p. 341-355 1057-7149
18. Porikli, F., and Wang, Y.: ' Automatic video object segmentation using volume growing and hierarchical clustering ', EURASIP J. Appl. Signal Process., 2004, (6), p. 814-832 1110-8657
19. Sarkar, S., Majchrzak, D., and Korimilli, K.: ' Perceptual organization based computational model for robust segmentation of moving objects ', Comput. Vis. Image Underst., 2002, 86, (3), p. 141-170 1077-3142
20. Mikolajczyk, K., and Schmid, C.: ' Scale and affine invariant interest point detectors ', Int. J. Comput. Vis., 2004, 60, (1), p. 63-86 10.1023/B:VISI.0000027790.02288.f2 0920-5691
21. Moenne-Loccoz, N., Bruno, E., and Marchand-Maillet, S.: ' Knowledge-based detection of events in video streams from salient regions of activity ', Pattern Anal. Appl., 2004, 7, (4), p. 422-429 1433-7541
22. Brandley, P.A., and Stentiford, M.W.: ' Visual attention for region of interest coding in JPEG 2000 ', J. Vis. Commun. Image Represent., 2003, 14, p. 232-250 1047-3203
23. Vetro, A., Sun, H., and Wang, Y.: ' MPEG-4 rate control for multiple video objects ', IEEE Trans. Circuits Syst. Video Technol., 1999, 9, p. 186-199 10.1109/76.744285 1051-8215
24. Martins, F.C., Ding, W., and Feig, E.: ' Joint control of spatial quantization and temporal sampling for very low bit rate video ', Proc. ICASSP, May, 1997, p. 2072-2075
25. Lee, J.-W., Vetro, A., Wang, Y., and Ho, Y.-S.: ' Bit allocation for MPEG-4 video coding with spatio-temporal tradeoffs ', IEEE Trans. Circuits Syst. Video Technol., 2003, 13, (6), p. 488-502 10.1109/TCSVT.2003.813421 1051-8215
26. Itti, L., and Koch, C.: ' A saliency-based search mechanism for overt and covert shifts of visual attention ', Vis. Res., 2000, 40, p. 1489-1506 10.1016/S0042-6989(99)00163-7 0042-6989
27. Itti, L., Koch, C., and Niebur, E.: ' A model of saliency-based visual attention for rapid scene analysis ', IEEE Trans. Pattern Anal. Mach. Intell., 1998, 20, (11), p. 1254-1259 10.1109/34.730558 0162-8828
28. Niebur, E., and Koch, C.: ' Computational architectures for attention ', Parasuraman, R., The attentive brain, (MIT Press, Cambridge, MA, 1998), 9, p. 163-186
29. Rapantzikos, K., Tsapatsoulis, N., and Avrithis, Y.: ' Spatiotemporal visual attention architecture for video analysis ', Proc. IEEE Int. Workshop On Multimedia Signal Processing (MMSP'04), 2004, p. 83-86
30. Patel, N.V., and Sethi, I.K.: ' Video shot detection and characterization for video databases ', Pattern Recognit., 1997, 30, (4), p. 583-592 10.1016/S0031-3203(96)00114-8 0031-3203
31. Crespo, J., Scaher, W.R., Serra, J., Gratin, C., and Meyer, F.: ' The flat zone approach: A general low-level region merging segmentation method ', Signal Process., 1997, 62, p. 37-60 10.1016/S0165-1684(97)00114-X 0165-1684
32. Maragos, P.: ' Noise suppression, ', Madisetti, V.K., Williams, D.B., The digital signal processing handbook, (CRC Press, 1998), 74, p. 20-21
33. Salembier, P., and Serra, J.: ' Flat zones filtering, connected operators, and filters by reconstruction ', IEEE Trans. Image Process., 1995, 4, (8), p. 1153-1160 10.1109/83.403422 1057-7149
34. Burt, P.J., and Adelson, E.H.: ' The Laplacian pyramid as a compact image code ', IEEE Trans. Commun., 1983, 31, p. 532-540 10.1109/TCOM.1983.1095851 0090-6778
35. Kaiser, P.K., and Boynton, R.M.: ' Human color vision ', 2nd (Optical Society of America, Washington, DC, 1996)
36. Treisman, A.M., and Gelade, G.: ' A feature integration theory of attention ', Cognit. Psychol., 1980, 12, (1), p. 97-136
37. Freeman, W.T., and Adelson, E.H.: ' The design and use of steerable filters ', IEEE Trans. Pattern Anal. Mach. Intell., 1991, 13, (9), p. 891-906 10.1109/34.93808 0162-8828
38. Watanabe, T., Sasaki, Y., Miyauchi, S., Putz, B., Fujimaki, N., Nielsen, M., Takino, R., and Miyakawa, S.: ' Attention-regulated activity in human primary visual cortex ', J. Neurophysiol., 1998, 79, p. 2218-2221
39. Rapantzikos, K., and Tsapatsoulis, N.: ' On the implementation of visual attention architectures ', Tales of the disappearing computer, Santorini, 2003, June)
40. Huang, C.L., and Chen, Y.T.: ' Motion estimation method using a 3D steerable filter ', Image Vis. Comput., 1995, 13, p. 21-32 10.1016/0262-8856(95) 91465-P
41. Yu, W., Sommer, G., and Daniilidis, K.: ' Three dimensional orientation signatures with conic kernel ', Image Vis. Comput., 2003, 21, (5), p. 447-458 10.1016/S0262-8856(03)00012-X
42. http://homepages.inf.ed.ac.uk/rbf/CAVIAR/EC Funded CAVIAR project/IST 2001 37540
43. Itti, L., and Baldi, P.: ' A principled approach to detecting surprising events in video ', Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June, 2005, p. 631-637
44. Black, M.J., and Anan, P.: ' The robust estimation of multiple motions: parametric and piecewise-smooth flow fields ', Comput. Vis. Image Underst., 1996, 63, (1), p. 75-104 1077-3142
45. Otsu, N.: ' A thresholding selection method from gray-scale histogram ', IEEE Trans. Syst. Man Cybernet., 1979, 9, p. 62-66 0018-9472
46. Serra, J.: ' Image analysis and mathematical morphology ', (Academic Press, New York, 1982)
47. Tsechpenakis, G., Rapantzikos, K., Tsapatsoulis, N., and Kollias, S.: ' A snake model for object tracking in natural sequences ', Signal Process. Image Commun., 2004, 19, (3), p. 219-238 10.1016/j.image.2003.07.002 0923-5965
48. Pardàs, M., and Sayrol, E.: ' Motion estimation based tracking of active contours ', Pattern Recognit. Lett., 2001, 22, p. 1447-1456 0167-8655
49. Peterfreund, N.: ' Robust tracking of position and velocity with Kalman snakes ', IEEE Trans. Pattern Anal. Mach. Intell., 1999, 21, (6), p. 564-569 10.1109/34.771328 0162-8828
50. http://www.cs.brown.edu/people/black/regression.html