Foveated shot detection for video segmentation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 15, Issue 3, 2005, Pages 365-377

  Boccignone, Giuseppe ^a   Chianese, Angelo ^b   Moscato, Vincenzo ^b   Picariello, Antonio ^b  

^a UNIVERSITY OF SALERNO   (Italy)

^b UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

Attentive vision; Dissolves; Hard cuts; Shot detection; Video segmentation

Indexed keywords

BOUNDARY CONDITIONS; CAMERAS; DATA ACQUISITION; IMAGE CODING; MOTION PICTURE EDITING MACHINES; SHOT NOISE;

ATTENTIVE VISION; DISSOLVES; HARD CUTS; SHOT DETECTION; VIDEO SEGMENTATION;

IMAGE SEGMENTATION;

EID: 15244354796     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2004.842603     Document Type: Article

References (64)

1. B. Adams, C. Breazeal, R. A. Brooks, and B. Scassellati, "Humanoid robots: A new kind of tool," IEEE Intell. Syst. Mag., vol. 15, no. 4, pp. 25-31, Jul.-Aug. 2000.
2. S. Antani, R. Kasturi, and R. Jain, "A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video," Pattern Recogn., vol. 35, pp. 945-965, 2002.
3. G. Backer, B. Mertshing, and M. Bollmann, "Data and model-driven gaze control for an active-vision system," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 12, pp. 1415-1429, Dec. 2001.
4. M. Barnden and J. A. Srinivas, "Temporal winner-take-all networks: A time-based mechanism for fast selection in neural networks," IEEE Trans. Neural Netw., vol. 4, no. 5, pp. 844-853, Sep. 1993.
5. A. Berthoz, Le sens du mouvement, O. Jacob, Ed., 1997.
6. G. Boccignone and M. Ferraro, "Gaze shift as a constrained random walk," Physica A, vol. 331, pp. 207-218, 2004.
7. D. Broadbent, Perception and Communication. New York: Pergamon, 1958.
8. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-9, no. 4, pp. 532-540, Apr. 1983.
9. P. J. Burt, "A pyramid-based front-end processor for dynamic vision applications," Proc. IEEE, vol. 90, no. 7, pp. 1188-1200, Jul. 2002.
10. D. A. Chernyak and L. W. Stark, "TopDown guided eye movements," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 31, no. 4, pp. 514-522, Aug. 2001.
11. J. Denzler and C. M. Brown, "Information theoretic sensor data selection for active object recognition and state estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 2, pp. 145-157, Feb. 2002.
12. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York: Wiley, 2001.
13. W. A. C. Fernando, C. N. Canagarjah, and D. R. Bull, "Fade and dissolve detection in uncompressed and compressed video sequences," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 1999, pp. 299-303.
14. M. Ferraro, G. Boccignone, and T. Caelli, "Entropy-based representation of image information," Pattern Recogn. Lett., vol. 23, pp. 1391-1398, 2002.
15. B. Furht, S. W. Smoliar, and H. Zhang, Video and Image Processing in Multimedia Systems. Norwell, MA: Kluwer, 1995.
16. U. Gargi, R. Kasturi, and S. H. Strayer, "Performance characterization of video-shot change detection methods," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 1-13, Jan. 2000.
17. G. J. Giefing, H. Janssen, and H. Mallot, "Saccadic object recognition with an active vision system," in Proc. 10th Eur. Conf. Artificial Intelligence, 1992, pp. 803-805.
18. M. A. Goodale and G. K. Humphrey, "The objects of action and perception," Cognition, vol. 67, pp. 181-207, 1998.
19. H. Greenspan, S. Belongie, P. Perona, S. Rakshit, and C. H. Anderson, "Overcomplete steerable pyramid filters and rotation invariance," in Proc. IEEE Computer Vision and Pattern Recognition, Seattle, WA, 1994, pp. 222-228.
20. A. Hampapur, R. Jain, and T. Weymouth, "Digital video segmentation," in Proc. ACM Multimedia'94, 1994, pp. 357-364.
21. A. Hanjalic, "Shot-boundary detection: unraveled and resolved?" IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 1, pp. 90-105, Jan. 2002.
22. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, pp. 1254-1259, 1998.
23. L. Itti and C. Koch, "Computational modeling of visual attention," Nature Rev., vol. 2, pp. 1-11, 2001.
24. T. Kikukawa and S. Kawafuchi, "Development of an automatic summary editing system for the audio visual resources," Trans. Inst. Electron., Inform., Commun. Eng., vol. J75-A, no. 2, pp. 204-212, 1992.
25. G. Krieger, I. Rentschler, G. Hauske, K. Schill, and C. Zetsche, "Object and scene analysis by saccadic eye-movements: An investigation with higher order statistics," Spat. Vis., vol. 13, pp. 201-214, 2000.
26. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001.
27. D. Li and H. Lu, "Model based video segmentation," IEEE Trans. Circuits Syst. Video Technol., vol. 5, no. 5, pp. 533-544, May 1995.
28. R. Lienhart, "Reliable transition detection in videos: a survey and practicioner's guide," Int. J. Image Graph., vol. 1, no. 3, pp. 469-486, 2001.
29. _, "Comparison of automatic shot boundary detection algorithms," in Proc. of SPIE 3656-29 Image and Video Processing, vol. VII, 1999, pp. 1-12.
30. _, "Reliable dissolve detection," in Proc. SPIE 4315, 2001, pp. 219-230.
31. T. M. Liu, H. J. Zhang, and F. H. Qi, "A novel video key frame extraction algorithm," in Proc. IEEE Int. Symp. Circuits and Systems, vol. 4, 2002, pp. 149-152.
32. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.
33. R. Milanese, S. Gil, and T. Pun, "Attentive mechanisms for dynamic and static scene analysis," Opt. Eng., vol. 34, pp. 2428-2434, 1995.
34. A. Nagasaka and Y. Tanaka, "Automatic video indexing and full-videosearch for object appearances," Visual Database Systems II, pp. 113-127, 1995.
35. W. W. Nelson and G. R. Loftus, "The functional visual field during picture viewing," J. Exp. Psych., Human Learn. Mem., vol. 6, pp. 391-399, 1980.
36. E. Niebur and C. Koch, Computational Architectures for Attention. Cambridge, MA: MIT Press, 1998.
37. D. Noton and L. Stark, "Scanpaths in saccadic eye movements while viewing and recognising patterns," Vis. Res., vol. 11, pp. 929-942, 1971.
38. K. O'Regan, "Solving the 'real' mysteries of visual perception: the world as an outside memory," Canad. J. Psychol., vol. 46, no. 3, pp. 461-488, 1992.
39. K. Otsuji, Y. Tonomura, and Y. Ohba, "Video browsing using brightness data," in Proc. SPIE-IST VCIP'91, vol. 1606, 1991, pp. 980-989.
40. D. Parkhurst, K. Law, and E. Niebur, "Modeling the role of salience in the allocation of overt visual attention," Vis. Res., vol. 42, pp. 107-123, 2002.
41. I. Pitas and A. N. Venetsanopoulos, Non-Linear Filters. Norwell, MA: Kluwer, 1989.
42. C. M. Privitera and L. W. Stark, "Algorithms for defining visual regions-of-interest: comparison with eye fixations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 970-982, Sep. 2000.
43. Y. Qi, A. Hauptmann, and T. Liu, "Supervised classification for video shot segmentation," in Proc. IEEE Conf. Multimedia Expo (ICME03), vol. 2, 2003, pp. 689-692.
44. R. P. N. Rao and D. H. Ballard, "Dynamic model of visual recognition predicts neural response properties in the visual cortex," Neur. Comp., vol. 9, pp. 721-763, 1997.
45. R. P. N. Rao, "An optimal estimation approach to visual perception and learning," Vis. Res., vol. 39, pp. 1963-1989, 1999.
46. R. A. Rensink, J. K. O'Regan, and J. J. Clark, "To see or not to see: The need for attention to perceive changes in scenes," Psych. Sci., vol. 8, pp. 368-373, 1997.
47. W. Richards, A. Jepson, and J. Feldman, "Priors, preferences and categorical percepts," in Perception as Bayesian Inference, D. C. Knill and W. Richards, Eds. Cambridge, U.K.: Cambridge Univ. Press, 1996, pp. 93-122.
48. R. D. Rimey and C. M. Brown, "Controlling eye movements with hidden Markov models," Int. J. Comput. Vis., vol. 7, pp. 47-65, 1991.
49. K. Schill, E. Umkehrer, S. Beinlich, G. Krieger, and C. Zetzsche, "Scene analysis with saccadic eye movements: top-down and bottom-up modeling," J. Electron. Imag. - Spec. Issue. Human Vision Elect. Imag., vol. 10, no. 1, pp. 152-160, Jan. 2001.
50. B. Shahraray, "Scene change detection and content-based sampling of video sequences," in Proc. 1st SPIE, vol. 2419, Feb. 1995, pp. 2-13.
51. D. J. Simons and D. T. Levin, "Change blindess," Trends Cogn. Sci., no. 7, pp. 261-267, 1997.
52. E. A. Styles, The Psychology of Attention. Hove, U.K.: Psychology Press, 1997.
53. M. J. Swain and D. H. Ballard, "Color indexing," Int. J. Comput. Vision, vol. 7, no. 1, pp. 11-32, 1991.
54. J. K. Tsotsos et al., "Modeling visual-attention via selective tuning," Art. Intell., vol. 78, pp. 507-545, 1995.
55. A. M. Tekalp, Digital Video Processing. Upper Saddle River, NJ: Prentice-Hall, 1995.
56. S. Thorpe, A. Delorme, and R. Van Rullen, "Spike-based strategies for rapid processing," Neural Netw., vol. 14, pp. 715-725, 2001.
57. B. T. Truong, C. Dorai, and S. Venkatesk, "New enhancements to cut, fade, and dissolve detection processes in video segmentation," ACM Multimedia, pp. 219-227, 2000.
58. N. Vasconcelos and A. Lippman, "Statistical models of video structure for content analysis and characterization," IEEE Trans. Image Process., vol. 9, no. 1, pp. 3-19, Jan 200.
59. G. J. Walker-Smith, A. G. Gale, and J. M. Findlay, "Eye movement strategies involved in face perception," Perception, vol. 6, pp. 313-326, 1977.
60. A. L. Yarbus, Eye Movements and Vision. New York: Plenum, 1967.
61. B.-L. Yeo and B. Liu, "Rapid scene analysis on compressed video," IEEE Trans. Circuits Syst. Video Technol., vol. 5, no. 12, pp. 533-544, Dec. 1995.
62. A. L. Yuille and H. H. Bulthoff, "Bayesian decision theory and psychophysics," in Perception as Bayesian Inference, D. C. Knill and W. Richards, Eds. Cambridge, U.K.: Cambridge Univ. Press, 1996, pp. 123-162.
63. R. Zabih, J. Miller, and K. Mai, "A feature-based algorith, for detecting and classifying scene breaks," in Proc. ACM Int. Conf. Multimedia, 1995, pp. 189-200.
64. H. Zhang, A. Kankanhalli, and S. W. Smoliar, "Automatic partitioning of full-motion video," Multimedia Syst., vol. 1, pp. 10-28, 1993.