A rule based technique for extraction of visual attention regions based on real-time clustering

IEEE Transactions on Multimedia

Volumn 9, Issue 4, 2007, Pages 766-784

  Yu, Zhiwen ^a,b   Wong, Hau San ^a,b  

^a IEEE   (Hong Kong)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Clustering; Knowledge extraction; Real time processing; Visual attention regions; Visualization

Indexed keywords

KNOWLEDGE EXTRACTION; REAL TIME CLUSTERING; REAL TIME PROCESSING; SEMANTIC GAP; VISUAL ATTENTION REGIONS (VAR);

CLUSTERING ALGORITHMS; DATA VISUALIZATION; FEATURE EXTRACTION; MULTIMEDIA SYSTEMS; REAL TIME SYSTEMS; SEMANTICS;

IMAGE ANALYSIS;

EID: 34249320885     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.893351     Document Type: Article

References (49)

1. Y. Hu, D. Rajan, and L.-T. Chia, "Robust subspace analysis for detecting visual attention regions in images," in ACM Multimedia 2005, 2005, pp. 716-724.
2. U. Rutishauser, D. Walther, C. Koch, and P. Perona, "Is bottom-up attention useful for object recognition?," in Proc. 2004 IEEE Comput. Soc. Conf. Computer Vision and Pattern Recognition, Washington, DC, Jul. 2004, vol. 2, pp. 37-44.
3. Y.-F. Ma and H. J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in ACM Multimedia 2003, 2003, pp. 374-381.
4. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
5. A. P. Bradley and F. W. Stentiford, "Visual attention for region of interest coding in jpeg2000," J. Vis. Commun. Image Represent., vol. 14, no. 3, pp. 232-250, Sep. 2003.
6. Y. Hu, X. Xie, Z. Chen, and W.-Y. Ma, "Attention model based progressive image transmission," in ICME 2004, 2004, pp. 1079-1082.
7. Y. Hu, L.-T. Chia, and D. Rajan, "Region-of-interest based image resolution adaptation for mpeg-21 digital item," in Proc. 12th Annu. ACM Im. Conf. Multimedia, New York, 2004, pp. 340-343.
8. K. Cheoi and Y. Lee, "Detecting perceptually important regions in an image based on human visual attention characteristic," in SSPR/SPR 2002, 2002, pp. 329-338.
9. J. Bormans and K. Hill, "MPEG-21 overview V.5," ISO/IEC JTC1/SC29/WG11/N5231 Oct. 2002.
10. A. Vetro and C. Timmerer, "ISO/IEC 21000-7 FCD - Part 7: Digital item adaptation," ISO/IEC JTC 1/SC 29/WG 11/N5845 Jul. 2003.
11. D. Mukherjee, G. Kuo, S. Liu, and G. Beretta, "Motivation and use cases for decision-wise BSDLink, and a proposal for usage environment descriptor-adaptationQoSLinking," ISO/IEC JTC 1/SC 29/WG 11 Hewlett Packard Laboratories, Apr. 2003.
12. G. Panis, A. Hutter, J. Heuer, H. Hellwagner, H. Kosch, C. Timmerer, S. Devillers, and M. Amielh, "Bitstream syntax description: A tool for multimedia resource adaptation within MPEG-21," Signal Process.: Image Commun., vol. 18, no. 8, pp. 721-747, 2003.
13. Y.-Y. Lin, T.-L. Liu, and H.-T. Chen, "Semantic manifold learning for image retrieval," in ACM Multimedia 2005, 2005, pp. 249-258.
14. K.-S. Goh, E. Y. Chang, and W.-C. Lai, "Multimodal concept-dependent active learning for image retrieval," in ACM Multimedia 2004, 2004, pp. 564-571.
15. C.-H. Hoi and M. R. Lyu, "A novel log-based relevance feedback technique in content-based image retrieval," in ACM Multimedia 2004, 2004, pp. 24-31.
16. W. James, The Principles of Psychology. Cambridge, MA: Harvard Univ. Press, 1890.
17. D. E. Broadbent, Perception and Communication. Oxford, U.K.: Pergamon, 1958.
18. J. Deutsch and D. Deutsch, "Attention: Some theoretical considerations," Psychol. Rev., vol. 70, pp. 80-90, 1963.
19. S. Ahmad, "VISIT: A neural model of covert attention," in Advances in Neural Information Processing Systems. San Mateo, CA: Morgan Kaufmann, 1991, vol. 4, pp. 420-427.
20. Y. Li, Y. F. Ma, and H. J. Zhang, "Salient region detection and tracking in video," in Proc. IEEE Int. Conf. Multimedia & Expo 2003, Jul. 2003, vol. 2, pp. 72-75.
21. T. Kanungo, D. M. Mount, and N. S. Netanyahu et al., "An efficient K-means clustering algorithm: Analysis and implementation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 881-892, Jul. 2002.
22. M.-C. Su and C.-H. Chou, "A modified version of the K-means algorithm with a distance based on cluster symmetry," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 674-680, Jun. 2001.
23. S. P. Lloyd, "A least squares quantization in PCM," IEEE Trans. Inform. Theory, vol. IT-28, pp. 129-137, 1982.
24. K. Lee, H. S. Chang, S. S. Chun, L. Choi, and S. Sull, "Perception based image transcoding for universal multimedia access," in Proc. 8th Int. Conf. Image Processing (ICIP-2001), Thessaloniki, Greece, Oct. 2001, vol. 2, pp. 475-478.
25. S. Lazebnik, C. Schmid, and J. Ponce, "A maximum entropy frame-work for part-based texture and object recognition," in Proc. IEEE Int. Conf. Computer Vision, Beijing, China, Oct. 2005, vol. 1, pp. 832-838.
26. _, "Semi-local affine parts for object recognition," in Proc. British Machine Vision Conf., Sep. 2004, vol. 2, pp. 959-968.
27. A. Treisman and S. Gormican, "Feature analysis in early vision: Evidence from search asymmetries," Psychol. Rev., vol. 95, pp. 15-48, 1988.
28. F. Crick and C. Koch, "Some reflections on visual awareness," in Proc. Cold Spring Harbor Symp. Quantitative Biology, 1990, vol. 55, pp. 953-962.
29. J. M. Wolfe and K. R. Cave, "Deploying visual attention," in The Guided Search Model, A. Blake and T. Troscianko, Eds. New York: Wiley, 1990, ch. 4, pp. 79-103, AI and the Eye.
30. A. Treisman, "Perception of features and objects," in Visual Attention. New York: Oxford Univ. Press, 1998.
31. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Human Neurobiol., vol. 4, pp. 219-227, 1985.
32. J. K. Tsotsos, S. M. Culhane, and W. Y. K. Wai et al., "Modeling visual attention via selective tuning," Artif. l Intell., vol. 78, pp. 507-545, 1995.
33. E. Niebur and C. Koch, "Computational architectures for attention," in The Attentive Brain, R. Parasuraman, Ed. Cambridge, MA: MIT Press, 1998, pp. 163-186.
34. S. Baluja and D. A. Pomerleau, "Expectation-based selective attention dor visual monitoring and control of a robot vehicle," Robot. Auton. Syst., vol. 22, no. 3-4, pp. 329-344, Dec. 1997.
35. S. Kim, Y. Tak, Y. Nam, and E. Hwang, "CLOVER: Mobile content-based leaf image retrieval system," in ACM Multimedia 2005, 2005, pp. 215-216.
36. C. Yang, M. Dong, and F. Fotouhi, "Semantic feedback for interactive image retrieval," in ACM Multimedia 2005, 2005, pp. 415-418.
37. F. Jing, M. J. Li, H. J. Zhang, and B. Zhang, "An efficient and effective region-based image retrieval framework," IEEE Trans. Image Process., vol. 13, no. 5, pp. 699-709, 2002.
38. L. Q. Chen, X. Xie, X. Fan, W. Y. Ma, H. J. Zhang, and H. Q. Zhou, "A visual attention model for adapting images on small displays," ACM Multimedia Syst. J., vol. 9, no. 4, pp. 353-364, 2003.
39. D. Walther, U. Rutishauser, C. Koch, and P. Perona, "On the usefulness of attention for object recognition," in 2nd International Workshop on Attention and Performance in Computational Vision 2004, Prague, Czech Republic, May 2004, pp. 96-103.
40. _, "Selective visual attention enables learning and recognition of multiple objects in cluttered scenes," Comput. Vis. Image Understand., pp. 745-770, 2005.
41. A. Bamidele, F. W. Stentiford, and J. Morphett, "An attention-based approach to content based image retrieval," Brit. Telecommun. Adv. Res. Technol. J. Intell. Spaces (Perv. Comput.), vol. 22, no. 3, pp. 151-160, Jul 2004.
42. S. Paek and J. R. Smith, "Detecting image purpose in world-wide web documents," in Proc. SPIEIS&T Photonics West, Document Recognition, Jan. 1998, vol. 3305, pp. 151-158.
43. R. Mohan, J. R. Smith, and C.-S. Li, "Adapting multimedia internet content for universal access," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 104-114, Mar. 1999.
44. J. R. Smith, R. Mohan, and C.-S. Li, "Content-based transcoding of images in the internet," in Proc. IEEE Int. Conf. on Image Processing, Oct. 1998, vol. 3, pp. 7-11.
45. C.-S. Li, R. Mohan, and J. R. Smith, "Multimedia content description in the InfoPyramid," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, May 1998, vol. 6, pp. 3789-3792.
46. K. Lee, H. S. Chang, S. S. Chun, and H. Choi, "Perception-based image transcoding for universal multimedia access," IEEE Trans. Image Process., vol. 2, pp. 475-478, 2001.
47. D. L. Davies and D. W. Bouldin, "A cluster separation measure," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-1, no. 4, pp. 224-227, 1979.
48. H. J. A. M. Heijmans, "Connected morphological operators for binary images," Comput. Vis. Image Understand., vol. 73, no. 1, pp. 99-120, 1999.
49. _, Morphological Image Operators. Boston, MA: Academic, 1994.