Event-based media organization and indexing

Infocommunications Journal

Volumn 3, Issue 3, 2011, Pages 9-18

  Mattivi, Riccardo ^a   Boato, Giulia ^a   De Natale, Francesco G B ^a  

^a UNIVERSITY OF TRENTO   (Italy)

Author keywords

Events and sub events recognition; Multimedia retrieval; Photo collection organization

Indexed keywords

AUTOMATIC TOOLS; EVENT STRUCTURES; EVENT-BASED; EVENTS AND SUB-EVENTS RECOGNITION; MEDIA INDEXING; MULTIMEDIA RETRIEVAL; PERSONAL MEDIA; PHOTO COLLECTIONS; REPRESENTATION OF EVENTS;

EID: 84857318854     PISSN: 20612079     EISSN: 20612125     Source Type: Journal    
DOI: None     Document Type: Review

References (53)

1. J. M. Zacks, T. S. Braver, M. A. Sheridan, D. I. Donaldson, A. Z. Snyder, J. M. Oinger, R. L. Buckner, M. E. Raichl, "Human brain activity time-locked to perceptual event boundaries," Nature neuroscience, vol. 4, n. 6, pp. 651-655, Jim. 2001. (Pubitemid 32507380)
2. C. Faloutsos, R. Barber, M. Flickner, J. Hafne, W. Niblack, D. Petkovic, W. Equitz, "Efficient and effective querying by image content," Journal on Intelligent Information Systems, vol. 3, pp. 3-4, Jill. 1994.
3. R. Aibing, R. K. Srihari, Z. Zhongfe, "Spatial color histograms for content-based image retrieval," IEEE Conference on Tools with Artificial intelligence 1999, pp. 183-186, 1999.
4. C. Schmid, R. Mohr, C. Banckhage. "Evaluation of Interest Point Detectors," International Journal on Computer Vision, vol. 37, n. 2, pp. 151-172, Jun. 2000.
5. K. Mikolajczyk, C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, n. 10, pp. 1615-1630, Oct. 2005. (Pubitemid 41555406)
6. J. K. Kämäräinen, V. Kyrki, H. Kälviainen, "Invaríance Properties of Gabor Filter Based Features-Overview and Applications", IEEE Transactions on Image Processing, vol. 15, n. 5, pp. 1088-1099, May 2006.
7. H. Tamura, S. Mori, T. Yamawaki, Textual features corresponding to visual perception," IEEE Transaction on Systems, Man, and Cybernetics, vol. 8, n. 6, pp. 460-472, Jun. 1978.
8. T. Sikora, "The MPEG-7 visual standard for content descrption-an overview," IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no. 6, pp. 696-702, Jun 2001. (Pubitemid 32616531)
9. S. A. Chatzíchrístofis, Y. S. Boutalis, "CEDD: color and edge directivity descriptor: a compact descriptor for image indexing and retrieval," Conference on Computer vision systems 2008 (ICVS 2008), pp. 312-322, 2008. (Pubitemid 351775976)
10. M. Broilo, E. Zavesky, A. Basso, F. G. B. De Natale, "Unsupervised event segmentation of news content with multimodal cues," Workshop on Automated information extraction in media production 20J0 (AIEMPro 2010), pp. 39-44, 2010.
11. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," International Journal of Computer Vision, vol. 42, n. 3, pp. 145-175, May 2001. ' (Pubitemid 32680801)
12. D. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol. 60,n. 2,pp. 91-110,2004.
13. K. E. A. Van de Sande, T. Gevers, C. G. M. Snoek. "Evaluating color descriptors for object and scene recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, n. 9, pp. l582-1596, Sep. 2010.
14. M. Heikkila, M. Pietikainen, C. Schmid. "Description of interest regions with local binary patterns," Journal on Pattern Recognition, vol. 42, n. 3, pp. 425-436, Mar. 2009.
15. H. Bay, A. Ess, T. Tuytelaars, L. Van Gool, "SURF: Speeded Up Robust Features," Computer Vision and Image Understanding, vol. 110, n. 3, pp. 346-359, 2008.
16. J. R. R. Uijlings, A. W. M. Smeulders, R. J. H. Scha, "Real-Time Visual Concept Classification," IEEE Transactions on Multimedia, vol. 12, n. 7, pp. 665-68l, Nov. 2010.
17. S. Theodoridis, K. Koutroumbas, "Pattern Recognition," Academic Press, 3 edition, March 2006.
18. N. Ailon, R. Jaiswal, C. Monteleoni, "One-pass approximate k-means optimization," Workshop on On-line Learning with Limited Feedback 2009, 2009.
19. M. Cooper, J. Foote, A. Girgenshon, L. Wlcox, "Temporal event clustering for digital Photo collections," ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 1, n. 3, pp. 269-288, 2005.
20. X. Liao, Y. Wang, L. Ding, "Discovering Temporal Patterns from Images using Extended PLSA," Conference on Multimedia Technology 2010 (ICMT 2010), pp. 1-7, 2010.
21. A. Bosch, A. Zisserman, X. Muñoz, "Scene Classification Via pLSA," European Conference on Computer Vision 2006 (ECCV 2006), pp. 517-530, 2006. (Pubitemid 44029655)
22. M. Pavan, M. Pelillo, "Dominant sets and hierarchical clustering," IEEE Conference on Computer Vision 2003, pp. 362-369, 2003.
23. L. Shao, R. Mattivi: "Feature detector and descriptor evaluation in human action recognition". ACM Conference on Image and Video Retrieval 2010, 2010.
24. N. Robertson, I, Reid, M. Brady, "Behaviour Recognition and Explanation for Video Surveillance," Conference on Crime and Security 2006, pp. 458-463, 2006.
25. S. Park, J. K. Aggarwal, "A hierarchical bayesian network for event recognition of human actions and interactions," Multimedia Systems, vol. 10, n. 2, pp. 164-179, Aug. 2004.
26. H. Foroughi, B. S. Aski, H. Pourreza, "Intelligent Video Surveillance for Monitoring Elderly in Home Environments," Conference on Computer and Information Technology 2008 (ICCIT 2008), 2008.
27. R. Mehran, A. Oyama, M. Shah, "Abnormal crowd behavior detection using social force model," IEEE Conference on Computer Vision and Pattern Recognition 2009 (CVPR 2009), pp. 935-942, 2009.
28. I. Tsampoulatidis, N. Gkalelis, A. Dintou, V. Mezaris, I. Kompatsiaris. "High-level event detection system based on discriminant visual concepts," ACM Conference on Multimedia Retrieval 2011 (ICMR 2011), 2011.
29. P. Zontone, G. Boato, F. G. B. De Natale, A. De Rosa, M. Barni, A. Piva, J. S. Hare, D. Dupplaw, P. H. Lewis, "Image diversity analysis: context, opinion and bias," Workshop on Living Web: Making Web Diversity a true asset 2009, 2009.
30. U. Westermann, R. Jain, "Toward a Common Event Model for Multimedia Applications," IEEE Multimedia, vol. 14, no. l, pp. 19-29, Jan.-Mar. 2007. (Pubitemid 46351075)
31. M. Szummer and R. W. Picard, "Indoor-outdoor image classification," IEEE Workshop on Content-Based Access of Image and Video Database, pp. 42-51, 1998.
32. M. Broilo, P. Rocca, F. G. B. De Natale, "Content-Based Image Retrieval by a Semi-Supervised Particle Swarm Optimization" IEEE Workshop on Multimedia Signal Processing 2008, pp. 666-671, 2008.
33. M. Aly, P. Welinde, M. E. Munich, P. Perona, "Automatic discovery of image families: Global vs. local features," IEEE Conference on Image Processing 2009 (IC1P 2009), pp. 777-780, 2009.
34. K. E. A. Van de Sande, T. Gevers, C. G. M. Snoek, "Evaluating Color Descriptors for Object and Scene Recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, n. 9, pp. 1582-1596, 2010.
35. P. Dollar, V. Rabaud, G. Cottrell, S. Belongie, "Behavior Recognition via Sparse Spatio-Tcmporal Features," Visual Surveillance and Performance Evaluation of Tracking and Surveillance 2005, 2005.
36. LJ. Li, "What, where and who? Classifying events by scene and object recognition," IEEE Conference on Computer Vision 2007 (ICCV 2007), 2007.
37. W. Jiang, A. C. Loui, "Semantic event detection for consumer photo and video collections," IEEE Conference on Multimedia and Expo 2008 (ICME 2008), 2008.
38. N. Rasiwasia, N. Vasconcelos, "Scene classification with low-dimensional semantic spaces and weak supervision," IEEE Conference on Computer Vision and Pattern Recognition 2008, pp. 1-6, 2008.
39. N. Imran, J. Liu, J. Luo, M. Shah, "Event recognition from photo collections via PageRank," ACM Conference on Multimedia 2009, 2009.
40. M. Das, A. C. Loui, "Event classification in personal image collections", IEEE Conference on Multimedia and Expo 2009 (ICME 2009), 2009.
41. D. Lin, A. Kapoor, G. Hua, S. Baker, "Joint people, event, and location recognition in personal photo collections using cross-domain context," European conference on Computer vision 2010 (ECCV 2010), pp. 243-256, 2010.
42. M. S. Dao, D. T. Dang-Nguyen, F. G. B. De Natale, "Signature-Image- Based Event Analysis for Personal Photo Albums," ACM Conference on Multimedia 2011, 2011.
43. A. Graham, H. Garcia-Molina, A. Paepcke, T. Winogrand, "Time as the essence for photo browsing through personal digital libraries," ACM Joint Conference on Digital Libraries 2002,2002.
44. J. H. Lim, Q. Tian, P. Mulhelm, "Home photo content modeling for personalized event-based retrieval," IEEE Multimedia, vol. 10, n. 4, pp. 28-37, 2003.
45. A. Jaffe, M. Naaman, T. Tassa, M. Davis, "Generating summaries and visualization for large collections of georeferenced photographs," ACM Workshop on Multimedia Information Retrieval 2006 (MIR 2006), pp. 89-98, 2006. (Pubitemid 47168205)
46. L. Cao, J. Luo, H. Kautz, T. S. Huang, "Annotating collections of photos using hierarchical event and scene models", IEEE Conference on Computer Vision and Pattern Recognition 2008 (CVPR 2008), 2008.
47. J. Yuan, J. Luo, Y. Wu, "Mining Compositional Features From GPS and Visual Cues for Event Recognition in Photo Collections," IEEE Transactions on Multimedia, vol. 12, no. 7, pp. 705-716, Nov. 2010.
48. J. Luo, J. Yu, D. Joshi, W. Hao, "Event recognition: viewing the world with a third eye," ACM Conference on Multimedia 2008, pp. 1071-1080, 2008.
49. R. Mattivi, J. Uijlings, F. G. B. De Natale, N. Sebe, "Exploitation of time constrains for event recognition," ACM Workshop on Modeling and Representing Events 2011, 2011.
50. C. Schuldt, I. Laptev, B. Caputo, "Recognizing Human Actions: A Local SVM Approach," Conference on Pattern Recognition 2004 (ICPR 2004), 2004.
51. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, "Learning realistic human actions from movies," IEEE Conference on Computer Vision and Pattern Recognition 2008 (CVPR 2008), pp. 1-8, 2008.
52. A. Quattoní, A. Torralba, "Recognizing Indoor Scenes," IEEE Conference on Computer Vision and Pattern Recognition 2009 (CVPR 2009), 2009.
53. http://www.muItimediaeval.org/mediaeval2Ol1/SED2011/index.html