Effective multimedia surveillance using a human-centric approach

Multimedia Tools and Applications

Volumn 51, Issue 2, 2011, Pages 697-721

  Atrey, Pradeep K ^a   El Saddik, Abdulmotaleb ^b   Kankanhalli, Mohan S ^c  

^a UNIVERSITY OF WINNIPEG   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Camera view selection and scheduling; Eyes tracking; Human centered; Importance computation; Multimedia surveillance; Relevance feedback

Indexed keywords

CAMERA VIEW SELECTION AND SCHEDULING; EYES TRACKING; HUMAN-CENTERED; IMPORTANCE COMPUTATION; MULTIMEDIA SURVEILLANCE; RELEVANCE FEEDBACK;

CAMERAS; FEEDBACK; MONITORING; SCHEDULING; VIDEO CAMERAS;

SECURITY SYSTEMS;

EID: 79951509955     PISSN: 13807501     EISSN: 15737721     Source Type: Journal    
DOI: 10.1007/s11042-010-0649-1     Document Type: Article

References (32)

1. Amarnag S, Kumaran RS, Gowdy JN (2003) Real time eye tracking for human computer interfaces. In: IEEE international conference on multimedia and expo. Washington DC, USA, pp 557-560
2. S Asteriadis P Tzouveli K Karpouzis S Kollias 2009 Estimation of behavioral user state based on eye gaze and head pose application in an e-learning environment Multimed Tools Appl 41 3 469 493 10.1007/s11042-008-0240- 1
3. Atrey PK (2009) A hierarchical model for representation of events in multimedia observation systems. In: The 1st ACM international workshop on events in multimedia. Beijing, China, pp 57-64
4. Atrey PK, Hossain MA, Saddik AE (2008) Automatic scheduling of cctv camera views using a human-centric approach. In: IEEE international conference on multimedia and expo. Hannover, Germany, pp 325-338
5. PK Atrey MS Kankanhalli R Jain 2006 Information assimilation framework for event detection in multimedia surveillance systems Springer/ACM Multimed Syst J 12 3 239 253 10.1007/s00530-006-0063-8 (Pubitemid 44876288)
6. Baumann MA, MacLean KE, Hazelton TW, McKay A (2010) Emulating human attention-getting practices with wearable haptics. In: IEEE haptics symposium. Waltham, USA, pp 149-156
7. Davis M (2003) Active capture: integrating human-computer interaction and computer vision/audition to automate media capture. In: IEEE international conference on multimedia and expo, vol 2, pp 185-188
8. HM Dee SA Velastin 2007 How close are we to solving the problem of automated visual surveillance: a review of real-world surveillance, scientific progress and evaluative mechanisms Mach Vis Appl 19 5-6 329 343 05534645
9. A Hampapur L Brown J Connell A Ekin N Haas M Lu H Merkl S Pankanti A Senior CF Shu YL Tian 2005 Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking IEEE Signal Process Mag 22 2 38 51 10.1109/MSP.2005.1406476 (Pubitemid 40527452)
10. Hossain MA, Atrey PK, Saddik, AE (2011) Modeling and assessing quality of information in multi-sensor multimedia monitoring systems. ACM Trans Multimed Comput Commun Appl 7(1)
11. L Itti P Baldi 2009 Bayesian surprise attracts human attention Vision Res 49 10 1295 1306 10.1016/j.visres.2008.09.007
12. L Itti C Koch 2001 Computational modelling of visual attention Nat Rev Neurosci 2 194 203 10.1038/35058500 (Pubitemid 33673372)
13. Leykin A, Hammoud R (2008) Real-time estimation of human attention field in LWIR and color surveillance videos. In: IEEE international workshop on object tracking and classification in and beyond the visible spectrum. Anchorage, USA, pp 1-6
14. Liu A, Zhang Y, Song Y, Zhang D, Li J, Yang Z (2008) Human attention model for semantic scene analysis in movies. In: IEEE international conference on multimedia and expo. Hannover, Germany, pp 1473-1476
15. Ma YF, Lu L, Zhang HJ, Li M (2002) A user attention model for video summarization. In: ACM international conference on multimedia, pp 533-542
16. Menezes P, Barreto JC, Dias J (2004) Face tracking based on haar-like features and eigenfaces. In: The 5th symposium on intelligent autonomous vehicles, pp 5-7
17. Peters C, O'Sullivan C (2003) Attention-driven eye gaze and blinking for virtual humans. In: ACM SIGGRAPH 2003 sketches & applications. San Diego, USA, pp 1-1
18. RJ Radke S Andra O Al-Kofahi B Roysam 2005 Image change detection algorithms: a systematic survey IEEE Trans Image Process 14 3 294 307 10.1109/TIP.2004.838698 2120664 (Pubitemid 40351907)
19. Reinders M (1997) Eye tracking by template matching using an automatic codebook generation scheme. In: Third annual conference of the advanced school for computing and imaging. Heijen, The Netherlands, pp 85-91
20. LA Rowe R Jain 2005 ACM SIGMM retreat report on future directions in multimedia research ACM Trans Multimed Comput Commun Appl 1 1 3 13 10.1145/1047936.1047938
21. Savas Z (2005) Real-time detection and tracking of human eyes in video sequences. MSc thesis, Middle East Technical University, Ankara, Turkey
22. Savas Z (2008) Trackeye: real-time tracking of human eyes using a webcam. http://www.codeproject.com/KB/cpp/TrackEye.aspx
23. Smith P, Shah M, da Vitoria Lobo N (2000) Monitoring head/eye motion for driver alertness with one camera. In: IEEE international conference on pattern recognition. Barcelona, Spain, pp 636-642
24. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2. Ft. Collins, CO, USA, pp 252-258
25. Taylor JG, Fragopanagos N (2004) Modelling human attention and emotions. In: IEEE international joint conference on neural networks, vol 1. Budapest, Hungary, pp 501-506 (Pubitemid 40011788)
26. K Vaiapury M Kankanhalli 2008 Finding interesting images in albums using attention J Multimedia 3 4 1 12
27. Vilaplana V, Marques F (2008) Region-based mean shift tracking: application to face tracking. In: The 15th IEEE international conference on image processing. San Diego, CA, pp 2712-2715
28. U Vural YS Akgul 2009 Eye-gaze based real-time surveillance video synopsis Pattern Recogn Lett 30 1151 1159 10.1016/j.patrec.2009.03.002
29. Wallace E, Diffey C (1988) CCTV control room ergonomics. Tech. rep., Police Scientific Development Branch, UK Home Office
30. Wang J, Kankanhalli MS, Yan W, Jain R (2003) Experiential sampling for video surveillance. In: First ACM international workshop on video surveillance. Berkeley, California, USA, pp 77-86
31. Wu C, Lin Y, Zhang WJ (2005) Human attention modeling in a human-machine interface based on the incorporation of contextual features in a Bayesian network. In: IEEE international conference on systems, man and cybernetics, vol 1. San Antonio, USA, pp 760-766 (Pubitemid 41674970)
32. J Wu MM Trivedi 2010 An eye localization, tracking and blink pattern recognition system: algorithm and evaluation ACM Trans Multimed Comput Commun Appl 6 2 1 23 10.1145/1671962.1671964