Smart camera based monitoring system and its application to assisted living

Proceedings of the IEEE

Volumn 96, Issue 10, 2008, Pages 1698-1714

  Fleck, Sven ^a   Straßer, Wolfgang ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Activity recognition; Assisted living; Distributed smart cameras; Privacy; Surveillance; Tracking

Indexed keywords

AIRPORT SECURITY; CAMERAS; DATA PRIVACY; INDUSTRIAL PLANTS; MONITORING; PATTERN RECOGNITION; SECURITY SYSTEMS; SPACE SURVEILLANCE; SURFACE DISCHARGES;

ACTIVITY RECOGNITION; DISTRIBUTED SMART CAMERAS; GOVERNMENT BUILDINGS; MONITORING SYSTEM; PROTECTION APPLICATION; SURVEILLANCE SYSTEMS; VIDEO-SURVEILLANCE APPLICATIONS; WESTERN SOCIETIES;

ASSISTED LIVING;

EID: 55649119763     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2008.928765     Document Type: Article

References (48)

1. SIW Editorial Staff, Integrator Unveils Security System for Wynn Casino, [Online]. Available: http://www.securityinfowatah.com/article/ article.jsp?siteSection=344&id=9566
2. T. Datz, What Happens in Vegas Stays on Tape. [Online]. Available: http://www.csoonline.com/read/090105/hiddencamera_vegas_ 3834.html
3. "Automated analysis of nursing home observations," Pervasive Comput., vol. 3, no. 2, pp. 15-21, 2004.
4. Philips Lifeline. [Online]. Available: http://www.lifelinesys.com/
5. CNN, Smart Cameras Spot Shady Behavior. [Online]. Available: http://edition.cnn.com/2007/TECH/science/03/26/fs.behaviorcarneras/index.html
6. A. Yilmaz, O. Javed, and M. Shah, "Object tracking: A survey," ACM Comput. Surv., vol. 38, no. 4, 2006.
7. "Surveillance works: Look who's watching," IEEE Signal Process. Mag., vol. 22, Mar. 2005.
8. N. T. Siebel and S. Maybank, "The advisor visual surveillance system," in Proc. BCCV 2004 Workshop Applicat. Comput. Vision (ACV), 2004.
9. A. Hampapur, L. M. Brown, J. Connell, M. Lu, H. Merkl, S. Pankanti, A. W. Senior, C. f. Shu, and Y. 1. Tian, "Multi-scale tracking for smart video surveillance," IEEE Trans. Signal Process., vol. 22, Feb. 2005.
10. S. Velalstin and P. Remagnino, Intelligent Distributed Video Surveillance Systems. Herts, U.K.: Institution of Engineering and Technology, 2006.
11. M. M. Trivedi, T. L. Gandhi, and K. S. Huang, "Distributed interactive video arrays for event capture and enhanced situational awareness," IEEE Intell. Syst. (Special Issue on Homeland Security), Oct./Nov. 2005.
12. M. M. Trivedi and S. Park, "Video analysis of vehicles and persons for surveillance," Intell. Security Informatics, 2007.
13. M. Shah, O. Javed, and K. Shafique, "Automated visual surveillance in realistic scenarios," IEEE Multimedia, vol. 14, no. 1, pp. 30-39, 2007.
14. M. Kampel, J. Aguilera, D. Thirde, M. Borg, G. Fernandez, H. Wildenauer, J. Ferryman, and P. Blauensteiner, "3D object localisation and evaluation from video streams," in Proc. 28th Workshop Austrian Assoc. Pattern Recognit. (AAPR), F. Lenzen, O. Scherzer, and M. Vincze, Eds., Obergurgl, Austria, Mar. 2006, pp. 113-122.
15. R. Collins, A. Lipton, T. Kanade, H. Fujiyoshi, D. Duggins, Y. Tsin, D. Tolliver, N. Enomoto, and O. Hasegawa, "A system for video surveillance and monitoring," Robotics Inst., Carnegie-Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-00-12, May 2000.
16. P. C. Ribeiro and J. Santos-Victor, "Human activity recognition from video: Modeling, feature selection and classification architecture," in Proc. Workshop Human Activity Recognit. Model. (HAREM 2005), 2005.
17. M. Quaritsch, M. Kreuzthaler, B. Rinner, H. Bischof, and B. Strobl, "Autonomous multicamera tracking on embedded smart cameras," EURASIP J. Embed. Syst., 2007.
18. J. Schiff, M. Meingast, D. K. Mulligan, S. Sastry, and K. Goldberg, "Respectful cameras: Detecting visual markers in real-time to address privacy concerns," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Oct. 2007.
19. F. Dufaux and T. Ebrahimi, "Scrambling for video surveillance with privacy," in Proc. Conf. Comput. Vision Pattern Recognit. Workshop Privacy Res. Vision (CVPRW-PRIV), Washington, DC, 2006, p. 160.
20. R. Gross, L. Sweeney, F. de la Torre, and S. Baker, "Model-based face de-identification," in Proc. Conf. Comput. Vision Pattern Recognit. Workshop Privacy Res. Vision (CVPRW-PRIV), Washington, DC, 2006, p. 161.
21. A. Senior, S. Pankanti, A. Hampapur, L. Brown, Y.-L. Tian, A. Ekin, J. Connell, C. F. Shu, and M. Lu, "Enabling video privacy through computer vision," IEEE Security Privacy, vol. 3, no. 3, pp. 50-57, 2005.
22. R. Cucchiara, A. Prati, and R. Vezzani, "A system for automatic face obscuration for privacy purposes," Pattern Recognit. Lett., vol. 27, no. 15, pp. 1809-1815, Nov. 2006.
23. E. Dishman, "Inventing wellness systems for aging in place," Computer, vol. 37, no. 5, pp. 34-41, 2004.
24. A. M. Tabar, A. Keshavarz, and H. Aghajan, "Smart home care network using sensor fusion and distributed vision-based reasoning," in Proc. ACM Int. Workshop Video Surveil. Sensor Netw. (VSSN 2006), 2006.
25. H. K. Aghajan, J. C. Augusto, C. Wu, P. J. McCullagh, and J.-A. Walkden, "Distributed vision-based accident management for assisted living," in ICOST, vol. 4541, Lecture Notes in Computer Science, T. Okadome, T. Yamazaki, and M. Makhtari, Eds. Berlin, Germany: Springer, 2007, pp. 196-205.
26. A. Keshavarz, A. Maleki-Tabar, and H. Aghajan, "Distributed vision-based reasoning for smart home care," in Proc. ACM SenSys Workshop Distrib. Smart Cameras (DSC), Oct. 2006.
27. R. Cucchiara, A. Prati, and R. Vezzani, "A multi-camera vision system for fall detection and alarm generation," Expert Syst., vol. 24, no. 5, pp. 334-345, Nov. 2007.
28. A. Williams, D. Xie, S. Ou, R. Grupen, A. Hanson, and E. Riseman, "Distributed smart cameras for aging in place," in Proc. Workshop Distrib. Smart Cameras (DSC 2006), 2006.
29. B. Ugur Toereyin, Y. Dedeoglu, and A. Enis Cetin, "HMM based falling person detection using both audio and video," in Proc. MUSCLE Netw. Excellence Project, Apr. 2006.
30. W. Wolf, B. Ozer, and T. Lv, "Smart cameras as embedded systems," Computer, vol. 35, no. 9, pp. 48-53, 2002.
31. D. Dietrich, H. Garn, U. Kebschull, C. Grimm, and M. Ben-Ezra, "Embedded vision systems," EURASIP J. Embed. Syst., 2007.
32. M. Bramberger, A. Doblander, A. Maier, B. Rinner, and H. Schwabach, "Distributed embedded smart cameras for surveillance applications," IEEE Computer, vol. 39, Feb. 2006.
33. P. Chalimbaud and F. Berry, "Embedded active vision system based on an FPGA architecture," EURASIP J. Embed. Syst., no. 1, p. 26, 2007.
34. R. Kleihorst, A. Abbo, B. Schueler, and A. Danilin, "Camera mote with a high-performance parallel processor for real-time frame-based video processing," in Proc. ACM/IEEE Int. Conf. Distrib. Smart Cameras (ICDSC-07), 2007.
35. S. Hengstler, D. Prashanth, S. Fong, and H. Aghajan, "MeshEye: A hybrid-resolution smart camera mote for applications in distributed intelligent surveillance," in Proc. 6th Int. Conf. Inf. Process. Sensor Netw. (IPSN '07), New York, 2007, pp. 360-369.
36. Die schöne neue Welt der Überwachung, Spiegel Online. [Online]. Available: http://www.spiegel.de/flash/0,5532,15385,00.html
37. The Royal Academy of Engineering, "Dilemmas of privacy and surveillance - Challenges of technological change," Royal Acad. of Eng., London, U.K., Mar. 2007, Tech. Rep.
38. S. Fleck, R. Loy, C. Vollrath, F. Walter, and W. Straßer, "SmartClassySurv - A smart camera network for distributed tracking and activity recognition and its application to assisted living," in Proc. ACM/IEEE Int. Conf. Distrib. Smart Cameras (ICDSC-07), 2007.
39. S. Fleck, F. Busch, and W. Straßer, "Adaptive probabilistic tracking embedded in smart cameras for distributed surveillance in a 3D model," EURASIP J. Embed. Syst. (Special Issue on Embedded Vision Systems), no. 29858, 2007.
40. A. Elgainmal, R. Duraiswami, D. Harwood, and L. S. Davis, "Background and foreground modeling using nonparametric kernel density for visual surveillance," Proc. IEEE, vol. 90, pp. 1151-1163, Jul. 2002.
41. A. Prati, I. Mikic, R. Cucchiara, and M. Trivedi, "Analysis and detection of shadows in video streams: A comparative evaluation," Proc. 2001 IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognir. (CVPR'01), 2001, vol. 2, p. 571.
42. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, "Detecting objects, shadows and ghosts in video streams by exploiting color and motion information," in Proc. 11th Int. Conf. Image Anal. Process. (ICIAP '01), Washington, DC, 2001, p. 360.
43. R. Cucchiara, C. Grana, M. Piccardi, A. Prati, and S. Sirotti, "Improving shadow suppression in moving object detection with HSVcolor information," in Proc IEEE Intell. Transp. Syst. 2001, 2001, pp. 334-339.
44. S. Fleck and W. Straßer, "Adaptive probabilistic tracking embedded in a smart camera," in IEEE Embed. Comput. Vision Workshop (ECVW)/IEEE CVPR 2005, 2005.
45. J. Weston, A. Elisseeff, G. Bakir, and F. Sinz, SPIDER machine learning framework. [Online]. Available: http://www.kyb.tuebingen.mpg.de/bs/ people/spider/
46. P. Biber, S. Fleck, M. Wand, D. Staneker, and W. Straßer, "First experiences with a mobile platform for flexible 3D model acquisition in indoor and outdoor environments-The Wägele," in Proc. 3D Virtual Reconstruct. Visual. Complex Architect. (3D-AROT2005), 2005.
47. S. Fleck, F. Busch, P. Biber, and W. Straßer, "Graph cut based panoramic 3D modeling and ground truth comparison with a mobile platform - The Wägele," in Proc. IAPR Can. Conf. Comput. Robot Vision (CRV2006), 2006.
48. M. Wand, A. Berner, M. Bokeloh, P. Jenke, A. Fleck, M. Hoffmann, B. Maier, D. Staneker, A. Schilling, and H.-P. Seidel, "Processing and interactive editing of huge point clouds from 3 scanners," Comput. Graph., vol. 2008, no. 1, 2008.