Intelligent surveillance of indoor environments based on computer vision and 3D point cloud fusion

Expert Systems with Applications

Volumn 42, Issue 21, 2015, Pages 8156-8171

  Gómez, María José ^a   García, Fernando ^a   Martín, David ^a   De La Escalera, Arturo ^a   Armingol, José María ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

3D point cloud; Computer vision; Intelligent Surveillance System; Intruder detection; Sensor fusion

Indexed keywords

ALGORITHMS; COMPUTER VISION; DISTRIBUTED COMPUTER SYSTEMS; INTRUSION DETECTION; ITERATIVE METHODS; MONITORING; OBJECT DETECTION; SIGNAL DETECTION;

3D POINT CLOUD; ILLUMINATION CONDITIONS; INTELLIGENT SURVEILLANCE; INTELLIGENT SURVEILLANCE SYSTEMS; INTRUDER DETECTION; ITERATIVE CLOSEST POINTS; SENSOR FUSION; VOLUMETRIC REPRESENTATION;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84937151522     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.06.026     Document Type: Article

References (41)

1. A. Adam, E. Rivlin, I. Shimshoni, and D. Reinitz Robust real-time unusual event detection using multiple fixed-location monitors IEEE Transactions on Pattern Analysis and Machine Intelligence 30 2008 555 560
2. J. Albusac, D. Vallejo, J.J. Castro-Schez, C. Glez-Morcillo, and L. Jiménez Dynamic weighted aggregation for normality analysis in intelligent surveillance systems Expert Systems with Applications 41 2014 2008 2022
3. Davis, J. W., & Sharma, V. (2004). Robust background-subtraction for person detection in thermal imagery. In IEEE international workshop on object tracking and classification beyond the visible spectrum (pp. 1-8).
4. Fischer, Y., & Beyerer, J. (2012). A top-down-view on intelligent surveillance systems. In The seventh international conference on systems, ICONS (pp. 43-48).
5. A. Fitzgibbon Robust registration of 2D and 3D points sets Image and Vision Computing 21 13-14 2003 1145 1153
6. C. Fookes, S. Denman, R. Lakemond, D. Ryan, S. Sridharan, and M. Piccardi Semi-supervised intelligent surveillance system for secure environments IEEE International Symposium on Industrial Electronics (ISIE) 2010 2815 2820
7. Galvin, B., McCane, B., Novins, K., Mason, D., & y Mills, S. (1998). Recovering motion fields: An evaluation of eight optical flow algorithms. In British machine vision conference.
8. F. García, F. Jiménez, J.J. Anaya, J.M. Armingol, J.E. Naranjo, and A. y de la Escalera Distributed pedestrian detection alerts based on data fusion with accurate localization Sensors 13 9 2013 11687 11708
9. T. Gill, J.M. Keller, D.T. Anderson, and R.H. Luke A system for change detection and human recognition in voxel space using the Microsoft kinect sensor Applied imagery pattern recognition workshop (AIPR) 2011 IEEE 1 8
10. Harville, M. (2004). Stereo person tracking with adaptive plan-view statistical templates. Tech. rep., Hewlett-Packard.
11. Horn, B. K. P., & Schunck, B. G. (1980). Determining optical flow. AI Memo 572, Massachusetts Institute of Technology.
12. Hu, J., Hu, R., Wang, Z., Gong, Y., & Duan, M. (2013). Kinect depth map based enhancement for low light surveillance image. In 20th IEEE international conference on image processing (ICIP) (pp. 1090-1094).
13. Q. Huihuan, W. Xinyu, and Xu. Yangsheng Intelligent surveillance systems, intelligent systems, control and automation: Science and engineering 2011 Springer
14. Huwer, S., & Niemann, H. (2000). Adaptive change detection for real-time surveillance applications. In IEEE International Workshop on Visual Surveillance (Dublin, Ireland) (pp. 37-45).
15. M. Irani, and P. Anandan A unified approach to moving object detection in 2D and 3D scenes IEEE Transactions on Pattern Analysis and Machine Intelligence 20 6 1998 577 589
16. Izadi, S., Newcombe, R. A., Kim, D., Hilliges, O., Molyneaux, D., Hodges, S., Kohli, P., Shotton, J., Davison, A. J., & Fitzgibbon, A. (2011). KinectFusion: Real-time dynamic 3D surface reconstruction and interaction. In SIGGRAPH '11, ACM SIGGRAPH 2011 Talks, No.23.
17. Keller, M., Lefloch, D., Lambers, M., Izadi, S., Weyrich, T., & Kolb, A. (2013). Real-time 3D reconstruction in dynamic scenes using point-based fusion. In Proc. of joint 3DIM/3DPVT conference (3DV).
18. G. Kim, S. Lee, and S. Kim A novel hybrid intrusion detection method integrating anomaly detection with misuse detection Expert Systems with Applications 41 2014 1690 1700
19. Krishnan, A. K., Saripalli, S., Nissen, E., & Arrowsmith, R. (2012). 3D change detection using low cost aerial imagery. In IEEE international symposium on safety, security, and rescue robotics (SSRR) (pp. 1-6).
20. Kuthirummal, S., Bansal, M., Sawhney, H., & Eledath, J. (2011). 3D alignment and change detection from uncalibrated eye images. In First IEEE international conference on healthcare informatics, imaging and systems biology (HISB) (pp. 299-306).
21. Lee, S., & Chung, W. K. (2006). Rotating IR sensor system for 2.5D sensing. In 2006 IEEE/RSJ international conference on intelligent robots and systems (pp. 814-819).
22. M.K. Lim, S. Tang, and C.S. Chan ISurveillance: Intelligent framework for multiple events detection in surveillance videos Expert Systems with Applications 41 2014 4704 4715
23. D. Lu, P. Mausel, E. Brondízio, and E. Moran Change detection techniques International Journal of Remote Sensing 25 2004 2365 2401
24. B. Luo, and J. Xia A novel intrusion detection system based on feature generation with visualization strategy Expert Systems with Applications 41 2014 4139 4147
25. J.L. Martinez, A.J. Reina, J. Morales, and A. Mandow Using multicore processors to parallelize 3D point cloud registration with the coarse binary cubes method IEEE International Conference on Mechatronics (ICM) 2013 335 340
26. Mishra, A. K., Ni, B., Winkler, S., & Kassim, A. (2007). 3D surveillance system using multiple cameras. In SPIE proceedings, 3D Sensing: Videometrics (Vol. 6491).
27. K. Müller, A. Smolic, M. Drose, P. Voigt, and T. Wiegand 3-D reconstruction of a dynamic environment with a fully calibrated background for traffic scenes IEEE Transactions on Circuits and Systems for Video Technology 15 4 2005 538 549
28. A. Myronenko, and X. Song Point set registration: Coherent point drift IEEE Transaction on Pattern Analysis and Machine Intelligence 32 12 2010 2262 2275
29. Newcombe, R. A., Davison, A. J., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S., Kim, D., & Fitzgibbon, A. (2011). Kinectfusion: Real-time dense surface mapping and tracking. In Proc. IEEE Int. Symp. Mixed and Augmented Reality (ISMAR) (pp. 127-136).
30. M. Niessner, M. Zollhöfer, S. Izadi, and M. Stamminger Real-time 3D reconstruction at scale using voxel hashing ACM Transactions on Graphics (TOG) 32 6 2013 169
31. R.R. Oliveira, F.C. Noguez, C.A. Costa, J.L. Barbosa, and M.P. Prado SWTRACK: An intelligent model for cargo tracking based on off-the-shelf mobile devices Expert Systems with Applications 40 2013 2023 2031
32. Park, H., Lee, S., & Chung, W. K. (2006). Obstacle detection and feature extraction using 2.5D range sensor. In SICE-ICASE, 2006. International Joint Conference (pp. 2000-2004).
33. M. Popa, A.K. Koc, L.J.M. Rothkrantz, C. Shan, and P. Wiggers Kinect sensing of shopping related actions, constructing ambient intelligence Communications in Computer and Information Science 277 2012 91 100
34. R.J. Radke, S. Andra, O. Al-Kofahi, and B. Roysam Image change detection algorithms: A systematic survey IEEE Transactions on Image Processing 14 2005 294 307
35. Santos, D., Sciotti, D. F., Gomes, M., Oliva, D., Wolf, D. F., & Santos, F. (2012). Mobile robots navigation in indoor environments using kinect sensor. In Second Brazilian conference on critical embedded systems.
36. Savage, R., Clarke, N., & Li, F. (2013). Multimodal biometric surveillance using a kinect sensor. In Proceedings of the 12th annual security conference, Las Vegas, USA.
37. Song, X., & Zhang, Q. (2013). Kinect-based intelligent surveillance, motion capture and 3D object recognition. CORE Project of Microsoft Research, USA.
38. Steder, B., Rusu, R. B., Konolige, K., & Burgard, W. (2010). NARF: 3D range image features for object recognition. In IEEE/RSJ int. conf. on intelligent robots and systems (IROS), workshop on defining and solving realistic perception problems in personal robotics (pp. 1-2).
39. J. Tang, J. Luo, T. Tjahjadi, and Y.Y. Gao 2.5D multi-view gait recognition based on point cloud registration Sensors 14 4 2014 6124 6143
40. T. Tuytelaars, and K. Mikolajczyk Local invariant feature detectors: A survey Foundation and Trends in Computer Graphics and Vision 3 2007 177 280
41. M. Valera, and S.A. Velastin Intelligent distributed surveillance systems: A review vision Image and Signal Processing, IEE Proceedings 152 2005 192 204