An integrated surveillance system - Human tracking and view synthesis using multiple omni-directional vision sensors

Image and Vision Computing

Volumn 22, Issue 7, 2004, Pages 551-561

  Ng, Kim C ^a,e   Ishiguro, Hiroshi ^b   Trivedi, Mohan ^c   Sogo, Takushi ^d  

^a STMicroelectronics USA   (United States)

^b WAKAYAMA UNIVERSITY   (Japan)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d NEC CORPORATION   (Japan)

^e NONE   (United States)

Author keywords

Dynamic view synthesis; Human activity profiling; Human tracking; Intelligent environments; Multiple camera stereo; N ocular stereo; Surveillance and monitoring; Visual modeling

Indexed keywords

AUTOMATIC TARGET RECOGNITION; IMAGE ENHANCEMENT; IMAGE QUALITY; IMAGING SYSTEMS; OBJECT RECOGNITION; OPTICAL SENSORS;

DYNAMIC VIEW SYNTHESIS; HUMAN ACTIVITY PROFILING; HUMAN TRACKING; INTELLIGENT ENVIRONMENTS; MULTIPLE CAMERA STEREO; N OCULAR STEREO;

COMPUTER VISION;

EID: 2342464219     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2003.09.009     Document Type: Article

References (32)

1. Ng K.C., Trivedi M.M., Ishiguro H. 3D ranging and virtual view generation using omni-view cameras. Proceedings of Multimedia Systems and Applications, SPIE, Boston. vol. 3528:November 1998.
2. Ishiguro H. Distributed vision system: a perceptual information infrastructure for robot navigation. Proceedings of IJCAI. 1997;. pp. 36-41.
3. Ishiguro H. Development of low-cost and compact omnidirectional vision sensors and their applications. Proceedings of the International Conference on Information Systems, Analysis and Synthesis. 1998;. pp. 433-439.
4. Narayanan P.J., Rander P.W., Kanade T. Constructing virtual world using dense stereo. Proceedings of ICCV. 1998;. pp. 3-10.
5. Seitz S.M., Kutulakos K.N. Plenoptic image editing. Proceedings of ICCV. 1998;. pp. 17-24.
6. Adelson E.H., Bergen E.H. The plenoptic function and the elements of early vision. Landy M., Movshon J.A. Computation models of visual processing. 1991;MIT Press, Cambridge, MA.
7. Levoy M., Hanrahan P. Light field rendering. Proceedings of SIGGRAPH. 1996;. pp. 31-42.
8. Gortler S.J., Grzeszczuk R., Szeliski R., Cohen M.F. The lumigraph. Proceedings of SIGGRAPH. 1996;. pp. 43-54.
9. Boyd J.E., Hunter E., Kelly P.H., Tai L.-C., Philips C.B., Jain R.C. MPI-video infrastructure for dynamic environments. in: Proceedings of the IEEE International Conference on Multimedia Computing and Systems. 1998;. pp. 249-254.
10. Kanade T., Collins T., Lipton A.J., Anandan P., Burt P., Wixson L. Cooperative multi-sensor video surveillance. in: DARPA Image Understanding Workshop. 1:1997;3-10.
11. Lipton A.J., Fujiyoshi H., Patil R.S. Moving target classification and tracking from real-time video. in: DARPA Image Understanding Workshop. 1998;. pp. 115-122.
12. Collins R.T., Tsin Y., Miller J.R., Lipton A.J. Using a DEM to determine geospatial object trajectories. in: DARPA Image Understanding Workshop. 1998.
13. Mori T., Kamisuwa Y., Mizoguchi H., Sato T. Action recognition system based on human finder and human tracker. in: Proceedings of the International Conference on Intelligent Robots and Systems (IROS). 1997;. pp. 1334-1342.
14. Grimson W.E.L., Stauffer C., Romano R., Lee L. Using adaptive tracking to classify and monitor activities in a site. in: Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR). 1998;. pp. 22-29.
15. Trivedi M.M., Huang K., Mikic I. Intelligent environments and active camera networks. IEEE Syst. Man Cybern. October 2000.
16. Okutomi M., Kanade T. A multiple baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. 15:(4):1993;353-363.
17. Kanade T., Yoshida A., Oda K., Kano H., Tanaka M. A stereo machine for video-rate dense depth mapping and its new applications. Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR). 1996;. pp. 196-202.
18. Ishiguro H., Yamamoto M., Tsuji S. Omni-directional stereo. IEEE Trans. PAMI. 14:(2):1992;257-262.
19. Yachida M. 3-D data acquisition by multiple views. In 3rd international Symposium on Robotics Research (ISRR'85). 1986;. pp. 11-18, London.
20. Gurewitz E., Dinstein I., Sarusi B. More on the benefit of a third eye. in: Proceedings of the International Conference on Pattern Recognition (ICPR). 1986;. pp. 966-968.
21. Marapane S.B., Trivedi M.M. Multi-primitive hierarchical (MPH) stereo analysis. IEEE Trans. PAMI. 16:(3):1994.
22. Dalmia A., Trivedi M. Depth extraction using a single moving camera: an integration of depth from motion and depth from stereo. Mach. Vis. Appl. 9:(2):1996;43-55.
23. Kato K., Ishiguro H. Identifying and localizing robots in a multi-robot system. Proceedings of the International Conference on Intelligent Robots and Systems (IROS). 1999;. pp. 966-972.
24. Shams S. Neural network optimization for multi-target multi-sensor passive tracking. Proc. IEEE. 84:(10):1996;1442-1457.
25. Statistical methods in research and production: with special reference to the chemical industry. Davies O.L., Goldsmith P.L. 4th rev. ed. 1976;Imperial Chemical Industries, Ltd, London. xiii, 478 p.: ill.: 24 cm.
26. K.C. Ng, M.M. Trivedi, H. Ishiguro. Generalized multiple baseline stereo and direct virtual view synthesis using range-space search, match, and render, Int. J. Comput. Vis., 47 (1-3) (2002) 131-147 .
27. Sogo T., Ishiguro H., Trivedi M.M. N -ocular stereo for real-time human tracking. Benosman R., Kang S.B. Panoramic Vision: Sensors, Theory and Applications. 2001;Springer, Berlin.
28. Ng K.C., Ishiguro H., Trivedi M. Multiple omni-directional vision sensors (ODVS) based visual modeling approach. Conference and Video Proceedings of IEEE Visualization '99, San Francisco, California, October. 1999.
29. Boult T. Remote reality demonstration. in: IEEE Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, June 23-25. 1998;. pp. 966-967.
30. Ng K.C., Trivedi M.M., Ishiguro H. Range-space approach for generalized multiple baseline stereo and direct virtual view synthesis. IEEE Workshop on Stereo and Multi-Baseline Vision, Kauai, HI, Dec. 9-10. 2001.
31. R. Capella, Real-time system for integrated omni-directional and rectilinear image-based virtual walkthroughs, Master Thesis, University of California, San Diego, December 1999.
32. Ishiguro H., Ng K.C., Capella R., Trivedi M.M. Omnidisectional Image-based Modeling: Three approaches to approximated glentoptic representations. Machine vision and applications. 14:(2):2003;94-102.