Aerial video surveillance and exploitation

Proceedings of the IEEE

Volumn 89, Issue 10, 2001, Pages 1518-1538

  Kumar, Rakesh ^a,b   Sawhney, Harpreet ^a,b   Samarasekera, Supun ^b   Hsu, Steve ^a,b   Tao, Hai ^a,b   Guo, Yanlin ^a,b   Hanna, Keith ^b   Pope, Arthur ^b   Wildes, Richard ^a,b   Hirvonen, David ^b   Hansen, Michael ^b   Burt, Peter ^a,b  

^a IEEE   (United States)

^b SARNOFF CORPORATION   (United States)

Author keywords

Aerial images; Camera control; Change detection; Computer vision; Geo location; Image processing; Mosaicing; Registration; Tracking; Video surveillance; Visualization

Indexed keywords

EID: 0000455389     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.959344     Document Type: Article

References (61)

1. P. R. Wolf and B. A. Dewitt, Elements of Photogrammetry with Applications in GIS, 3rd ed. New York: McGraw Hill, 2000.
2. P. Burt, P. Anandan, G. van der Wal, and R. Bassman, "A front-end vision processor for vehicle navigation," in Proc. Int. Conf. Intelligent Autonomous Systems, 1993.
3. P. Burt and E. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, pp. 532-540, Apr. 1983.
4. W. Freeman and E. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, pp. 891-906, Sept. 1991.
5. B. Jahne, Digital Image Processing, Berlin, Germany: Springer-Verlag, 1988.
6. R. Wildes and J. Bergen, "Qualititative spatio-temporal analysis with an oriented energy representation," in Proc. Eur. Conf. Computer Vision, Ireland, 2000, pp. 768-774.
7. G. Adiv, "Determining three-dimensional motion and structure from optical flow generated by several moving objects," IEEE Trans. Pattern Anal. Mach. Intell., July 1985.
8. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. Cambridge, MA: MIT Press, 1993.
9. J. R. Bergen, P. Anandan, K. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. Eur. Conf. Computer Vision, 1992.
10. K. J. Hanna and N. E. Okamoto, "Combining stereo and motion analysis for direct estimation of scene structure," in Proc. IEEE Int. Conf. Computer Vision, Berlin, 1993, pp. 357-365.
11. R. Kumar, P. Anandan, and K. Hanna, "Direct recovery of shape from multiple views: A parallax based approach," in Proc. Int. Conf. Pattern Recognition, Jerusalem, Israel, 1994.
12. H. Sawhney, "3D geometry from planar parallax," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994.
13. A. Shashua and N. Navab, "Relative affine structure: Theory and application to 3D reconstruction from perspective views," in Proc. IEEE Conf. Computer Vision and Patter Recognition, 1994.
14. J. J. Koenderink and A. J. van Doorn, "Affine structure from motion," J. Opt. Soc. Amer. A, vol. 8, no. 2, pp. 377-385, 1991.
15. P. Anandan, "A computational framework and an algorithm for the measurement of visual motion," Int. J. Comput. Vis., vol. 2, pp. 283-310, Jan. 1989.
16. B. D. Lucas and T. Kanade, "An iterative technique of image registration and its application to stereo," in Proc. 7th Int. Joint Conf. Artificial Intelligence, 1981, pp. 674-679.
17. Z. Zhang, R. Deriche, O. Faugeras, and Q.-T. Luong, "A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry," Artif. Intell. J., vol. 78, pp. 87-119, Oct. 1995.
18. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2000.
19. B. K. P. Horn and E. J. Weldon, Jr., "Direct methods for recovering motion," Int. J. Comput. Vis., vol. 2, pp. 51-76, June 1988.
20. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1993.
21. M. J. Black and P. Anandan, "The robust estimation of multiple motions: parametric and piecewise smooth flow fields," Comput. Vis. Image Understand., vol. 63, pp. 75-104, Jan. 1996.
22. M. Hansen, P. Anandan, K. Dana, G. van der Wal, and P. Burt, "Real-time scene stabilization and mosaic construction," in Proc. IEEE Workshop on Applications of Computer Vision, 1994.
23. R. Kumar, P. Anandan, M. Irani, J. Bergen, and K. Hanaa, "Representation of scenes from collections of images," in Proc. IEEE Workshop on Visual Representations, Cambridge, MA, 1995.
24. H. S. Sawhney, S. Ayer, and M. Gorkani, "Model-based 2D and 3D dominant motion estimation for mosaicing and video representation," in Proc. Int. Conf. Computer Vision, 1995, pp. 583-590.
25. R. Szeliski, "Video mosaics for virtual environments," IEEE Comput. Graph. Appl., vol. 16, pp. 22-30, Mar. 1996.
26. P. Burt and T. Adelson, "A multi-resolution spline with application to image mosaics," ACM Trans. Graphics, vol. 2. pp. 217-236, 1983.
27. C. H. Anderson, P. J. Burt, and G. S. van der Wal, "Change detection and tracking using pyramid transform techniques," SPIE Intell. Robots Comput. Vis., vol. 579, pp. 72-78, 1985.
28. P. Burt, J. Bergen, R. Hingorani, R. Kolczynski, W. Lee, A. Leung, J. Lubin, and H. Shvaytser, "Object tracking with a moving camera: An application of dynamic motion analysis," in Proc. IEEE Workshop on Motion, 1989.
29. M. Irani, B. Rousso, and S. Peleg, "Computing occluding and transparent motions," Int. J. Comput. Vis., vol. 12, pp. 5-15, Feb. 1994.
30. R. Wildes, "A measure of motion salience for surveillance applications," in Proc. IEEE Conf. Image Processing, 1998, pp. 183-187.
31. A. Lipton, H. Fujiyoshi, and R. Patil, "Moving target classification and tracking from real-time video," in Proc. IEEE Workshop on Applications of Computer Vision, 1998.
32. A. Selinger and L. Wixson, "Classifying moving objects as rigid or nonrigid without correspondences," in Proc. DARPA Image Understanding Workshop, 1998.
33. M. Irani and P. Anandan, "A unified approach to moving object detection in 2D and 3D scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, pp. 577-589, June 1998.
34. S. Fejes and L. Davis, "What can projections of flow fields tell us about visual motion," in Proc. Int. Conf. Computer Vision, 1993.
35. M. I. A. Lourakis, A. A. Argyros, and S. C. Orphanoudakis, "Independent 3D motion detection using residual parallax normal flow fields," in Proc. Int. Conf. Computer Vision, 1998.
36. P. H. S. Torr, A. Zisserman, and S. Maybank, "Robust detection of degenerate configurations for the fundamental matrix." J. Comput. Vis. Image Understand., vol. 71, pp. 312-333, Sept. 1998.
37. H. S. Sawhney, Y. Guo, and R. Kumar, "Independent motion detection in 3D scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 1191-1199, Oct. 2000.
38. M. Piacentino, G. van der Wal, and M. Hansen, "Reconfigurable elements for a video pipeline processor," in Proc. IEEE Syrnp. Field-Programmable Custom Computing (FCCM99), Apr. 1999.
39. _, "The ACADIA vision processor," in Proc. IEEE Int. Workshop on Computer Architecture for Machine Perception, Padua, Italy, Sept. 2000.
40. J. Y. A. Wang and E. H. Adelson, "Layered representation for motion analysis," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1993, pp. 361-366.
41. H. Tao, H. S. Sawhney, and R. Kumar, "Dynamic layer representation with applications to tracking," in Proc. IEEE Conf. Computer Vision and Patter Recognition, Hilton Head, SC, 2000.
42. G. Hager and P. Belhumeur, "Real-time tracking of image regions with changes in geometry and illumination," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996, pp. 403-410.
43. M. J. Black and Y. Yacoob, "Tracking and recognizing rigid and nonrigid facial motions using local parametric models of image motion," in Proc. 5th Int. Conf. Computer Vision, ICCV'95, 1995, pp. 374-381.
44. L. Wixson, J. Eledath, M. Hansen, R. Mandelbaum, and D. Mishra, "Image alignment for precise camera fixation and aim," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.
45. R. Kumar, H. S. Sawhney, J. C. Asmuth, A. Pope, and S. Hsu, "Registration of video to geo-referenced imagery," in Proc. Int. Conf. Pattern Recognition, ICPR'98, Brisbane, Australia, Aug. 1998.
46. R. Kumar, S. Samarasekera, S. Hsu, and K. Hanna, "Registration of highly-oblique and zoomed in aerial video to reference imagery," in Proc. Int. Conf. Pattern Recognition, Barcelona, Spain, 2000.
47. R. Wildes, D. Hirvonen, S. Hsu, T. Klinedinst, R. Kumar, B. Lehman, B. Matei, and W. Zhao, "Video georegistration: Algorithm and quantitative evaluation," in Proc. IEEE Int. Conf. Computer Vision, Vancouver, July 2001.
48. "Rapid generation and use of 3D site models to aid imagery analysts/systems performing image exploitation," in Proc. SPIE Conf. Integrating Photogrammetric Techniques with Scene Analysis and Machine Vision, vol. 1944, Apr. 1993.
49. A. J. Heller, M. A. Fischler, R. C. Bolles, C. I. Connolly, R. Wilson, and J. Pearson, "An integrated feasibility demonstration for automatic population of geo-spatial databases," in 1998 Image Understanding Workshop, Monterey, CA, Nov. 20-23, 1998.
50. T. Drummond and R. Cipolla, "Real-time tracking of complex structures for visual serving," in Proc. Vision Algorithms Workshop in Conjunction with ICCV '99, 1999, pp. 91-98.
51. D. Lowe, "Robust model-based motion tracking through the integration of search and estimation," Int. J. Comput. Vis., vol. 8, no. 2, pp. 113-122, 1992.
52. R. Kumar and A. R. Hanson, "Robust methods for estimating pose and a sensitivity analysis," Comput. Vis. Graphics Image Process., vol. 60, pp. 313-342, Nov. 1994.
53. S. Hsu, S. Samarasekera, R. Kumar, and H. S. Sawhney, "Pose estimation, model refinement and enhanced visualization using video," in IEEE Proc. Computer Vision and Pattern Recognition, Hilton Head, SC, 2000, pp. 488-495.
54. J. Coughlan, D. Snow, C. English, and A. L. Yuille, "Efficient optimization of a deformable template using dynamic programming," in IEEE Proc. Computer Vision and Pattern Recognition., Hilton Head, SC, 2000.
55. H. Kollnig and H. H. Nagel, "3D pose estimation by fitting image gradients directly to polyhedral models," in Proc. IEEE Int. Conf. Computer Vision, 1995, pp. 569-574.
56. E. Marchand, P. Bouthemy, F. Chaumette, and V. Moreau, "Robust real-time visual tracking using a 2D-3D model-based approach," in Proc. Int. Conf. Computer Vision, vol. 1. 1999, pp. 262-268.
57. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model filling with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
58. H. Sawhney, S. Hsu, and R. Kumar, "Robust video mosaicing through topology inference and local to global alignment," in Proc. Eur. Conf. Computer Vision, Nov. 1998.
59. M. Irani, S. Hsu, and P. Anandan, "Video compression using mosaic representations," Signal Process. Image Commun., vol. 7, pp. 529-552, Nov. 1995.
60. M. Irani, P. Anandan, J. Bergen, R. Kumar, and S. Hsu, "Efficient representations of video sequences and their applications," Signal Process. Image Commun., vol. 8, pp. 327-351, 1996.
61. A. Pope, R. Kumar, H. Sawhney, and C. Wan, "Video abstraction: Summarizing video content for retrieval and visualization," in Proc. Asilomar Conf. Signals, Systems and Computers, 1998.