Near real-time orthorectification and mosaic of small UAV video flow for time-critical event response

IEEE Transactions on Geoscience and Remote Sensing

Volumn 47, Issue 3, 2009, Pages 739-747

  Zhou, Guoqing ^a,b  

^a Old Dominion University   (United States)

^b BEIJING NORMAL UNIVERSITY   (China)

Author keywords

Image flow; Image processing; Image registration; Unmanned aerial vehicle (UAV)

Indexed keywords

AUTOMOBILE FRAMES; IMAGE REGISTRATION; IMAGING SYSTEMS; REMOTELY OPERATED VEHICLES; VIDEO RECORDING;

BASIC PROCEDURES; CRITICAL EVENTS; DIFFERENTIAL GPS; EXTERIOR ORIENTATION PARAMETERS; IMAGE FLOW; INTERIOR ORIENTATION PARAMETERS; MISSISSIPPI; NEAR-REAL TIME; ORTHO RECTIFICATIONS; REAL TIME; SMALL UAV; TEST FIELDS; UNMANNED AERIAL VEHICLE (UAV); VIDEO DATUM; VIDEO FLOWS; VIDEO FRAMES; VIDEO IMAGES;

UNMANNED AERIAL VEHICLES (UAV);

IMAGE ANALYSIS; NUMERICAL MODEL; UNMANNED VEHICLE;

EID: 61349187118     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2008.2006505     Document Type: Article

References (38)

1. Y. I. Abdel-Aziz and H. M. Karara, "Direct linear transformation from comparator coordinates into object space coordinates in close-range photogrammetry," in Proc. Symp. Close-Range Photogramm., 1971, pp. 1-18.
2. B. D. Barber, J. D. Redding, T. W. McLain, R. W. Beard, and N. Clark, "Vision-based target geo-location using a fixed-wing miniature air vehicle," J. Intell. Robot. Syst., vol. 47, no. 4, pp. 361-382, Dec. 2006.
3. M. D. Bethea, J. A. Lock, F. Merat, and P. Crouser, "Three- dimensional camera calibration technique for stereo imaging velocimetry experiments," Opt. Eng., vol. 36, no. 12, pp. 3445-3454, Dec. 1997.
4. C. Bielski, J. Grazzini, and P. Soille, "Automated morphological image composition for mosaicking large image data sets," in Proc. IEEE IGARSS, 2007, pp. 4068-4071.
5. G. Bland, P. Coronado, T. Miles, P. Bretthauer, A. Lunsford, and J. Bognar, "'Sensors with wings'-Small UAVs for earth science," in Proc. Collection Tech. Papers AIAA 3rd 'Unmanned-Unlimited' Tech. Conf., Workshop, Exhib., 2004, pp. 317-327.
6. J.-F. Boer, M. L. Preatoni, and G. M. Saggiani, "Specific aspects in the preliminary design process for small Rotorcraft UAVs," in Proc. Int. 62nd Annu. Forum-Vertical Flight: Leading Through Innovation, 2006, pp. 887-898.
7. M. E. Campbell and M. Wheeler, "A vision based geolocation tracking system for UAVs," presented at the AIAA Guidance, Navigation, and Control Conf. and Exhibit, Keystone, CO, 2006, Paper no. AIAA-2006-6246.
8. M. Cramer and D. Stallmann, "System calibration for direct georeferencing," in Proc. Int. Soc. Photogramm. Remote Sens., Graz, Austria, Sep. 2002, vol. 34, pp. 79-84. Com. III, Part A.
9. V. N. Dobrokhodov, I.I. Kaminer, and K. D. Jones, "Vision-based tracking and motion estimation for moving targets using small UAVs," presented at the AIAA Guidance, Navigation, and Control Conf. and Exhibit, Keystone, CO, 2006, Paper no. AIAA-2006-6606.
10. Y. Du, J. Cihlar, J. Beaubien, and R. Latifovic, "Radiometric normalization, compositing, and quality control for satellite high resolution image mosaics over large areas," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 3, pp. 623-634, Mar. 2001.
11. A. G. Grejner-Brzezinska, "Direct exterior orientation of airborne imagery with GPS/INS system-performance analysis," J. Inst. Navig., vol. 46, no. 4, pp. 261-270, 1999.
12. D. Gibbins, P. Roberts, and L. Swierkowski, "A video geo-location and image enhancement tool for small unmanned air vehicles (UAVs)," in Proc. Intell. Sens., Sens. Netw. Inf. Process. Conf., Melborne, Australia, 2004, pp. 469-473.
13. D. Hausamann, W. Zirnig, G. Schreier, and P. Strobl, "Monitoring of gas pipelines-A civil UAV application," Aircr. Eng. Aerosp. Technol., vol. 77, no. 5, pp. 352-360, 2005.
14. S. R. Herwitz, R. Berthold, S. Dunagan, D. Sullivan, M. Fladeland, and J. A. Brass, "UAV homeland security demonstration," in Proc. AIAA 3rd 'Unmanned-Unlimited' Tech. Conf., Workshop, Exhib., 2004, pp. 396-400.
15. R. C. Hruska, G. D. Lancaster, J. L. Harbour, and S. J. Cherry, "Small UAV-acquired, high-resolution, georeferenced still imagery," in Proc. AUVSI's Unmanned Syst. North America, 2005, pp. 837-840.
16. E. N. Johnson, D. P. Schrage, and J. V. R. Prasad, "UAV flight test programs at Georgia Tech," in Proc. AIAA 3rd 'Unmanned-Unlimited' Tech. Conf., Workshop, Exhib., 2004, pp. 527-539.
17. E. N. Johnson, M. A. Turbe, A. D. Wu, S. K. Kannan, and J. C. Neidhoefer, "Flight test results of autonomous fixed-wing UAV transitions to and from stationary hover," in AIAA Guidance, Navigation, and Control Conf., Keystone, CO, Aug. 21-24, 2006Paper AIAA 2006-6775, pp. 5144-5167.
18. Y. Kang, D. S. Caveney, and J. K. Hedrick, "Probabilistic mapping for UAV using point-mass target detection," in AIAA Guidance, Navigation, and Control Conf., Keystone, CO, Aug. 21-24, 2006, pp. 1915-1926.
19. M. Li, C. L. Soo, and K. K. Leong, "Producing cloud free and cloudshadow free mosaic from cloudy IKONOS images," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2003, vol. 6, pp. 3946-3948.
20. Y Liu, W. Yanting, V. Chandrasekar, and V. N. Bringi, "Real-time threedimensional radar mosaic in CASA IP1 testbed," in Proc. IEEE IGARSS, 2007, pp. 2754-2757.
21. M. J. Logan, T. L. Vranas, M. Motter, Q. Shams, and D. S. Pollock, "Technology challenges in small UAV development," in Proc. Collection Tech. Papers-InfoTech Aerosp.: Advancing Contemporary Aerosp. Technol. Integr., 2005, vol. 3, pp. 1644-1648.
22. M. R. Mostafa, K. P. Schwarz, and M. A. Chapman, "Development and testing of an airborne remote sensing multi-sensor system," in Proc. ISPRS Commission II, Symp. Data Integr: Syst. Tech., Cambridge, U.K., 1998.
23. V. Narli and P. Y Oh, "Near-earth unmanned aerial vehicles: Sensor suite testing and evaluation," in Proc. ASME Int. DETC Comput. Inf. Eng. Conf., 2006. 7p.
24. D. R. Nelson, T. W. McLain, R. S. Christiansen, R. W. Beard, and D. Johansen, "Initial experiments in cooperative control of unmanned air vehicles," in Proc. Collection Tech. Papers AIAA 3rd 'Unmanned-Unlimited' Tech. Conf., Workshop, Exhib., 2004, pp. 666-674.
25. P. Y. Oh, "Flying insect inspired vision for micro-air-vehicle navigation," in Proc. AUVSI's Unmanned Syst. North America, 2004, pp. 2201-2208.
26. G. Postell and P. Thomas, "Wallops flight facility Uninhabited Aerial Vehicle (UAV) user's handbook," Suborbital Special Orbital Projects Directorate, NASA Wallops Flight Facility, Wallops Island, VA, Apr. 15, 2005840-HDBK-0002. [Online]. Available: http://www.wff. aasa.gov
27. A. D. Ryan, D. L. Nguyen, and J. K. Hedrick, "Hybrid control for UAV-assisted search and rescue," in Proc. ASME Dyn. Syst. Control Division, Orlando, FL, Nov. 5-11, 2005, pp. 187-195.
28. K. P. Schwarz, M. E. Chapman, E. Cannon, and P. Gong, "An integrated INS/GPS approach to the georeferencing of remotely sensed data," Photogramm. Eng. Remote Sens., vol. 59, no. 11, pp. 1667-1674, 1993.
29. D. Shin, J. K. Pollard, and J. P. Muller, "Accurate geometric correction of ATSR images," IEEE Trans. Geosci. Remote Sens., vol. 35, no. 4, pp. 997-1006, Jul. 1997.
30. M. Simard, S. Saatchi, and G. DeGrandi, "Classification of the Gabon SAR mosaic using a wavelet based rule classifier," in Proc. IEEE IGARSS, 1999, vol. 5, pp. 2768-2770.
31. B. Sinopoli, M. Micheli, G. Donato, and T. J. Koo, "Vision based navigation for an unmanned aerial vehicle," in Proc. IEEE ICRA, Seoul, Korea, May 21-26, 2001, pp. 1757-1764.
32. J. Skaloud, M. Cramer, and K. P. Schwarz, "Exterior orientation by direct measurement of camera and position," Int. Arch. Photogramm. Remote Sens., vol. XXXI, no. B3, pp. 125-130, 1996.
33. I. H. Whang, V. N. Dobrokhodov, I. I. Kaminer, and K. D. Jones, "On vision-based tracking and range estimation for small UAVs," presented at the AIAA Guidance, Navigation, and Control Conf. and Exhibit, San Francisco, CA, 2005, Paper no. AIAA-2005-6401.
34. N. Yastikli and K. Jacobsen, "Influence of system calibration on direct sensor orientation," Photogramm. Eng. Remote Sens., vol. 71, no. 5, pp. 629-633, 2005.
35. Y Sheng and D. E. Alsdorf, "Automated georeferencing and or thorectification of Amazon basin-wide SAR mosaics using SRTM DEM data," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 8, pp. 1929-1940, Aug. 2005.
36. G. Zhou, J. Wu, S. Wright, and J. Gao, "High-resolution UAV video data processing for forest fire surveillance," in "Technical Report to National Science Foundation," Old Dominion Univ., Norfolk, VA, Aug. 2006. 82p.
37. G. Zhou, G. K. Jezek, and W Wright, "Orthorectification of 1960s satellite photographs covering Greenland," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 6, pp. 1247-1259, Jun. 2002.
38. G. Zhou, W Chen, J. Kelmelis, and D. Zhang, "A comprehensive study on urban true orthorectification," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 9, pp. 2138-2147, Sep. 2005.