The fusion of large scale classified side-scan sonar image mosaics

IEEE Transactions on Image Processing

Volumn 15, Issue 7, 2006, Pages 2049-2060

  Reed, Scott ^a,b   Tena Ruiz, Ioseba ^a   Capus, Chris ^a   Petillot, Yvan ^a  

^a HERIOT WATT UNIVERSITY   (United Kingdom)

^b SEEBYTE LTD   (United Kingdom)

Author keywords

Classification; Fusion; Markov random fields; Mosaicing; Registration; Side scan sonar (SSS); Simultaneous localization and mapping (SLAM)

Indexed keywords

CLASSIFICATION (OF INFORMATION); IMAGE SEGMENTATION; MARKOV PROCESSES; MATHEMATICAL MODELS; PROBABILITY; SONAR;

IMAGE MOSAICS; MARKOV RANDOM FIELDS; SIDE-SCAN SONAR (SSS); SIMULTANEOUS LOCALIZATION AND MAPPING (SLAM);

ACOUSTIC IMAGING;

ACOUSTICS; ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING;

ACOUSTICS; ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 33745592534     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2006.873448     Document Type: Article

References (69)

1. J. G. Bellingham, C. A. Goudey, T. R. Consi, J. W. Bales, D. K. Atwood, J. J. Leonard, and C. Chryssostomidis, "A second generation survey AUV," in Proc. Autonomous Underwater Vehicle Technology, Jul. 1994, pp. 148-155.
2. A. Ishoy, "How to make survey instruments "AUV-friendly"," in Proc. MTS/IEEE Int. Conf. OCEANS, 2000, pp. 1647-1652.
3. C. von Alt, B. Allen, T. Austin, N. Forrester, R. Goldsborough, M. Purcell, and R. Stokey, "Hunting for mines with REMUS: A high performance, affordable, free swimming underwater robot," in Proc. MTS/IEEE Int. Conf. OCEANS, 2001, pp. 117-122.
4. K. J. Cuevas, M. V. Buchanan, and D. Moss, "Utilizing side scan sonar as an artificial reef management tool," in Proc. MTS/IEEE Int. Conf. OCEANS, 2002, pp. 136-140.
5. D. Diaz, K. Cuevas, M. V. Buchanan, S. Gordon, and W. S. Perret, "Side scan sonar in oyster management," in Proc. MTS/IEEE Int. Conf. OCEANS, 2002, pp. 141-145.
6. B. G. Gonzalez, Y. Petillot, and C. Smith, "Detection and classification of trawling marks in side scan sonar images," presented at the Advances in Technology for Underwater Vehicles Conf., Mar. 2004.
7. S. Reed, J. Bell, and Y. Petillot, "An unsupervised approach to the detection and extraction of mine features in side scan sonar," in CAD/CAC Conf., Halifax, NS, Canada, Nov. 2001, to be published.
8. R. J. Urick, Principles of Underwater Sound. New York: McGraw-Hill, 1975.
9. C. Mazel, "Side Scan Sonar Record Interpretation," Klein Assoc., Inc., 1985.
10. J. Chatillon, A. E. Adams, M. A. Lawlor, and M. E. Zakharia, "SAMI: A low-frequency prototype for mapping and imaging of the seabed by means of synthetic aperture," IEEE J. Ocean. Eng., vol. 24, no. 1, pp. 4-15, Jan. 1999.
11. APL-UW, APL-UW High-Frequency Ocean Environmental Acoustic Models Handbook. Seattle, CA: Appl. Phys. Lab., Univ. Washington, 1994.
12. J. M. Bell, "A Model for the Simulation of Sidescan Sonar," Ph.D. dissertation, Heriot-Watt Univ., Edinburgh, U.K., Sep. 1995.
13. C. Capus, I. Tena Ruiz, and Y. Petillot, "Compensation for changing beam pattern and residual tvg effects with sonar altitude variation for sidescan mosaicing and classification," presented at the 7th. Eur. Conf. Underwater Acoustics, Delft, The Netherlands, 2004.
14. S. Anstee, "Removal of Range-Dependent Artifacts From Sidescan Sonar Imagery," DSTO Aeronautical1 and Maritime Res. Lab., Australia, Tech. Rep. DSTO-TN-0354, Apr. 2001.
15. R. D. Muller, N. C. Overkov, J.-Y. Royer, A. Dutkiewics, and J. B. Keene, "Seabed classification of the south tasminrise from simrad em12 backscatter data using artificial neural networks," Austral. J. Earth Sci., pp. 689-700, 1997.
16. W. K. Stewart, M. Marra, and M. Jiang, "A hierarchical approach to seafloor classification using neural networks," in Proc. IEEE Int. OCEANS Conf., Oct. 1992, pp. 109-113.
17. B. Bourgeois and C. Walker, "Sidescan sonar image interpretation with neural networks," in Proc. IEEE Int. OCEANS Conf., Honolulu, HI, 1991, pp. 1687-1694.
18. W. K. Stewart, M. Jiang, and M. Marra, "A neural network approach to classification of sidescan sonar imagery from a midocean ridge area," IEEE J. Ocean. Eng., vol. 19, no. 2, pp. 214-224, Apr. 1994.
19. B. Zerr, E. Maillard, and D. Gueriot, "Seafloor classification by neural hybrid system," in Proc. IEEE Int. OCEANS Conf., 1994, pp. 239-243.
20. D. Alexandrou and D. Pantzartzis, "Seafloor classification with neural networks," in Proc. IEEE Int. OCEANS Conf., Washington, DC, 1990, pp. 18-23.
21. Z. Reut, N. G. Pace, and M. J. P. Heaton, "Computer classification of seabeds by sonar," Nature, pp. 426-428, 1985.
22. N. G. Pace and H. Gao, "Swathe seabed classification," IEEE J. Ocean. Eng., vol. 13, no. 2, pp. 83-90, Apr. 1988.
23. D. Tamsett, "Seabed characterization and classification from the power spectra of sidescan sonar data," Marine Geophys. Res., pp. 43-64, 1993.
24. D. R. Carmichael, L. M. Linnett, S. J. Clarke, and B. R. Calder, "Seabed classification through multifractal analysis of sidescan sonar imagery," Inst. Elect. Eng. Radar, Sonar, Navig., no. 3, pp. 140-148, 1996.
25. L. M. Linnett, D. R. Carmichael, S. J. Clarke, and A. D. Tress, "Texture analysis of sidescan sonar data," presented at the IEE Conf. Texture Analysis in Radar and Sonar, London, U.K., Nov. 1993.
26. B. R. Dasarathy and E. B. Holder, "Image characterizations based on joint gray-level run-length distributions," Pattern Recognit. Lett., pp. 497-502, 1991.
27. R. M. Haralick, K. Shanmugam, and I. Dinstein, "Textrural features for image classification," IEEE Trans. Syst., Man, Cybern., vol. SMC-2, no. 6, pp. 610-621, Nov. 1973.
28. S. Subramaniam, H. Barad, and A. B. Martinez, "Seafloor characterization using texture," presented at the IEEE South East Conf., New Orleans, LA, Apr. 1993.
29. M. Mignotte, C. Collet, P. Perez, and P. Bouthemy, "Fuzzy logic modeling in sonar imagery: Application to the classification of underwater floor," Comput. Vis. Image Understand., pp. 4-24, 2000.
30. D. T. Cobra and H. A. de Moraes, "Classification of sidescan sonar images through parametric modeling," in Proc. IEEE Int. OCEANS Conf., Brest, France, 1994, pp. 109-113.
31. D. Gueriot, "Bathymetric and side-scan data fusion for sea-bottom 3-D mosaicing," in Proc. MTS/IEEE Int. Conf. OCEANS, 2000, pp. 1663-1668.
32. I. Tena Ruiz, Y. Petillot, and D. M. Lane, "Improved AUV navigation using side-scan sonar," in Proc. MTS/IEEE Int. Conf. OCEANS, 2003, pp. 1261-1268.
33. J. J. Leonard, R. N. Carpenter, and H. J. S. Feder, "Stochastic mapping using forward look sonar," in Proc. Int. Conf. Field Service Robotics, Pittsburgh, PA, Aug. 1999, pp. 69-74.
34. I. Tena Ruiz, Y. Petillot, D. M. Lane, and C. Salson, "Feature extraction and data association for AUV concurent mapping and localization," in Proc. IEEE Int. Conf. Robotics Automation, Seoul, Korea, May 2001, pp. 2785-2790.
35. I. Tena Ruiz, S. de Raucourt, Y. Petillot, and D. M. Lane, "Concurrent mapping and localization using side-scan sonar," IEEE J. Ocean. Eng., vol. 29, no. 2, pp. 442-456, Apr. 2004.
36. H. Singh, C. Roman, L. Whitcomb, and D. Yoerger, "Advances in fusion of high resolution underwater optical and acoustic data," in Proc. IEEE Int. Symp. Underwater Technology, May 2000, pp. 206-211.
37. J. Wright, K. Scott, T.-H. Chao, and B. Lau, "Advances in fusion of high resolution underwater optical and acoustic data," in Proc. IEEE Symp. Autonomous Underwater Vehicle Technology, Jun. 1996, pp. 167-175.
38. A. Solberg, A. Jain, and T. Taxt, "Multisource classification of remotely sensed data: Fusion of landsat TM and SAR images," IEEE Trans. Geosci. Remote Sens., vol. 32, no. 4, pp. 768-778, Jul. 1994.
39. I. Bloch, "Information combination operators for data fusion: A comparative review with classification," IEEE Trans. Syst., Man, Cybern. A, vol. 26, no. 1, pp. 52-67, Jan. 1996.
40. I. Bloch, "Some aspects of Dempster-Shafer evidence theory for classification of multi-modality medical images taking partial volume into account," Pattern Recognit. Lett., pp. 905-919, 1996.
41. S. Foucher, M. Germain, J.-M. Boucher, and G. Benie, "Multisource classification using ICM and Dempster-Shafer theory," IEEE Trans. Instrum. Meas., vol. 51, no. 2, pp. 277-281, Apr. 2002.
42. L. Fouque, A. Appriou, and W. Pieczynski, "An evidential Markovian model for data fusion and unsupervised image classification," in Proc. 3rd ISIF Int. Conf. Information Fusion, 2000, pp. 25-32.
43. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
44. L. Xu, A. Krzyzak, and C. Y. Suen, "Methods of combining multiple classifiers and their applications to handwriting recognition," IEEE Trans. Syst., Man, Cybern., vol. 22, no. 3, pp. 418-435, May/Jun. 1992.
45. S. L. Hegarat-Mascle, I. Bloch, and D. Vidal-Madjar, "Application of Dempster-Shafer evidence theory to unsupervised classification in multisource remote sensing," IEEE Trans. Geosci. Remote Sens., vol. 35, no. 4, pp. 1018-1031, Jul. 1997.
46. J. V. Cleynenbreugel, S. A. Osinga, F. Fierens, P. Suetens, and A. Oosterlinck, "Road extraction from multi-temporal satellite images by an evidential reasoning approach," Pattern Recognit. Lett., pp. 371-380, Jun. 1991.
47. L. Fouque, A. Appriou, and W. Pieczynski, "Multiresolution hidden Markov chain model and unsupervised image segmentation," in Proc. 4th IEEE Southwest Symp. Image Analysis and Interpretation, 2000, pp. 121-125.
48. A. Bendjebbour, Y. Delignon, L. Fouque, V. Samsom, and W. Pieczynski, "Muitisensor image segmentation using Dempster-Shafer fusion in Markov fields context," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 8, pp. 1789-1798, Aug. 2001.
49. S. L. Hegarat-Mascle, A. Quesney, D. Vidal-Madjar, and O. Taconet, "Land cover discrimination from multitemporal ERS images and multi-spectral landsat images: A study case in an argicultural area in France," Int. J. Remote Sens., no. 3, pp. 435-456, 2000.
50. W. A. Wright, "Fast image fusion with a Markov random field," in Proc. IEE Conf. Image Processing and Its Applications, 1999, pp. 557-561.
51. D. Geman, S. Geman, C. Graffigne, and P. Dong, "Boundary detection by constrained optimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 609-628, Jul. 1990.
52. J. Besag, "On the statistical analysis of dirty pictures," J. Roy. Statist. Soc., no. 3, pp. 261-279, 1986.
53. J. A. Benediktsson and I. Kanellopoulos, "Classification of multisource and hyperspectral data based on decision fusion," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1367-1377, May 1999.
54. N. A. Brokloff, "Matrix algorithm for doppler sonar navigation," in Proc. IEEE Int. Conf. OCEANS, 1994, pp. III/378-III/383.
55. R. Cox and S. Wei, "Advances in the state of the art for AUV inertial sensors and navigation systems," IEEE J. Ocean. Eng., vol. 20, no. 4, pp. 361-366, Oct. 1995.
56. G. Grenon, P. E. An, S. M. Smith, and A. J. Healey, "Enhancement of the inertial navigation system for the Morpheus autonomous underwater vehicles," IEEE J. Ocean. Eng., vol. 26, no. 4, pp. 548-560, Oct. 2001.
57. K. Vickery, "Acoustic positioning systems, a practical overview of current systems," in Proc. Autonomous Underwater Vehicle Technology, Aug. 1998, pp. 5-17.
58. O. Bergem, "Bathymetric Navigation of Autonomous Underwater Vehicles Using a Multibeam Sonar and a Kalman Filter With Relative Measurement Covariance Matrices," Ph.D. dissertation, Univ. Trondheim, Norway, Dec. 1993.
59. M. Sistiaga, J. Opderbecke, and M. Aldon, "Depth image matching for underwater vehicle navigation," in Int. Conf. Image Analysis Processing, 1999, pp. 624-629.
60. E. Coiras, I. Tena Ruiz, Y. Petillot, and D. M. Lane, "Fusion of multiple side-scan sonar views," presented at the IEEE Int. Conf. OCEANS, 2004.
61. P. Maybeck, Stochastic Models, Estimation and Control. New York: Academic, 1982, vol. 141-142.
62. Y. Bar-Shalom and T. Fortmann, Tracking and Data Association. New York: Academic, 1988, vol. 179.
63. R. Smith, M. Self, and P. Cheeseman, "Estimating uncertain spatial relationships in robotics," in Autonomous Robot Vehicles, I. Cox and G. Wilfong, Eds. New York: Springer-Verlag, 1990.
64. M. W. M. G. Dissanayake, H. Durrant-Whyte, S. Clark, and M. Csorba, "A solution to the simultaneous localization and map building (SLAM) problem," Univ. Sydney, Sydney, Australia, Tech. Rep. ACFR-TR-01-99, Jan. 1999.
65. A. Gelb, Ed., Applied Optimal Estimation. Cambridge, MA: MIT Press, 1974.
66. M. Mignotte, C. Collet, P. Perez, and P. Bouthemy, "Sonar image segmentation using an unsupervised hierarchical MRF model," IEEE Trans. Image Process., vol. 9, no. 7, pp. 1216-1231, Jul. 2000.
67. H. Derin and H. Elliot, "Modeling and segmentation of noisy and textured images using Gibbs random field," IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, no. 1, pp. 39-55, Jan. 1987.
68. MeasTex ImageTexture Database and Test Suite, MeasTex. (1997, May). [Online]. Available: http://www.cssip.uq.edu.au/meastex/meastex.html
69. I. Tena Ruiz, Y. Petillot, D. M. Lane, and A. Cormack, "Large scale side-scan sonar mosaics," presented at the Maritime Reconnaissance for NATO's Recognized Environmental Picture (MREP), La Spezia, Italy, May 2003.