Quantitative experimental comparison of single-beam, sidescan, and multibeam benthic habitat maps

ICES Journal of Marine Science

Volumn 67, Issue 8, 2010, Pages 1766-1779

  Schimel, Alexandre C G ^a   Healy, Terry R ^a   Johnson, David ^b   Immenga, Dirk ^a  

^a UNIVERSITY OF WAIKATO   (New Zealand)

^b A Division of Meteorological Service of New Zealand   (New Zealand)

Author keywords

accuracy; average of mutual information (AMI); contingency matrix; Cram r's V; Goodman Kruskal's lambda; kappa statistic; Theil's uncertainty coefficient

Indexed keywords

ACCURACY ASSESSMENT; ACOUSTIC DATA; BENTHOS; COMPARATIVE STUDY; DATA SET; ECHO SOUNDER; EXPERIMENTAL STUDY; HABITAT MANAGEMENT; PIXEL; QUANTITATIVE ANALYSIS; REMOTE SENSING; SEAFLOOR MAPPING; SIDESCAN SONAR; UNCERTAINTY ANALYSIS;

AUCKLAND; NEW ZEALAND; NORTH ISLAND; TE MATUKU MARINE RESERVE; WAIHEKE ISLAND;

EID: 77958198977     PISSN: 10543139     EISSN: 10959289     Source Type: Journal    
DOI: 10.1093/icesjms/fsq102     Document Type: Article

References (86)

1. Abramowitz, M., and Stegun, I. A. 1964. Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables.
2. Dover, New York. 1046 pp.
3. Anderson, J. T., Gregory, R. S., and Collins,W. T. 2002. Acoustic classification of marine habitats in coastal Newfoundland. ICES Journal of Marine Science, 59: 156-167.
4. Anderson, J. T., Holliday, D. V., Kloser, R., Reid, D. G., and Simard, Y. 2008. Acoustic seabed classification: current practice and future directions. ICES Journal of Marine Science, 65: 1004-1011.
5. Atallah, L., Probert Smith, P. J., and Bates, C. R. 2002.Wavelet analysis of bathymetric sidescan sonar data for the classification of seafloor sediments in Hopva°gen Bay - Norway. Marine Geophysical Researches, 23: 431-442.
6. Beyer, A., Chakraborty, B., and Schenke, H. W. 2007. Seafloor classification of the mound and channel provinces of the Porcupine Seabight: an application of the multibeam angular backscatter data. International Journal of Earth Sciences, 96: 11-20.
7. Blondel, P., and Gómez Sichi, O. 2009. Textural analyses of multibeam sonar imagery from Stanton Banks, Northern Ireland continental shelf. Applied Acoustics, 70: 1288-1297.
8. Boots, B., and Csillag, F. 2006. Categorical maps, comparisons, and confidence. Journal of Geographical Systems, 8: 109-118.
9. Brennan, R. L., and Prediger, D. J. 1981. Coefficient kappa: some uses, misuses, and alternatives. Educational and Psychological Measurement, 41: 687-699.
10. Brown, C. J., and Coggan, R. 2007. Verification methods of acoustic classes. ICES Cooperative Research Report, 286: 116-131.
11. Brown, C. J., and Collier, J. S. 2008. Mapping benthic habitat in regions of gradational substrata: an automated approach utilising geophysical, geological, and biological relationships. Estuarine, Coastal and Shelf Science, 78: 203-214.
12. Brown, C. J., Cooper, K. M., Meadows, W. J., Limpenny, D. S., and Rees, H. L. 2002. Small-scale mapping of sea-bed assemblages in the eastern English Channel using sidescan sonar and remote sampling techniques. Estuarine, Coastal and Shelf Science, 54: 263-278.
13. Brown, C. J., Mitchell, A., Limpenny, D. S., Robertson, M. R., Service, M., and Golding, N. 2005. Mapping seabed habitats in the Firth of Lorn off the west coast of Scotland: evaluation and comparison of habitat maps produced using the acoustic ground-discrimination system, RoxAnn, and sidescan sonar. ICES Journal of Marine Science, 62: 790-802.
14. Cohen, J. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20: 37-46.
15. Collier, J. S., and Humber, S. R. 2007. Time-lapse side-scan sonar imaging of bleached coral reefs: a case study from the Seychelles. Remote Sensing of Environment, 108: 339-356.
16. Congalton, R. G. 1991. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sensing of Environment, 37: 35-46.
17. Couto, P. 2003. Assessing the accuracy of spatial simulation models. Ecological Modelling, 167: 181-198.
18. Cramér, H. 1946. Mathematical Methods of Statistics. Princeton University Press, Princeton, NJ. 575 pp.
19. Cutter, G. R., Rzhanov, Y., and Mayer, L. A. 2003. Automated segmentation of seafloor bathymetry from multibeam echosounder data using local Fourier histogram texture features. Journal of Experimental Marine Biology and Ecology, 285/286: 355-370.
20. Diaz, R. J., Solan, M., and Valente, R. M. 2004. A review of approaches for classifying benthic habitats and evaluating habitat quality. Journal of Environmental Management, 73: 165-181.
21. Dungan, J. L. 2006. Focusing on feature-based differences in map comparison. Journal of Geographical Systems, 8: 131-143.
22. Ehrhold, A., Hamon, D., and Guillaumont, B. 2006. The REBENT monitoring network, a spatially integrated, acoustic approach to surveying nearshore macrobenthic habitats: application to the Bay of Concarneau (South Brittany, France). ICES Journal of Marine Science, 63: 1604-1615.
23. Ellingsen, K. E., Gray, J. S., and Bjørnbom, E. 2002. Acoustic classification of seabed habitats using the QTC VIEWTM system. ICES Journal of Marine Science, 59: 825-835.
24. Finn, J. T. 1993. Use of the average mutual information index in evaluating classification error and consistency. International Journal of Geographical Information Science, 7: 349-366.
25. Fonseca, L., Brown, C., Calder, B., Mayer, L., and Rzhanov, Y. 2009. Angular range analysis of acoustic themes from Stanton Banks Ireland: a link between visual interpretation and multibeam echosounder angular signatures. Applied Acoustics, 70: 1298-1304.
26. Foody, G. M. 1992. On the compensation for chance agreement in image classification accuracy assessment. Photogrammetric Engineering and Remote Sensing, 58: 1459-1460.
27. Foody, G. M. 2002. Status of land cover classification accuracy assessment. Remote Sensing of Environment, 80: 185-201.
28. Foody, G. M. 2006. What is the difference between two maps? A remote senser's view. Journal of Geographical Systems, 8: 119-130.
29. Foody, G. M. 2007. Map comparison in GIS. Progress in Physical Geography, 31: 439-445.
30. Foody, G. M. 2008. Harshness in image classification accuracy assessment. International Journal of Remote Sensing, 29: 3137-3158.
31. Foody, G. M. 2009. Sample size determination for image classification accuracy assessment and comparison. International Journal of Remote Sensing, 30: 5273-5291.
32. Foster-Smith, R. L., Brown, C. J., Meadows, W. J., White, W. H., and Limpenny, D. S. 2001. Ensuring continuity in the development of broad-scale mapping methodology-direct comparison of RoxAnn and QTC-VIEW technologies. CEFAS Lowestoft Laboratory Contract Report, AE0908. 113 pp.
33. Foster-Smith, R. L., Brown, C. J., Meadows, W. J., White, W. H., and Limpenny, D. S. 2004. Mapping seabed biotopes at two spatial scales in the eastern English Channel. 2. Comparison of two acoustic ground discrimination systems. Journal of the Marine Biological Association of the UK, 84: 489-500.
34. Foster-Smith, R. L., and Sotheran, I. S. 2003. Mapping marine benthic biotopes using acoustic ground discrimination systems. International Journal of Remote Sensing, 24: 2761-2784.
35. Giri, C., Zhu, Z., and Reed, B. 2005. A comparative analysis of the Global Land Cover 2000 and MODIS land cover data sets. Remote Sensing of Environment, 94: 123-132.
36. Goodman, L. A., and Kruskal,W. H. 1954. Measures of association for cross classifications. Journal of the American Statistical Association, 49: 732-764.
37. Grace, R. V., and Whitten, R. F. 1974. Benthic communities west of Slipper Island, north-eastern New Zealand. Tane, 20: 4-20.
38. Hagen-Zanker, A. 2006. Map comparison methods that simultaneously address overlap and structure. Journal of Geographical Systems, 8: 165-185.
39. Hamilton, L. J., Mulhearn, P. J., and Poeckert, R. 1999. Comparison of RoxAnn and QTC-View acoustic bottom classification system performance for the Cairns area, Great Barrier Reef, Australia. Continental Shelf Research, 19: 1577-1597.
40. Heald, G. J., and Pace, N. G. 1996. An analysis of 1st and 2nd backscatter for seabed classification. Proceedings of the 3rd European Conference on Underwater Acoustics, Heraklion, Crete, Greece, 2: 649-654.
41. Hewitt, J. E., Thrush, S. F., Legendre, P., Funnell, G. A., Ellis, J., and Morrison, M. 2004. Mapping of marine soft-sediment communities: Integrated sampling for ecological interpretation. Ecological Applications, 14: 1203-1216.
42. Hughes Clarke, J. 1994. Toward remote seafloor classification using the angular response of acoustic backscattering: a case study from multiple overlapping GLORIA data. IEEE Journal of Oceanic Engineering, 19: 112-127.
43. Hutin, E., Simard, Y., and Archambault, P. 2005. Acoustic detection of a scallop bed from a single-beam echosounder in the St Lawrence. ICES Journal of Marine Science, 62: 966-983.
44. Huvenne, V. A. I., Blondel, P., and Henriet, J. P. 2002. Textural analyses of sidescan sonar imagery from two mound provinces in the Porcupine Seabight. Marine Geology, 189: 323-341.
45. Iampietro, P. J., Kvitek, R. G., and Morris, E. 2005. Recent advances in automated genus-specific marine habitat mapping enabled by high-resolution multibeam bathymetry. Marine Technology Society Journal, 39: 83-93.
46. Ierodiaconou, D., Burq, S., Reston, M., and Laurenson, L. 2007. Marine benthic habitat mapping using multibeam data, georeferenced video and image classification techniques in Victoria, Australia. Journal of Spatial Science, 52: 93-104.
47. Jackson, J. B. C., Kirby,M. X., Berger,W. H., Bjorndal, K. A., Botsford, L. W., Bourque, B. J., Bradbury, R. H., et al. 2001. Historical overfishing and the recent collapse of coastal ecosystems. Science, 293: 629-638.
48. Kenny, A. J., Cato, I., Desprez, M., Fader, G., Schüttenhelm, R. T. E., and Side, J. 2003. An overview of seabed-mapping technologies in the context of marine habitat classification. ICES Journal of Marine Science, 60: 411-418.
49. Kostylev, V. E., Todd, B. J., Fader, G. B. J., Courtney, R. C., Cameron, G. D. M., and Pickrill, R. A. 2001. Benthic habitat mapping on the Scotian Shelf based on multibeam bathymetry, surficial geology and sea floor photographs. Marine Ecology Progress Series, 219: 121-137.
50. Le Bas, T. P., and Huvenne, V. A. I. 2009. Acquisition and processing of backscatter data for habitat mapping-comparison of multibeam and sidescan systems. Applied Acoustics, 70: 1248-1257.
51. Legendre, P., Ellingsen, K. E., Bjørnbom, E., and Casgrain, P. 2002. Acoustic seabed classification: improved statistical method. Canadian Journal of Fisheries and Aquatic Sciences, 59: 1085-1089.
52. Lucieer, V. 2008. Object-oriented classification of sidescan sonar data for mapping benthic marine habitats. International Journal of Remote Sensing, 29: 905-921.
53. Lucieer, V., and Lucieer, A. 2009. Fuzzy clustering for seafloor classification. Marine Geology, 264: 230-241.
54. Lurton, X. 2002. An Introduction to Underwater Acoustics: Principles and Applications. Springer, London. 347 pp.
55. Ma, Z., and Redmond, R. L. 1995. Tau-coefficients for accuracy assessment of classification of remote-sensing data. Photogrammetric Engineering and Remote Sensing, 61: 435-439.
56. Marsh, I., and Brown, C. 2009. Neural network classification of multibeam backscatter and bathymetry data from Stanton Bank (Area IV). Applied Acoustics, 70: 1269-1276.
57. McCallum, I., Obersteiner, M., Nilsson, S., and Shvidenko, A. 2006. A spatial comparison of four satellite derived 1km global land cover datasets. International Journal of Applied Earth Observation and Geoinformation, 8: 246-255.
58. Michaels, W. L. 2007. Review of acoustic seabed classification systems. ICES Cooperative Research Report, 286: 94-115.
59. Monserud, R. A., and Leemans, R. 1992. Comparing global vegetation maps with the kappa statistic. Ecological Modelling, 62: 275-293.
60. Morrison, M., Drury, J., Shankar, U., Middleton, C., and Smith, M. 2003. A broad scale, soft sediment habitat assessment of the Hauraki Gulf. National Institute for Water and Atmospheric Research Client Report, AKL2003-64. 56 pp.
61. Morrison, M. A., Thrush, S. F., and Budd, R. 2001. Detection of acoustic class boundaries in soft sediment systems using the seafloor acoustic discrimination system QTC View. Journal of Sea Research, 46: 233-243.
62. Pace, N. G., and Gao, H. 1988. Swathe seabed classification. IEEE Journal of Oceanic Engineering, 13: 83-90.
63. Pauly, D., Christensen, V., Guénette, S., Pitcher, T. J., Sumaila, U. R., Walters, C. J., Watson, R., et al. 2002. Towards sustainability in world fisheries. Nature, 418: 689-695.
64. Pikitch, E. K., Santora, C., Babcock, E. A., Bakun, A., Bonfil, R., Conover, D. O., Dayton, P., et al. 2004. Ecosystem-based fishery management. Science, 305: 346-347.
65. Pouliquen, E., and Lyons, A. P. 2002. Backscattering from bioturbated sediments at very high frequency. IEEE Journal of Oceanic Engineering, 27: 388-402.
66. Prada, M. C., Appeldoorn, R. S., and Rivera, J. A. 2008. Improving coral reef habitat mapping of the Puerto Rico insular shelf using side scan sonar. Marine Geodesy, 31: 49-73.
67. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. 1992. Numerical Recipes in C: the Art of Scientific Computing. Cambridge University Press, New York. 994 pp.
68. Preston, J. M., Christney, A. C., Beran, L. S., and Collins, W. T. 2004a. Statistical seabed segmentation-from images and echoes to objective clustering. Proceedings of the Seventh European Conference on Underwater Acoustics, ECUA 2004, Delft, The Netherlands. 6 pp.
69. Preston, J. M., Christney, A. C., Collins, W. T., McConnaughey, R. A., and Syrjala, S. E. 2004b. Considerations in large-scale acoustic seabed characterization for mapping benthic habitats. ICES Document CM 2004/T: 13. 8 pp.
70. Rees, W. G. 2008. Comparing the spatial content of thematic maps. International Journal of Remote Sensing, 29: 3833-3844.
71. Reid, D. 2007. Accounting for spatial and temporal scales and interpolation in acoustic seabed classification surveys. ICES Cooperative Research Report, 286: 73-93.
72. Roberts, J. M., Brown, C. J., Long, D., and Bates, C. R. 2005. Acoustic mapping using a multibeam echosounder reveals cold-water coral reefs and surrounding habitats. Coral Reefs, 24: 654-669.
73. Russ, J. C. 2007. The Image Processing Handbook. CRC Press, Boca Raton, FL. 817 pp.
74. Schimel, A. C. G., Healy, T. R., McComb, P., and Immenga, D. 2010. Comparison of a self-processed EM3000 multibeam echosounder dataset with a QTC View habitat mapping and a sidescan sonar imagery, Tamaki Strait, New Zealand. Journal of Coastal Research, 26: 714-725.
75. Simard, Y., and Stepnowski, A. 2007. Classification methods and criteria. ICES Cooperative Research Report, 286: 61-72.
76. Simons, D. G., and Snellen, M. 2009. A Bayesian approach to seafloor classification using multi-beam echo-sounder backscatter data. Applied Acoustics, 70: 1258-1268.
77. Siwabessy, P. J. W., Penrose, J. D., Fox, D. R., and Kloser, R. J. 2000. Bottom classification in the continental shelf: a case study for the north-west and south-east shelf of Australia. Proceedings of the Australian Acoustical Society Conference, Joondalup, Australia. 6 pp.
78. Stanton, T. K. 2000. On acoustic scattering by a shell-covered seafloor. Journal of the Acoustical Society of America, 108: 551-555.
79. Stehman, S. V. 1999. Comparing thematic maps based on map value. International Journal of Remote Sensing, 20: 2347-2366.
80. Stehman, S. V. 2006. Design, analysis, and inference for studies comparing thematic accuracy of classified remotely sensed data: a special case of map comparison. Journal of Geographical Systems, 8: 209-226.
81. Stehman, S. V., and Czaplewski, R. L. 1998. Design and analysis for thematic map accuracy assessment: fundamental principles. Remote Sensing of Environment, 64: 331-344.
82. The Royal Forest and Bird Protection Society. 1998. Te Matuku marine reserve application Waiheke Island. The Royal Forest and Bird Protection Society of New Zealand Inc., Wellington. 31 pp.
83. Theil, H. 1972. Statistical Decomposition Analysis with Applications in the Social and Administrative Sciences. North-Holland, London. 337 pp.
84. Walker, B. K., Riegl, B., and Dodge, R. E. 2008. Mapping coral reef habitats in southeast Florida using a combined technique approach. Journal of Coastal Research, 24: 1138-1150.
85. White, R. 2006. Pattern based map comparisons. Journal of Geographical Systems, 8: 145-164.
86. Zajac, R. N., Lewis, R. S., Poppe, L. J., Twichell, D. C., Vozarik, J., and Digiacomo-Cohen, M. L. 2000. Relationships among sea-floor structure and benthic communities in Long Island Sound at regional and benthoscape scales. Journal of Coastal Research, 16: 627-640.