Classification of large acoustic datasets using machine learning and crowdsourcing: Application to whale calls

Journal of the Acoustical Society of America

Volumn 135, Issue 2, 2014, Pages 953-962

  Shamir, Lior ^a   Yerby, Carol ^a   Simpson, Robert ^b   Von Benda Beckmann, Alexander M ^c   Tyack, Peter ^d   Samarra, Filipa ^d   Miller, Patrick ^d   Wallin, John ^e  

^a LAWRENCE TECHNOLOGICAL UNIVERSITY   (United States)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c TNO   (Netherlands)

^d UNIVERSITY OF ST ANDREWS   (United Kingdom)

^e MIDDLE TENNESSEE STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO SENSORS; CITIZEN SCIENCE; COMMUNICATION METHOD; COMPUTER ANALYSIS; COMPUTER METHODS; CROWDSOURCING; KILLER WHALE; WHALE CALLS;

CLASSIFICATION (OF INFORMATION); COMMUNICATION; SEPARATION;

AUDIO ACOUSTICS;

ACOUSTICS; ANIMAL; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; COMPARATIVE STUDY; CROWDSOURCING; DATA MINING; ECOSYSTEM; FACTUAL DATABASE; KILLER WHALE; MOTION; PHYSIOLOGY; PILOT WHALE; PROCEDURES; PSYCHOLOGY; SIGNAL PROCESSING; SOUND; SOUND DETECTION; SPECIES DIFFERENCE; TIME; VOCALIZATION;

ACOUSTICS; ANIMALS; ARTIFICIAL INTELLIGENCE; CROWDSOURCING; DATA MINING; DATABASES, FACTUAL; ECOSYSTEM; MOTION; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOUND; SOUND SPECTROGRAPHY; SPECIES SPECIFICITY; TIME FACTORS; VOCALIZATION, ANIMAL; WHALE, KILLER; WHALES, PILOT;

EID: 84900602686     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4861348     Document Type: Article

References (44)

1. Barlow, H. B. (1989). "Unsupervised learning," Neural Comput. 1, 295-311. 10.1162/neco.1989.1.3.295
2. Barrett-Lennard, L. G., Ford, J. K. B., and Heise, K. A. (1996). "The mixed blessing of echolocation: Differences in sonar use by fish-eating and mammal-eating killer whales," Anim. Behav. 51, 553-566. 10.1006/anbe.1996.0059
3. Bishop, C. M. (2006). Pattern Recognition and Machine Learning (Springer, New York), pp. 191-192.
4. Deecke, V. B., Ford, J. K. B., and Spong, P. (1999). "Quantifying complex patterns of bioacoustic variation: Use of a neural network to compare killer whale (Orcinus orca) dialects," J. Acoust. Soc. Am. 105, 2499-2507. 10.1121/1.426853
5. Felsenstein, M. (2004). "PHYLIP phylogeny inference package," Version 36, 2004 (2004).
6. Fischer, D., Schwamb, M., Schawinski, K., Lintott, C., Brewer, J., Giguere, M., Lynn, S., Parrish, M., Sartori, T., Simpson, R., Smith, A., Spronck, J., Batalha, N., Rowe, J., Jenkins, J., Bryson, S., Prsa, A., Tenenbaum, P., Crepp, J., Morton, T., Howard, A., Beleu, M., Kaplan, Z., vanNispen, N., Sharzer, C., DeFouw, J., Hajduk, A., Neal, J., Nemec, A., Schuepbach, N., and Zimmermann, V. (2012). "Planet Hunters: The first two planet candidates identified by the public using the Kepler Public Archive Data," Mon. Not. R. Astron. Soc. 419, 2900-2911. 10.1111/j.1365-2966.2011. 19932.x
7. Ford, J. K. B. (1989). "Acoustic behavior of resident killer whales (Orcinus orca) off Vancouver Island, British Columbia," Can. J. Zool. 67, 727-745. 10.1139/z89-105
8. Ford, J. K. B., Ellis, G. M., and Balcomb, K. C. (2000). Killer whales: The Natural History and Genealogy of Orcinus orca in British Columbia and Washington, 2nd ed. (University of British Columbia Press, Vancouver), pp. 1-104.
9. Glotin, H., Caudal, F., and Giraudet, P. (2008). "Whales cocktail party: A real-time tracking of multiple whales," Int. J. Can. Acoust. 36, 141-147 (2008).
10. Johnson, M. P., and Tyack, P. L. (2003). "A digital acoustic recording tag for measuring the response of wild marine mammals to sound," IEEE J. Ocean. Eng. 28, 3-12. 10.1109/JOE.2002.808212
11. Kumar, A. R., and Johnson. D. H. (1993). "Analyzing and modeling fractal intensity point processes," J. Acoust. Soc. Am. 93, 3365-3373. 10.1121/1.405692
12. Lintott, C., Schawinski, K., Bamford, S., Slosar, A., Land, K., Thomas, D., Edmondson, E., Masters, K., Nichol, R., Raddick, M. J., Szalay, A., Andreescu, D., Murray, P., and van den Berg, J. (2011). "Galaxy zoo 1: Data release of morphological classifications for nearly 900,000 galaxies," Mon. Not. R. Astron. Soc. 410, 166-178. 10.1111/j.1365-2966.2010.17432.x
13. Lintott, C., Schawinski, K., Slosar, A., Land, K., Bamford, S., Thomas, D., Raddick, M. J., Nichol, R., Szalay, A., Andreescu, D., Murray, P., and van den Berg, J. (2008). "Galaxy zoo: Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey," Mon. Not. R. Astron. Soc. 389, 1179-1189. 10.1111/j.1365-2966.2008.13689.x
14. Miller, P. J. O. (2006). "Diversity in sound pressure levels and estimated active space of resident killer whale vocalizations," J. Comp. Physiol., A 192, 449-459. 10.1007/s00359-005-0085-2
15. Miller, P. J. O., and Bain, D. E. (2000). "Within-pod variation in the sound production of a pod of killer whales, Orcinus orca," Anim. Behav. 60, 617-628. 10.1006/anbe.2000.1503
16. Miller, P. J. O., Kvadsheim, P., Lam, F. P. A., Wensveen, P. J., Antunes, R., Alves, A. C., Visser, F., Kleivane, L., Tyack, P. L., and Doksæter Sivle, L. (2012). "The severity of behavioral changes observed during experimental exposures of killer (Orcinus orca), long-finned pilot (Globicephala melas), and sperm whales (Physeter macrocephalus) to naval sonar," Aquat. Mamm. 38, 362-401. 10.1578/AM.38.4.2012.362
17. Miller, P. J. O., Shapiro, A. D., Tyack, P. L., and Solow, A. R. (2004) "Call-type matching in vocal exchanges of free-ranging resident killer whales Orcinus orca," Anim. Behav. 67, 1099-1107. 10.1016/j.anbehav.2003. 06.017
18. Nousek, A. E., Slater, P. J. B., Wang, C., and Miller, P. J. O. (2006). "The influence of social affiliation on individual vocal signatures of northern resident killer whales (Orcinus orca)," Biol. Lett. 2, 481-484. 10.1098/rsbl.2006.0517
19. Oswald, J. N., Barlow, J., and Norris, T. F. (2003). "Acoustic identification of nine delphinid species in the eastern tropical Pacific Ocean," Marine Mammal Science 19, 20-37. 10.1111/j.1748-7692.2003.tb01090.x
20. Ottensmeyer, C. A., and Whitehead, H. (2003). "Behavioural evidence for social units in long-finned pilot whales," Can. J. Zool. 81, 1327-1338. 10.1139/z03-127
21. Pickover, C. A., and Khorasani, A. (1986). "Fractal characterization of speech waveform graphs," Comput. Graph. 10, 51-61. 10.1016/0097- 8493(86)90068-3
22. Riesch, R., and Deecke, V. (2011). "Whistle communication in mammal-eating killer whales (Orcinus orca): Further evidence for acoustic divergence between ecotypes," Behav. Ecol. Sociobiol. 65, 1377-1387 10.1007/s00265-011-1148-8
23. Riesch, R., Ford, J. K. B., and Thomsen, F. (2006). "Stability and group specificity of stereotyped whistles in resident killer whales, Orcinus orca, off British Columbia," Anim. Behav. 71, 79-91. 10.1016/j.anbehav. 2005.03.026
24. Samarra, F. I. P., Deecke, V. B., Vinding, K., Rasmussen, M. H., Swift, R. J., and Miller, P. J. O. (2010). "Killer whales (Orcinus orca) produce ultrasonic whistles," J. Acoust. Soc. Am. 128, EL205-EL210. 10.1121/1.3462235
25. Sayigh, L., Quick, N., Hastile, G., and Tyack, P. (2013). "Repeated call types in short-finned pilot whales, Globicephala macrorhynchus," Marine Mammal Sci. 29, 312-324. 10.1111/j.1748-7692.2012.00577.x
26. Schevill, W. E., and Watkins, W. A. (1966). "Sound structure and directionality in Orcinus (killer whale)," Zoologica (N.Y.) 51, 71-76.
27. Shamir, L. (2009). "Automatic morphological classification of galaxy images," Mon. Not. R. Astron. Soc. 399, 1367-1372. 10.1111/j.1365-2966. 2009.15366.x
28. Shamir, L., Delaney, J., Orlov, N., Eckley, D. M., and Goldberg, I. G. (2010b). "Pattern recognition software and techniques for biological image analysis," PLoS Comput. Biol. 6, e1000974. 10.1371/journal.pcbi.1000974
29. Shamir, L., Ling, S., Rahimi, S., Ferrucci, L., and Goldberg, I. (2009a) "Biometric identification using knee X-rays," Biometrics 1, 365-370. 10.1504/IJBM.2009.024279
30. Shamir, L., Ling, S. M., Scott, W., Boss, A., Orlov, N., Macura, T., Eckley, D. M., Ferrucci, L., and Goldberg, I. G. (2009b). "Knee X-ray image analysis method for automated detection of Osteoarthritis," IEEE Trans. Biomed. Eng. 56, 407-415. 10.1109/TBME.2008.2006025
31. Shamir, L., Macura, T., Orlov, N., Eckley, D. M., and Goldberg, I. G. (2010a). "Impressionism, expressionism, surrealism: Automated recognition of painters and schools of art," ACM Trans. Appl. Percept. 7 (2), 1. 10.1145/1670671.1670672
32. Shamir, L., Orlov, N., Eckley, D. M., Macura, T., and Goldberg, I. G. (2008b). "IICBU 2008-A proposed benchmark suite for biological image analysis," Med. Bio. Eng. Comp. 46, 943-947. 10.1007/s11517-008-0380-5
33. Shamir, L., Orlov, N. D., Eckley, M., Macura, T., Johnston, J., and Goldberg, I. G. (2008a). "Wndchrm-An open source utility for biological image analysis," Source Code Biol. Med. 3, 13. 10.1186/1751-0473-3-13
34. Shamir, L., and Tarakhovsky, J. (2012). "Computer analysis of art," ACM J. Comput. Cultural Heritage 5 (2), 7. 10.1145/2307723.2307726
35. Simpson, R., Povich, M., Kendrew, S., Lintott, C., Bressert, E., Arvidsson, K., Cyganowski, C., Maddison, S., Schawinski, K., Sherman, R., Smith, A., and Wolf-Chase, G. (2012). "The Milky Way Project first data release: A bubblier galactic disc," Mon. Not. R. Astron. Soc. 424, 2442-2460. 10.1111/j.1365-2966.2012.20770.x
36. Svatora, S., and Shamir, L. (2012). "Improving Eastern Bluebird nest box performance using computer analysis of satellite images," Comput. Ecol. Software 2, 96-102.
37. Teague M. (1980). "Image analysis via the general theory of moments," J. Opt. Soc. Am. 70, 920-930. 10.1364/JOSA.70.000920
38. Thomsen, F., Franck, D., and Ford, K. B. (2002). "On the communicative significance of whistles in wild killer whales (Orcinus orca)," Naturwissenschaften 89, 404-407. 10.1007/s00114-002-0351-x
39. Tyack, P. L., Johnson, M., Aguilar, N., Sturlese, A., and Madsen, P. (2006). "Extreme diving of beaked whales," J. Exp. Biol. 209, 4238-4253. 10.1242/jeb.02505
40. Tzanetakis, G., and Cook, P. (2002). "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process. 10, 293-302. 10.1109/TSA.2002.800560
41. van Parijs, S. M., Clark, C. W., Sousa-Lima, R. S., Parks, S. E., Rankin, S., Risch, D., and Van Opzeeland, I. C. (2009). "Management and research applications of real-time and archival passive acoustic sensors over varying temporal and spatial scales," Mar. Ecol.: Prog. Ser. 395, 21-36. 10.3354/meps08123
42. von Benda-Beckmann, A. M., Lam, F. P. A., Moretti, D. J., Fulkerson, K., Ainslie, M. A., van IJsselmuide, S. P., Theriault, J., and Beerens, S. P. (2010). "Detection of Blainville's beaked whales with towed arrays," Appl. Acoust. 71, 1027-1035. 10.1016/j.apacoust.2010.05.015
43. Wu, C. M., Chen, Y. C., and Hsieh, K. S. (1992). "Texture features for classification of ultrasonic liver images," IEEE Trans. Med. Imaging 11, 141-152. 10.1109/42.141636
44. Yurk, H., Barrett-Lennard, L., Ford, J. K. B., and Matkins, C. O. (2002). "Cultural transmission within maternal lineages: Vocal clans in resident killer whales in southern Alaska," Anim. Behav. 63, 1103-1119. 10.1006/anbe.2002.3012