Audio content analysis

Semantic Multimedia and Ontologies: Theory and Applications

Volumn , Issue , 2008, Pages 123-162

  Burred, Juan José ^a   Haller, Martin ^a   Jin, Shan ^a   Samour, Amjad ^a   Sikora, Thomas ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84892229349     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-84800-076-6_5     Document Type: Chapter

References (106)

1. Abdallah, S., Raimond, Y. and Sandler, M. (2006), An ontology-based approach to information management for music analysis systems, in 'Proceedings of the 120th Convention of the Audio Engineering Society'.
2. Adami, A. G., Kajarekar, S. S. and Hermansky, H. (2002), A new speaker change detection method for two-speaker segmentation, in 'Proceedings of the ICASSP', Vol. 4, pp. 3908-3911.
3. Arias, A., Pinquier, J. and André-Obrecht, R. (2005), Evaluation of classification techniques for audio indexing, in 'Proceedings of the EUSIPCO'.
4. Burred, J. J., Röbel, A. and Rodet, X. (2006), An accurate timbre model for musical instruments and its application to classification, in 'Proceedings of the First Workshop on Learning the Semantics of Audio Signals (LSAS)', pp. 22-32.
5. Campbell, J. P. (1997), 'Speaker recognition: A tutorial', Proc. IEEE 85(9), 1437-1462.
6. Carey, M. J., Parris, E. S. and Lloyd-Thomas, H. (1999), A comparison of features for speech, music discrimination, in 'Proceedings of the ICASSP', Vol. 1, pp. 149-152.
7. Casey, M. (2001), 'MPEG-7 sound-recognition tools', IEEE Trans. Circ. Syst. Video Tech. 11(6), 737-747.
8. Celma, O. (2006), Foafing the music: Bridging the semantic gap in music recommendation, in 'Proceedings of the 5th International Semantic Web Conference', Vol. 4273 of LNCS, pp. 927-934.
9. Celma, O., Herrera, P. and Serra, X. (2006), Bridging the music semantic gap, in 'Proceedings of the ESWC 2006 Workshop on Mastering the Gap: From Information Extraction to Semantic Representation'.
10. Chai, W. and Vercoe, B. (2003), Structural analysis of musical signals for indexing and thumbnailing, in 'Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries', pp. 27-34.
11. Chen, S. S. and Gopalakrishnan, P. S. (1998), Speaker, environment and channel change detection and clustering via the bayesian information criterion, in 'Proceedings of the DARPA Speech Recognition Workshop'.
12. Cheng, S.-s. and Wang, H.-M. (2003), A sequential metric-based audio segmentation method via the bayesian information criterion, in 'Proceedings of the EUROSPEECH', pp. 945-948.
13. Coden, A., Brown, E. W. and Srinivasan, S., eds (2001), Proceedings of the ACM SIGIR 2001 Workshop on Information Retrieval Techniques for Speech Applications, Vol. 2273 of LNCS, Springer, New York.
14. Cohen, A. and Lapidus, V. (1996), Unsupervised speaker segmentation in telephone conversations., in 'Proceedings of the Nineteenth Convention of Electrical and Electronics Engineers', pp. 102-105.
15. Cole, R. A., Mariani, J., Uszkoreit, H., Zaenen, A. and Zue, V., eds (1998), Survey of the state of the art in Human Language Technology, Cambridge University Press, Cambridge.
16. Crestani, F. (2003), 'Combination of similarity measures for effective spoken document retrieval', J. Inform. Sci. 29(2), 87-96.
17. D'Andrade, R. (1978), U-statistic hierarchical clustering, in 'Psychometrika', Vol. 43, pp. 59-68.
18. Davis, S. B. and Mermelstein, P. (1980), 'Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences', IEEE Trans. Acoust., Speech, Signal Process. 28(4), 357-366.
19. Delacourt, P. and Wellekens, C. J. (2000), 'DISTBIC: A speaker-based segmentation for audio data indexing', Speech Comm. 32(1), 111-126.
20. Downie, J. S. (2003), 'Music information retrieval', Annu. Rev. Inform. Sci. Tech. 37, 295-342.
21. Duda, R. O., Hart, P. E. and Stork, D. G. (2000), Pattern Classification, Wiley Interscience, New York.
22. Ferrieux, A. and Peillon, S. (1999), Phoneme-level indexing for fast and vocabulary-independent voice/voice retrieval, in 'Proceedings of the ESCA ITRW on Accessing Information in Spoken Audio', pp. 60-63.
23. Foote, J. (2001), The beat spectrum: A new approach to rhythm analysis, in 'Proceedings of the ICME', pp. 881-884.
24. Foote, J. T. (1997), Content-based retrieval of music and audio, in C.-C. Jay Kuo et al., ed., 'Proceedings of the Electronic Imaging', Vol. 3229, pp. 138-147.
25. Gauvain, J.-L., Lamel, L. and Adda, G. (1998), Partitioning and transcription of broadcast news data, in 'Proceedings of the ICSLP', Vol. 5, pp. 1335-1338.
26. Gish, H. and Schmidt, M. (1994), 'Text-independent speaker identification', IEEE Signal Process Mag. 11(4), 18-32.
27. Gish, H., Siu, M.-H. and Rohlicek, R. (1991), Segregation of speakers for speech recognition and speaker identification., in 'Proceedings of the ICASSP', pp. 873-876.
28. Glass, J., Chang, J. and McCandless, M. (1996), A probabilistic framework for feature-based speech recognition, in 'Proceedings of the ICSLP', Vol. 4, pp. 2277-2280.
29. Glavitsch, U. (1995), A first approach to speech retrieval, Technical Report 238, ETH Zrich, Institute of Information Systems.
30. Goldhor, R. S. (1993), Recognition of environmental sounds, in 'Proceedings of the ICASSP', Vol. 1, pp. 149-152.
31. Gómez, E. (2006), Tonal Description of Music Audio Signals, PhD thesis, Universitat Pompeu Fabra, Barcelona, Spain.
32. Guo, G., Zhang, H.-J. and Li, S. Z. (2001), Boosting for content-based audio classification and retrieval: An evaluation, in 'Proceedings of the ICME', pp. 1200-1203.
33. Gurevych, I. and Porzel, R. (2003), Using knowledge-based scores for identifying best speech recognition hypothesis, in 'Proceedings of the ISCA ITRW on Error Handling in Spoken Dialog Systems', pp. 77-81.
34. Harman, D. (2000), 'Overview of the sixth text retrieval conference (trec-6)', Inform. Process. Manag. 36(1), 3-35.
35. Hermansky, H. (1990), 'Perceptual linear predictive (PLP) analysis of speech', J. Acoust. Soc. Am. 87(4), 1738-1752.
36. Herrera, P., Peeters, G. and Dubnov, S. (2003), 'Automatic classification of musical instrument sounds', J. New. Music Res. 32(1), 3-21.
37. Hung, J.-W., Wang, H.-M. and Lee, L.-S. (2000), Automatic metric-based speech segmentation for broadcast news via principal component analysis, in 'Proceedings of the ICSLP', Vol. 4, pp. 121-124.
38. ISO/IEC (2002), '15938-4:2002 - Information technology - Multimedia content description interface - Part 4: Audio'.
39. ISO/IEC (2004), 15938-4:2002/amd 1:2004 - Information technology - Multimedia content description interface - Part 4: Audio, Amendment 1: Audio extensions'.
40. ISO/IEC (2006), '15938-4:2002/amd 2:2006 - Information technology - Multimedia content description interface - Part 4: Audio, Amendment 2: High-level descriptors'.
41. James, D. (1995), The application of classical information retrieval techniques to spoken documents, PhD thesis, University of Cambridge, UK.
42. Johnson, S. C. (1967), 'Hierarchical clustering schemes', Psychometrika 32(3), 241-254.
43. Jørgensen, K. W., Mølgaard, L. L. and Hansen, L. K. (2006), Unsupervised speaker change detection for broadcast news segmentation, in 'Proceedings of the EUSIPCO'.
44. Kartik, V., Satish, D. S. and Sekhar, C. C. (2005), Speaker change detection using support vector machines, in 'Proceedings of the ISCA ITRW on Non-linear Speech Processing', pp. 130-136.
45. Kemp, T., Schmidt, M., Westphal, M. and Waibel, A. (2000), Strategies for automatic segmentation of audio data, in 'Proceedings ICASSP', Vol. 3, pp. 1423-1426.
46. Kershaw, D., Robinson, A. and Renals, S. (1996), The 1995 abbot hybrid connectionist-hmm large-vocabulary recognition system, in 'Proceedings of the ARPA Speech Recognition Workshop', pp. 93-98.
47. Kim, H.-G., Burred, J. J. and Sikora, T. (2004), How efficient is MPEG-7 for general sound recognition?, in 'Proceedings AES 25th International Conference'.
48. Kim, H.-G., Ertelt, D. and Sikora, T. (2005), Hybrid speaker-based segmentation system using model-level clustering, in 'Proceedings of the ICASSP', Vol. 1, pp. 745-748.
49. Kim, H.-G., Moreau, N. and Sikora, T. (2005), MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval, John Wiley & Sons, New York.
50. Klapuri, A. (2004), Signal Processing Methods for the Transcription of Music, PhD thesis, Tampere University of Technology, Tampere, Finland.
51. Larson, M. and Eickeler, S. (2003), Using syllable-based indexing features and language models to improve german spoken document retrieval, in 'Proceedings of the EUROSPEECH', pp. 1217-1220.
52. Lee, K.-F. (1989), Automatic Speech Recognition, Kluwer Academic Publishers, chapter Appendix I.2, p. 147.
53. Liu, D. and Kubala, F. (1999), Fast speaker change detection for broadcast news transcription and indexing, in 'Proceedings of the EUROSPEECH', Vol. 3, pp. 1031-1034.
54. Liu, D., Lu, L. and Zhang, H.-J. (2003), Automatic mood detection from acoustic music data, in 'Proceedings of the ISMIR'.
55. Liu, Z., Wang, Y. and Chen, T. (1998), 'Audio feature extraction and analysis for scene segmentation and classification', J. VLSI Signal Process. 20(1/2), 61-79.
56. Logan, B., Prasangsit, P. and Moreno, P. (2003), Fusion of semantic and acoustic approaches for spoken document retrieval, in 'Proceedings of the ISCA Workshop on Multilingual Spoken Document Retrieval', pp. 1-6.
57. Lu, L. and Zhang, H. J. (2002a), Real-time unsupervised speaker change detection, in 'Proceedings of the ICPR', Vol. 2, pp. 358-361.
58. Lu, L. and Zhang, H. J. (2002b), Speaker change detection and tracking in real-time news broadcasting analysis., in 'Proceedings of the ACM International Conference on Multimedia', pp. 602-610.
59. Meng, A. and Shawe-Taylor, J. (2005), An investigation of feature models for music genre classification using the support vector classifier, in 'Proceedings of the ISMIR', pp. 604-609.
60. MIREX (2006), 'Music information retrieval evaluation exchange'. http://www.music-ir.org/mirex2006/ (last checked February 2007).
61. Moreau, N., Jin, S. and Sikora, T. (2005), Comparison of different phone-based spoken document retrieval methods with text and spoken queries, in 'Proceedings of the EUROSPEECH', pp. 641-644.
62. Mori, K. and Nakagawa, S. (2001), Speaker change detection and speaker clustering using VQ distortion for broadcast news speech recognition, in 'Proceedings of the ICASSP', Vol. 1, pp. 413-416.
63. Nakagawa, S. and Suzuk, H. (1993), A new speech recognition method based on VQ-distortion and HMM, in 'Proceedings of the ICASSP', Vol. 2, pp. 676-679.
64. Nakatani, T. and Okuno, H. (1998), Sound ontology for computational auditory scene analysis, in 'Proceedings of the National Conference on Artificial Intelligence (AAAI)', pp. 1004-1010.
65. Ng, K. (2000), Information fusion for spoken document retrieval, in 'Proceedings ICASSP', Vol. 6, pp. 2405-2408.
66. Ng, K. and Zue, V. W. (1998), Phonetic recognition for spoken document retrieval, in 'Proceedings ICASSP', Vol. 1, pp. 325-328.
67. O'Grady, P. D., Pearlmutter, B. A. and Rickard, S. T. (2005), 'Survey of sparse and non-sparse methods in source separation', Int. J. Imag. Syst. Tech. 15(1), 18-33.
68. Pachet, F. (2005), Musical metadata and knowledge management, in D. Schwartz, ed., 'Encyclopedia of Knowledge Management', Idea Group, pp. 672-677.
69. Pampalk, E. (2006), Computational Models of Music Similarity and their Application in Music Information Retrieval, PhD thesis, Technische Universitt Wien.
70. Pfeiffer, S., Fischer, S. and Effelsberg, W. (1996), Automatic audio content analysis, in 'Proceedings 4th ACM International Multimedia Conference', pp. 21-30.
71. Pietquin, O., Couvreur, L. and Couvreur, P. (2001), Applied clustering for automatic speaker-based segmentation of audio material, in 'JORBEL', Vol. 41, pp. 69-81.
72. Qi, W., Gu, L., Jiang, H., Chen, X. and Zhang, H. (2000), Integrating visual, audio and text analysis for news video, in 'Proceedings of the ICIP', Vol. 3, pp. 520-523.
73. Rabiner, L. and Juang, B.-H. (1993), Fundamentals of Speech Recognition, Prentice Hall.
74. Renals, S. (1999), The THISL spoken document retrieval project, in 'Proceedings IEEE International Conference on Multimedia Computing and Systems (MCS)', Vol. 2, pp. 1049-1051.
75. Rose, R. (1995), 'Keyword detection in conversational speech utterances using hidden markov model based continuous speech recognition', Comput. Speech Lang. 9(4), 309-333.
76. Samour, A., Karaman, M., Goldmann, L. and Sikora, T. (2007), Video to the rescue of audio: Shot boundary assisted speaker change detection, in 'Proceedings of the Electronic Imaging', Vol. 6506.
77. Sanderson, C. and Paliwala, K. K. (2004), 'Identity verification using speech and face information', Digit. Signal Process. 14(5), 449-480.
78. Saunders, J. (1996), Real-time discrimination of broadcast speech/music, in 'Proceedings of the ICASSP', Vol. 2, pp. 993-996.
79. Schaeuble, P. and Glavitsch, U. (1994), Assessing the retrieval effectiveness of a speech retrieval system by simulating recognition errors, in 'Proceedings Workshop on Human Language Technology', pp. 370-372.
80. Scheirer, E. and Slaney, M. (1997), Construction and evaluation of a robust multifeature speech/music discriminator, in 'Proceedings of the ICASSP', Vol. 2, pp. 1331-1334.
81. Schwarz, G. (1978), Estimation the dimension of a model, in 'Annals of Statistics', Vol. 6, pp. 461-464.
82. Serra, X. (1997), Musical sound modeling with sinusoids plus noise, in C. Roads, S. T. Pope, A. Piccialli and G. D. Poli, eds, 'Musical Signal Processing', Swets & Zeitlinger The Netherlands, pp. 91-122.
83. Siegler, M. A., Jain, U., Raj, B. and Stern, R. M. (1997), Automatic segmentation, classification and clustering of broadcast news audio, in 'Proceedings of the DARPA Speech Recognition Workshop', pp. 97-99.
84. Smaragdis, P. and Brown, J. C. (2003), Non-negative matrix factorization for polyphonic music transcription, in 'Proceedings of the WASPAA', pp. 177-180.
85. Sönmez, K., Heck, L. and Weintraub, M. (1999), Speaker tracking and detection with multiple speakers, in 'Proceedings of the EUROSPEECH', Vol. 5, pp. 2219-2222.
86. Sugiyama, M., Murakami, J. and H. Watanabe (1993), Speech segmentation and clustering based on speaker features, in 'Proceedings of the ICASSP', Vol. 2, pp. 395-398.
87. Taskiran, C., Albiol, A., Torres, L. and Delp, E. (2004), Detection of unique people in news programs using multimodal shot clustering, in 'Proceedings of the ICIP', Vol. 1, pp. 697-700.
88. Theodoridis, S. and Koutroumbas, K. (2006), Pattern Recognition, Elsevier, The Netherlands.
89. Tritschler, A. and Gopinath, R. (1999), Improved speaker segmentation and segments clustering using the bayesian information criterion., in 'Proceedings of the EUROSPEECH', pp. 679-682.
90. Tzanetakis, G. and Cook, P. (2002), 'Musical genre classification of audio signals', IEEE Trans. Speech Audio Process. 10(5), 293-302.
91. Venkatachalam, V., Cazzanti, L., Dhillon, N. and Wells, M. (2004), 'Identification of sound recordings', IEEE Signal Process. Mag. 21(2), 92-99.
92. Verma, T., Levine, S. and Meng, T. (1997), Transient modeling synthesis: A flexible analysis/synthesis tool for transient signals, in 'Proceedings of the International Computer Music Conference (ICMC)', pp. 164-167.
93. Vorhees, E. and Harman, D., eds (2001), NIST Special Publication 500-250:10th Text Retrieval Conference (TREC), chapter Common Evaluation Measures, pp. A14-A23.
94. Wang, Y., Liu, Z. and Huang, J.-C. (2000), 'Multimedia content analysis using both audio and visual clues', IEEE Signal Process. Mag. 17(6), 12-36.
95. Wilcox, L., Chen, F., Kimber, D. and Balasubramanian, V. (1994), Segmentation of speech using speaker identification, in 'Proceedings of the ICASSP', pp. 161-164.
96. Wilpon, J., Rabiner, L. and Lee, C.-H. (1990), 'Automatic recognition of keywords in unconstrained speech using hidden markov models', IEEE Trans. Acoust., Speech, Signal Process. 38, 1870-1878.
97. Wold, E., Blum, T., Keislar, D. and Wheaton, J. (1996), 'Content-based classification, search, and retrieval of audio', IEEE Multimedia 3(3), 27-36.
98. Woodland, P., Gales, M., Pye, D. and Valtchev, V. (1996), The HTK large vocabulary recognition system for the 1995 ARPA H3 task, in 'Proceedings of the ARPA Speech Recognition Workshop', pp. 99-104.
99. Wu, T., Lu, L. and Zhang, H.-J. (2003), UBM-based real-time speaker segmentation for broadcasting news, in 'Proceedings of the ICASSP', Vol. 2, pp. 193-196.
100. Xiong, Z., Radhakrishnan, R., Divakaran, A. and Huang, T. S. (2003), Comparing MFCC and MPEG-7 audio features for feature extraction, maximum likelihood HMM and entropic prior HMM for sports audio classification, in 'Proceedings of the ICASSP', Vol. 5, pp. 628-31.
101. Yu, P., Seide, F., Ma, C. and Chang, E. (2003), An improved model-based speaker segmentation system, in 'Proceedings of the EUROSPEECH', pp. 2025-2028.
102. Zhang, T. and Kuo, C.-C. (1999a), Hierarchical classification of audio data for archiving and retrieving, in 'Proceedings of the ICASSP', Vol. 6, pp. 3001-3004.
103. Zhang, T. and Kuo, C.-C. J. (1999b), Classification and retrieval of sound effects in audiovisual data management, in 'Proceedings of the Asilomar Conference on Signals, Systems, and Computers', Vol. 1, pp. 730-734.
104. Zhou, B. and Hansen, J. (2002), Speechfind: An experimental on-line spoken document retrieval system for historical audio archives, in 'Proceedings of the ICSLP', Vol. 3, pp. 1969-1972.
105. Zhou, B. and Hansen, J. H. L. (2000), Unsupervised audio stream segmentation and clustering via the bayesian information criterion, in 'Proceedings of the ICSLP', Vol. 3, pp. 714-717.
106. Zue, V., Glass, J., Goodine, D., Phillips, M. and Seneff, S. (1990), The summit speech recognition system: phonological modeling and lexical access, in 'Proceedings of the ICASSP', Vol. 1, pp. 49-52.