A generic audio classification and segmentation approach for multimedia indexing and retrieval

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 3, 2006, Pages 1062-1081

  Kiranyaz, Serkan ^b   Qureshi, Ahmad Farooq ^b   Gabbouj, Moncef ^a,b  

^a IEEE

^b TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Automatic audio classification and segmentation; Fuzzy modeling; Multimedia indexing and retrieval; Perceptual rule based approach

Indexed keywords

AUDIO ACOUSTICS; CLASSIFICATION (OF INFORMATION); FUZZY SETS; INDEXING (OF INFORMATION); INFORMATION RETRIEVAL SYSTEMS; MULTIMEDIA SYSTEMS;

AUTOMATIC AUDIO CLASSIFICATION; FUZZY MODELING; MULTIMEDIA INDEXING; PERCEPTUAL RULE-BASED APPROACH;

SPEECH SYNTHESIS;

EID: 34147125435     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.857573     Document Type: Article

References (28)

1. R. M. Aarts and R. T. Dekkers, "A real-time speech-music dicriminator," J. Audio Eng. Soc., vol. 47, no. 9, pp. 720-725, Sep. 1999.
2. K.-H. Brandenburg, "MP3 and AAC explained," in Proc. AES 17th Int. Conf., Florence, Italy, Sep. 1999.
3. A. Bugatti, A. Flammini, and P. Migliorati, "Audio classification in speech and music: A comparison between a statistical and a neural approach," Eurasip J. Appl. Signal Process., pt. 1, vol. 2002, no. 4, pp. 372-378, Apr. 2002.
4. Coding of Moving Pictures and Associated Audio for Digital Storage Media up to About 1.5 Mbit/s, Pan 3: Audio, 1992. ISO/IEC 11172-3.
5. Coding of Audiovisual Object Part 3: Audio, 1998. ISO/IEC CD 14496-3 Subpart4: 1998.
6. Information Technology-Generic Coding of Moving Pictures and Associated Audio Information-Part 3: Audio, 1997. ISO/IEC 13818-3:1997.
7. K. El-Maleh, M. Klein, G. Petrucci, and P. Kabal, "Speech/music discrimination for multimedia applications," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, Istanbul, Turkey, 2000, pp. 2445-2448.
8. M. Gabbouj, S. Kiranyaz, K. Caglar, E. Guldogan, O. Guldogan, and F. A. Qureshi, "Audio-based multimedia indexing and retrieval scheme in MUVIS framework," in Proc. Int. Symp. Intelligent Signal Processing and Communication Systems (ISPACS), Awaji Island, Japan, 2003.
9. R. Jarina, N. Murphy, N. O'Connor, and S. Marlow, "Speech-music discrimination from MPEG-I bitstream," in Advances in Signal Processing, Robotics, and Communications, V. V. Kluev and N. E. Maslorakis, Eds. New York: WSES, 2001, pp. 174-178.
10. S. Kiranyaz, M. Aubazac, and M. Gabbouj, Unsupervised Segmentation and Classification Over MP3 and AAC Audio Bit-Streams. London, U.K., 2003, pp. 338-345.
11. S. Kiranyaz, K. Caglar, O. Guldogan, and E. Karaoglu, "MUVIS: A multimedia browsing, indexing and retrieval framework," in Proc. 3rd Int. Workshop on Content Based Multimedia Indexing, CBMI 2003, Rennes, France, Sep., 22-24 2003.
12. S. Kiranyaz, K. Caglar, E. Guldogan, O. Guldogan, and M. Gabbouj, "MUVIS: A content-based multimedia indexing and retrieval framework," in Proc. 7th Int. Symp. Signal Processing and Its Applications, 1SSPA 2003, Paris, France, Jul. 1-1, 2003, pp. 1-8.
13. S. Kiranyaz and M. Gabbouj, "A novel multimedia retrieval technique: Progressive query (why wait?)," in Proc. 5th Int. Workshop on Image Analysis for Multimedia Interactive Services Lisboa, Portugal, Apr., 21-23 2004. WIAMIS 2004.
14. L. Lu, H. Jiang, and H. J. Zhang, "A robust audio classification and segmentation method," in Proc. ACM 2001, Ottawa, ON, Canada, 2001, pp. 203-211.
15. MUVIS [Online]. Available: http://muvis.cs.tut.fi/
16. Y. Nakayima, Y. Lu, M. Sugano, A. Yoneyama, H. Yanagihara, and A. Kurematsu, "A fast audio classification from MPEG coded data," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 6, Phoenix, AZ, Mar. 1999, pp. 3005-3008.
17. M. Noll, "Pitch determination of human speech by the harmonic product spectrum, the harmonic sum spectrum, and a maximum likelihood estimate," in Proc. Symp. Computer Processing Communications, Brooklyn, NY, 1969, pp. 770-797. Polytechnic Inst. Of Brooklyn.
18. D. Pan, "A tutorial on MPEG/audio compression," IEEE Multimedia, pp. 60-74, 1995.
19. S. Pfeiffer, J. Robert-Ribes, and D. Kim, "Audio content extraction from MPEG encoded sequences," in Proc. 5th Joint Conf. Information Sciences, vol. II, 1999, pp. 513-516.
20. S. Pfeiffer, S. Fischer, and W. Effelsberg, "Automatic audio content analysis," in Proc. ACM Int. Conf. Multimedia, 1996, pp. 21-30.
21. J. Saunders, "Real time discrimination of broadcast speech/music," in Proc. ICASSP96, vol. II, Atlanta, GA, May 1996, pp. 993-996.
22. E. Scheirer and M. Slaney, "Construction and evaluation of a robust multifeature, speech/music discriminator," in Proc. IEEE Int. Conf. on Acoustics, Speech, Signal Proc., Munich, Germany, Apr. 1997, pp. 1331-1334.
23. S. Srinivasan, D. Petkovic, and D. Ponceleon, "Toward robust featuresfor classifying audio in the cuevideo system," in Proc. 7th ACM Int. Conf. Multimedia, Ottawa, ON, Canada, 1999, pp. 393-400.
24. G. Tzanetakis and P. Cook, "Sound analysis using MPEG compressed audio," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, ICASSP 2000, vol. II, Istanbul, Turkey, 2000, pp. 761-764.
25. E. Terhardt, "Pitch shifts of harmonics, an explanation of the octave enlargement phenomenon," in Proc. 7th Int. Congr. Acoustics, Budapest, Hungary, 1971, pp. 621-624.
26. The Open Video Project [Online]. Available: http://www.open-video.org/
27. T. Zhang and J. Kuo, "Video content parsing based on combined audio and visual information," Proc. SPIE, vol. IV, pp. 78-89, 1999.
28. T. Zhang and C.-C. J. Kuo, "Herarchical classification of audio data for archiving and retrieving," in Proc. IEEE Int. Conf. on Acoustics, Speech, Signal Proc., Phoenix, AZ, Mar. 1999, pp. 3001-3004.