Acoustic and visual signal based context awareness system for mobile application

IEEE Transactions on Consumer Electronics

Volumn 57, Issue 2, 2011, Pages 738-746

  Choi, Woo Hyun ^a   Kim, Seung Il ^a   Keum, Min Seok ^a   Han, David K ^b   Ko, Hanseok ^a  

^a Korea University   (South Korea)

^b OFFICE OF NAVAL RESEARCH   (United States)

Author keywords

audio and visual classification; Context awareness; environmental sound classification; mobile device

Indexed keywords

CONTEXT- AWARENESS; CONTEXTUAL INFORMATION; ENVIRONMENTAL SOUND CLASSIFICATION; MOBILE APPLICATIONS; MULTIMODAL SYSTEM; VISUAL CLASSIFICATION; VISUAL FEATURE EXTRACTION; VISUAL SIGNALS;

AUDIO ACOUSTICS; BIOINFORMATICS; FEATURE EXTRACTION; MOBILE DEVICES; PORTABLE EQUIPMENT;

CELLULAR TELEPHONE SYSTEMS;

EID: 79960920749     PISSN: 00983063     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCE.2011.5955216     Document Type: Article

References (18)

1. B. Clarkson, N. Sawhney, and A. Pentland, "Auditory context awareness via wearable computing", Proc. Workshop on Perceptual User Interface(PUT'98), San Francisco, CA, Nov 4-6, pp. 37-42, 1998.
2. L. Ma, B. Milner, and D. Smith, "Environmental noise classification for context-aware application", International Conference and Worrkshop on Database and Expert Systems Applications(DEXA), LNCS 2736, pp.360-370, 2003.
3. L. Ma, B. Milner, and D. Smith, "Acoustic environment classification", ACM Transaction on Speech and Language Process, vol. 3, No. 2, pp. 1-22, July 2006. (Pubitemid 44188497)
4. A. J. Eronenm, V. T. Peltonen, J. T. Tuomi, A. P. Klapuri, S. Fagerlund, T. Sorsa, G. Lorho, and J. Huopaniemi, "Audio-based context recognition", IEEE Transaction on Audio, Speech, and Language Processing, Vol. 14, No. 1, Jan 2006.
5. T. Nishiura, S. Nakamura, K. Miki, K. Shikano, "Environmental sound source identification based on hidden markov model for robust speech recognition", EUROSPEECH 2003 - INTERSPEECH 2003, pp. 2157-2160, 2003.
6. P. Gaunard, C.G. Mubikangiey, C. Couvneur, V. Fontaine, "Automatic classification of environmental noise events by hidden markov model", Acoustics, Speech, and Signal Processing, Proceedings of the 1998 IEEE International Conference on, pp.3609-3612, vol. 6, 1998.
7. G. Guo, S.Z. Li, "Content-based audio classification and retrieval by support vector machines", IEEE Transaction on Neural Networks, Vol. 14, No.1, January 2003.
8. A. Temko, E. Monte, C. Nadeu, "Comparison of sequence discriminant support vector machines for acoustic event classification", Acoustics, Speech and Signal Processing, 2006, ICASSP 2006 Proceedings. 2006 IEEE International Conference on., 2006.
9. N. Sawhney, "Situational awareness from environmental sounds", Technical Report for Modeling Adaptive Behavior(MAS738), Speech Interface Group, MIT Media Lab, Jun 13, 1997.
10. S. B. Davis, P. Mermelstein, "Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Sentences", IEEE Transaction on Acoustic, Speech, and Signal Processing, vol. 28, no. 5, pp. 357-366, 1980. (Pubitemid 11464930)
11. The HTK book Version 3.4, Cambridge University Engineering Department, March, 2009.
12. P. Peer, J. Kovac, F. Solina, "Human skin colour clustering for face detection", The IEEE Region 8 Computer as a tool EUROCON 2003, vol. 2, pp. 144-148, Sep. 22-24, 2003.
13. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "Hight accuracy optical flow estimation based on a theory for warping", European Conference on Computer Vision (ECCV) Prague, Czech Republic, Springer, LNCS, Vol. 3024, pp. 25-36, May. 2004.
14. J. Y. Bouguet, "Pyramidal implementation of the Lucas-Kanade feature tracker description of the algorithm", intel Corporation, Microprocessor Research Labs, OpenCV Documents, 1999.
15. T. Gautama, V. Hulle, "A phase-based approach to the estimation of the optical flow field using spatial filtering", IEEE Transaction on Neural Network, vol. 13, no. 5, pp. 1127-1136, Sep. 2002.
16. th International Joint Conference on Artificial Intelligence(IJCAI), Vancouver, British Columbia, pp. 674-679, Aug. 1981. (Pubitemid 14478744)
17. M. Szummer and R.W. Picard, "Indoor-outdoor image classification", IEEE International Workshop on Content-based Access of Image and Video Database, Bombay, India, Jan. 1998.
18. S. Liao, X. Zhu, Z. Lei, L.Zhang, S. Li, "Learning multi-scale block local binary pattern for face recognition", in Advances in Biometrics, pp. 828-837, 2007.