Smart homecare surveillance system: Behavior identification based on state-transition support vector machines and sound directivity pattern analysis

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 43, Issue 6, 2013, Pages 1279-1289

  Chen, Bo Wei ^a   Chen, Chen Yu ^b   Wang, Jhing Fa ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^b INSTITUTE FOR INFORMATION INDUSTRY   (Taiwan)

Author keywords

Behavior identification; LCS based Markov random field (MRF); Localized contour sequence (LCS); Sound directivity pattern analysis (DPA); Sound localization; Statetransition support vector machine (SVM) (STSVM)

Indexed keywords

BEHAVIORAL RESEARCH; CAMERAS; MAGNETORHEOLOGICAL FLUIDS; MARKOV PROCESSES; SECURITY SYSTEMS;

BEHAVIOR IDENTIFICATIONS; LOCALIZED CONTOUR SEQUENCE (LCS); MARKOV RANDOM FIELDS; SOUND DIRECTIVITY; SOUND LOCALIZATION; STATETRANSITION SUPPORT VECTOR MACHINE (SVM) (STSVM);

SUPPORT VECTOR MACHINES;

EID: 84898680782     PISSN: 10834427     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2013.2244211     Document Type: Article

References (54)

1. P. Remagnino and G. L. Foresti, Ambient intelligence: A new multidisciplinary paradigm IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 35, no. 1, pp. 1-6, Jan. 2005. (Pubitemid 40085381)
2. M. R. Alam, M. B. I. Reaz, and M. A. M. Ali, A review of smart homes - Past, present, future IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 42, no. 6, pp. 1190-1203, Nov. 2012.
3. C.-F. Juang and C.-M. Chang, Human body posture classification by a neural fuzzy network and home care system application IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 6, pp. 984-994, Nov. 2007. (Pubitemid 350130837)
4. C.-H. Lu, C.-L. Wu, and L.-C. Fu, A reciprocal and extensible architecture for multiple-target tracking in a smart home IEEE Trans. Syst.,Man, Cybern. C, Appl. Rev., vol. 41, no. 1, pp. 120-129, Jan. 2011.
5. F. Zhou, J. R. Jiao, S. Chen, and D. Zhang, A case-driven ambient intelligence system for elderly in-home assistance applications IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 41, no. 2, pp. 179-189, Mar. 2011.
6. T. S. Barger, D. E. Brown, and M. Alwan, Health-status monitoring through analysis of behavioral patterns IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 35, no. 1, pp. 22-27, Jan. 2005. (Pubitemid 40085383)
7. H. Qian, Y. Mao, W. Xiang, and Z. Wang, Home environment fall detection system based on a cascaded multi-SVM classifier in Proc. 10th Int. Conf. Control, Autom., Robot. Vis., Hanoi, Vietnam, Dec. 17-20, 2008, pp. 1567-1572.
8. Q. C. Nguyen, D. Shin, D. Shin, and J. Kim, Real-time human tracker based on location and motion recognition of user for smart home in Proc. 3rd Int. Conf. Multimedia Ubiquitous Eng., Qingdao, China, Jun. 4-6, 2009, pp. 243-250.
9. Y. Huang, J. Benesty, and G. W. Elko, Passive acoustic source localization for video camera steering in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Istanbul, Turkey, Jun. 5-9, 2000, pp. II909-II912.
10. T. Wu, C. Vu, Q. Cheng, and D. M. Chandler, Region-of-importance detection based on fusion of audio and video in Conf. Rec. 43rd Asilomar Conf. Signals, Syst. Comput., Pacific Grove, CA, USA, Nov. 1-4, 2009,pp. 1673-1677.
11. V. M. Trifal, A. Koene, J. Morén, and G. Cheng, Real-time acoustic source localization in noisy environments for human-robot multimodal interaction in Proc. 16th IEEE Int. Conf. Robot Human Interact. Commun., Jeju, Korea, Aug. 26-29, 2007, pp. 393-398.
12. G. Valenzise, L. Gerosa, M. Tagliasacchi, F. Antonacci, and A. Sarti, Scream and gunshot detection and localization for audio-surveillance systems in Proc. IEEE Int. Conf. Adv. Video Signal Based Surv., London, U.K., Sep. 5-7, 2007, pp. 21-26.
13. H. Zhou, M. Taj, and A. Cavallaro, Target detection and tracking with heterogeneous sensors IEEE J. Sel. Topics Signal Process., vol. 2, no. 4, pp. 503-513, Aug. 2008.
14. I. Hara, F. Asano, Y. Kawai, F. Kanehiro, and K. Yamamoto, Robust speech interface based on audio and video information fusion for humanoid HRP-2 in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Sendai, Japan, Sep. 28-Oct. 2, 2004, pp. 2404-2410. (Pubitemid 40275956)
15. M. G. Christensen, P. Vera-Candeas, S. D. Somasundaram, and A. Jakobsson, Robust subspace-based fundamental frequency estimation in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Las Vegas, NV, USA, Mar. 30-Apr. 4, 2008, pp. 101-104.
16. I. Potamitis and G. Kokkinakis, Speech separation of multiple moving speakers using multisensor multitarget techniques IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 1, pp. 72-81, Jan. 2007. (Pubitemid 46019394)
17. B. Stenger, A. Thayananthan, P. H. S. Torr, and R. Cipolla, Model-based hand tracking using a hierarchical Bayesian filter IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1372-1384, Sep. 2006. (Pubitemid 44132645)
18. C. Bregler, Learning and recognizing human dynamics in video sequences in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., San Juan, Puerto Rico, Jun. 17-19, 1997, pp. 568-574.
19. M. Brand, N. Oliver, and A. Pentland, Coupled hidden Markov models for complex action recognition in Proc. 1997 IEEE Int. Conf. Comput. Vis. Pattern Recognit., San Juan, Puerto Rico, Jun. 17-19, 1997, pp. 994-999.
20. J. Yamato, J. Ohya, and K. Ishii, Recognizing human action in timesequential images using hidden Markov model in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Champaign, IL, USA, Jun. 15-18, 1992, pp. 379-385.
21. V. Cevher, A. C. Sankaranarayanan, J. H. McClellan, and R. Chellappa, Target tracking using a joint acoustic video system IEEE Trans. Multimedia, vol. 9, no. 4, pp. 715-727, Jun. 2007.
22. J. Nayak, L. Gonzalez-Argueta, B. Song, A. Roy-Chowdhury, and E. Tuncel, Multi-target tracking through opportunistic camera control in a resource constrained multimodal sensor network in Proc. 2nd ACM/ IEEE Int. Conf. Distrib. Smart Cameras, Sep. 7-11, 2008, pp. 1-10.
23. M. J. Beal, N. Jojic, and H. Attias, A graphical model for audiovisual object tracking IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 7, pp. 828-836, Jul. 2003.
24. N. Megherbi, S. Ambellouis, O. Colôt, and F. Cabestaing, Joint audio- video people tracking using belief theory in Proc. IEEE Int. Conf. Adv. Video Signal Based Surv., Como, Italy, Sep. 15-16, 2005, pp. 135-140.
25. N. Strobel, S. Spors, and R. Rabenstein, Joint audio-video object localization and tracking IEEE Signal Process. Mag., vol. 18, no. 1, pp. 22- 31, Jan. 2001.
26. F. Talantzis, A. Pnevmatikakis, and A. G. Constantinides, Audio-visual active speaker tracking in cluttered indoors environments IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 3, pp. 799-807, Jun. 2008. (Pubitemid 351801724)
27. M. S. Brandstein and D. Ward, Microphone Arrays: Signal Processing Techniques and Applications, 1st ed. New York, NY, USA: Springer- Verlag, Jun. 2001.
28. M. Wax and T. Kailath, Optimum localization of multiple sources by passive arrays IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-31, no. 5, pp. 1210-1217, Oct. 1983.
29. J. Capon, High-resolution frequency-wavenumber spectrum analysis Proc. IEEE, vol. 57, no. 8, pp. 1408-1418, Aug. 1969.
30. R. O. Schimidt, Multiple emitter location and signal parameter estimation IEEE Trans. Antennas Propag., vol. AP-34, no. 3, pp. 276-280, Mar. 1986.
31. M. S. Brandstein and H. F. Silverman, A robust method for speech signal time-delay estimation in reverberant rooms in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Munich, German, Apr. 21-24, 1997, pp. 375-378.
32. A. Amir, J. Argillander, M. Campbell, A. Haubold, S. Ebadollahi, F. Kang, M. Naphade, A. Natsev, J. R. Smith, J. Tešíc, and T. Volkmer, IBM research TRECVID-2005 video retrieval system in Proc. NIST TRECVID Workshop, Gaithersburg, MD, USA, Nov. 14-15, 2005, pp. 1-17.
33. S. Gutta, J. R. J. Huang, P. Jonathon, and H.Wechsler, Mixture of experts for classification of gender, ethnic origin, pose of human faces IEEE Trans. Neural Netw., vol. 11, no. 4, pp. 948-960, Jul. 2000.
34. J. Chen, C. Wang, and R. Wang, Combining support vector machines with a pairwise decision tree IEEE Geosci. Remote Sens. Lett., vol. 5, no. 3, pp. 409-413, Jul. 2008.
35. S. Kurita, H. Saruwatari, S. Kajita, K. Takeda, and F. Itakura, Evaluation of blind signal separation method using directivity pattern under reverberant conditions in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Istanbul, Turkey, Jun. 05-09, 2000, pp. 3140-3143.
36. H. Sawada, R. Mukai, S. Araki, and S. Makino, A robust and precise method for solving the permutation problem of frequency-domain blind source separation IEEE Trans. Speech Audio Process., vol. 12, no. 5, pp. 530-538, Sep. 2004.
37. L. Parra and C. Spence, Convolutive blind source separation of nonstationary sources IEEE Trans. Speech Audio Process., vol. 8, no. 3, pp. 320-327, May 2000.
38. M. Z. Ikram and D. R. Morgan, Permutation inconsistency in blind speech separation: Investigation and solutions IEEE Trans. Speech Audio Process., vol. 13, no. 1, pp. 1-13, Jan. 2005. (Pubitemid 40049935)
39. S. F. Boll, Suppression of acoustic noise in speech using spectral subtraction IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979.
40. J.-C. Wang, H.-P. Lee, J.-F. Wang, and C.-B. Lin, Robust environmental sound recognition for home automation IEEE Trans. Autom. Sci. Eng., vol. 5, no. 1, pp. 25-31, Jan. 2008.
41. A. Ganapathiraju, J. E. Hamaker, and J. Picone, Applications of support vector machines to speech recognition IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2348-2355, Aug. 2004.
42. L. Gupta and S. Ma, Gesture-based interaction and communication: Automated classification of hand gesture contours IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 31, no. 1, pp. 114-120, Feb. 2001. (Pubitemid 32512477)
43. M. I. Jordan, Learning in Graphical Models (Adaptive Computation and Machine Learning). Cambridge, MA, USA: MIT Press, 1998.
44. C. M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), 2nd ed. New York, NY, USA: Springer-Verlag, Oct. 2007.
45. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm, System Development. New York, NY, USA: Prentice-Hall, 2001.
46. R. Shahriyar, E. Hoque, I. Naim, S.M. Sohan, andM. Akbar, Controlling remote system using mobile telephony in Proc. 1st Int. Conf. Mobile Wireless Middleware, Oper. Syst., Appl., Innsbruck, Austria, Feb. 13-15, 2008, pp. 1-7.
47. H.-T. Kao and J.-F. Wang, Voice-driven multimedia interactive system with ubiquitous sound recognition for digital home applications M.S. thesis, Dept. Elect. Eng., Nat. Chen Kung Univ., Tainan, Taiwan, Jul. 2008.
48. H. R. Abutalebi, H. Heli, D. Korchagin, and H. Bourlard, A BSSbased approach for localization of simultaneous speakers in reverberant conditions in Proc. 19th Eur. Signal Process. Conf., Barcelona, Spain, Aug. 29-Sep. 2, 2011, pp. 254-258.
49. C.-W. Hsu, C.-C. Chang, and C.-J. Lin, A Practical Guide to Support Vector Classification. Taipei, Taiwan: Nat. Taiwan Univ., Apr. 2010.
50. C.-C. Chang and C.-J. Lin, LIBSVM: A library for support vector machines ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:7, Apr. 2011.
51. K. Murphy, Machine Learning: A Probabilistic Perspective. Cambridge,MA, USA: MIT Press, Aug. 2012.
52. L. Dong, X. Yu, L. Li, and J. K. E. Hoe, HOG-based multi-stage object detection and pose recognition for service robot in Proc. 11th Int. Conf. Control Autom. Robot. Vis., Singapore, Dec. 7-10, 2010, pp. 2495-2500.
53. M. Elmezain, A. Al-Hamadi, J. Appenrodt, and B. Michaelis, A hidden Markov model-based continuous gesture recognition system for hand motion trajectory in Proc. 19th Int. Conf. Pattern Recogni., Tampa, FL, USA, Dec. 08-11, 2008, pp. 1-4.
54. H. Wang, D. Suter, K. Schindler, and C. Shen, Adaptive object tracking based on an effective appearance filter IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 9, pp. 1661-1667, Sep. 2007. (Pubitemid 47299920)