An interaction-embedded HMM framework for human behavior understanding: With nursing environments as examples

IEEE Transactions on Information Technology in Biomedicine

Volumn 14, Issue 5, 2010, Pages 1236-1246

  Liu, Chin De ^a   Chung, Yi Nung ^b   Chung, Pau Choo ^c  

^a INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

^b NATIONAL CHANGHUA UNIVERSITY OF EDUCATION   (Taiwan)

^c NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Behavior understanding; coupled hidden Markov mode (CHMM); duration HMM (DHMM); interaction recognition

Indexed keywords

BEHAVIOR UNDERSTANDING; DURATION HMM (DHMM); EMBEDDED HIDDEN MARKOV MODEL; GROUP INTERACTION; HIDDEN MARKOV MODE; HUMAN ACTIONS; HUMAN BEHAVIOR UNDERSTANDING; HUMAN BEHAVIORS; INDIVIDUAL BEHAVIOR; INTERACTION BEHAVIOR; INTERACTION MODES; INTERACTION RECOGNITION; NURSING HOMES; RECOGNITION PERFORMANCE; RELATIVE DISTANCES; SWITCH CONTROL;

HIDDEN MARKOV MODELS; NURSING;

BEHAVIORAL RESEARCH;

ARTICLE; AUTOMATED PATTERN RECOGNITION; BEHAVIOR; HUMAN; HUMAN ACTIVITIES; IMAGE PROCESSING; METHODOLOGY; NURSING HOME; PROBABILITY; REPRODUCIBILITY; SOCIAL BEHAVIOR; VIDEORECORDING;

HUMAN ACTIVITIES; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; NURSING HOMES; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SOCIAL BEHAVIOR; SPATIAL BEHAVIOR; VIDEO RECORDING;

EID: 77956357907     PISSN: 10897771     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITB.2010.2052061     Document Type: Article

References (28)

1. I. Haritaoglu, D. Harwood, and L. S. David, "W4: Real-time surveillance of people and their acitvities", IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 8, pp. 809-830, Aug. 2000.
2. J. Ben-Arie, Z. Wang, P. Pandit, and S. Rajaram, "Human activity recognition using multidimensional indexing", IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 8, pp. 1091-1104, Aug. 2002.
3. A. F. Bobick and J. W. Davis, "The recognition of human movement using temporal templates", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257-267, Mar. 2001.
4. X. Zhang and J. S. Mason, "Improved training using semi-hidden Markov models in speech recognition", in Proc. Int. Conf. ICASSP 1989, pp. 306-309.
5. P.-C. Chung and C.-D. Liu, "A daily behavior enabled hidden Markov model for human behavior understanding", Pattern Recog., vol. 41, pp. 1589-1597, May 2008.
6. T. V. Duong, H. H. Bui, D. Q. Phung, and S. Venkatesh, "Activity recognition and abnormality detection with the switching hidden semi-Markov model", in Proc. IEEE Comput. Soc. Conf. CVPR, 2005, pp. 838-845.
7. K. Hara, T. Omori, and R. Ueno, "Detection of unusual human behavior in intelligent house", in Proc. IEEE Workshop Neural Netw. Signal Process., 2002, pp. 697-706.
8. N. Oliver, B. Rosario, and A. Pentland, "A Bayesian computer vision system for modeling human interactions", IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
9. S. Hongeng and R. Nevatia, "Multi-agent event recognition", in Proc. IEEE Int. Conf. ICCV, 2001, pp. 84-91.
10. D. Chen, R. Malkin, and J. Yang, "Multimodal detection of human interaction events in a nursing home environment", in Proc. 6th Int. Conf. ICMI, 2004, pp. 82-89.
11. D. Chen, H. Wactlar, and J. Yang, "Towards automatic analysis of social interaction patterns in a nursing home environment from video", in Proc. 6th ACM SIGMM Int. Workshop MIR, 2004, pp. 283-290.
12. N. Johnson, A. Galata, and D. Hogg, "The acquisition and use of interaction behaviour models", in Proc. IEEE Conf. CVPR, 1998, pp. 866-871.
13. K. Sato and J. K. Aggarwal, "Tracking and recognizing two-person interactions in outdoor image sequences", in Proc. IEEE Workshop Multi Object Tracking, 2001, pp. 87-94.
14. S. Park, J. Park, and J. K. Aggarwal, "Video retrieval of human interactions using model-based motion tracking and multi-layer finite state automata", in Lecture Notes in Computer Science, 2006, vol. 4291, pp. 60-69.
15. S. Park and J. K. Aggarwal, "Recognition of human interaction using multiple features in grayscale images", in Proc. Int. Conf. PR, 2000, pp. 51-54.
16. S. Park and J. K. Aggarwal, "Recognition of two-person interactions using a hierarchical Bayesian network", in Proc. ACM SIGMM Int. Workshop Video Surveill., 2003, pp. 65-76.
17. S. Park and J. K. Aggarwal, "Event semantics in two-person interactions", in Proc. Int. Conf. PR, 2004, pp. 227-230.
18. S. Park and J. K. Aggarwal, "Semantic-level understanding of human actions and interactions using event hierarchy", in Proc. IEEE Int. Workshop CVPR, 2004, no. 12-21.
19. S. Reiter and G. Rigoll, "A neural-field-like approach formodeling human group actions in meetings", in Proc. IEEE Conf. ICME, 2005, pp. 37-40.
20. I. McCowan, D. Gatica-Perez, S. Bengio, G. Lathoud, M. Barnard, and D. Zhang, "Automatic analysis of multimodal group actions in meetings", IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 305-317, Mar. 2005.
21. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, and G. Lathoud, "Modeling individual and group actions in meetings: A two-layer HMM framework", in Proc. IEEE Conf. CVPR, 2004, pp. 117-117.
22. D. Zhang and B. Samy, "Exploring contextual information in a layered framework for group action recognition", in Proc. IEEE Conf. ICME, 2007, pp. 2022-2025.
23. D. Zhang, D. Gatica-Perez, S. Bengio, and I. McCowan, "Modeling individual and group actions in meetings with layered HMMs", IEEE Trans. Multimedia, vol. 8, no. 3, pp. 509-520, Jun. 2006.
24. O. Brdiczka, J. Maisonnasse, and P. Reignier, "Automatic detection of interaction groups", in Proc. IEEE Conf. ICMI, 2005, pp. 32-36.
25. T. Zhao and R. Nevatia, "Tracking multiple humans in complex situations", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1208-1221, Sep. 2004.
26. C.-D. Liu, P.-C. Chung, Y.-N. Chung, and M. Thonnat, "Understanding of human behaviors from videos in nursing care monitoring systems", J. High Speed Netw., vol. 16, pp. 91-103, 2007.
27. D. P. Huttenlocher, G. A. Klanderman, and W. J. Rucklidge, "Comparing images using the Hausdorff distance", IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 9, pp. 850-863, Sep. 1993.
28. G. K. Aguirre and M. D'Esposito, "Topographical disorientation: A synthesis and taxonomy", in Proc. Brain, 1999, pp. 1613-28.