Bayesian filter based behavior recognition in workflows allowing for user feedback

Computer Vision and Image Understanding

Volumn 116, Issue 3, 2012, Pages 422-434

  Kosmopoulos, Dimitrios I ^a   Doulamis, Nikolaos D ^b   Voulodimos, Athanasios S ^b  

^a University of Texas at Arlington   (United States)

^b NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

Bayesian filter; Behavior recognition; Hidden Markov models; User feedback; Workflow

Indexed keywords

BAYESIAN FILTERS; BEHAVIOR MODELING; BEHAVIOR RECOGNITION; BEHAVIOR UNDERSTANDING; CLASSIFICATION RATES; CLASSIFICATION RESULTS; LEARNING PROCESS; ON-LINE RECOGNITION; RECOGNITION RATES; TO EFFECT; USER FEEDBACK; VISUAL BEHAVIOR; WORK-FLOWS; WORKFLOW;

HIDDEN MARKOV MODELS; INDUSTRIAL PLANTS;

BEHAVIORAL RESEARCH;

EID: 84856095851     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2011.09.006     Document Type: Article

References (52)

1. D. Kosmopoulos, A. Voulodimos, T. Varvarigou, Robust human behavior modeling from multiple cameras, in: 20th 697 International Conference on Pattern Recognition (ICPR), 2010, pp. 3575-3578.
2. N. Doulamis, A. Voulodimos, D. Kosmopoulos, T. Varvarigou, Enhanced human behavior recognition using hmm and evaluative rectification, in: ACM Multimedia, ARTEMIS Workshop, 2010.
3. Y. Wang, and G. Mori Human action recognition by semilatent topic models IEEE Transactions on Pattern Analysis and Machine Intelligence 31 10 2009 1762 1774
4. Q. Hu, L. Qin, Q. Huang, S. Jiang, Q. Tian, Action recognition using spatial-temporal context, in: 20th International Conference on Pattern Recognition (ICPR), 2010, pp. 1521-1524.
5. S. Ali, and M. Shah Human action recognition in videos using kinematic features and multiple instance learning IEEE Transactions on Pattern Analysis and Machine Intelligence 32 2 2010 288 303
6. A. Yao, J. Gall, L. Van Gool, A hough transform-based voting framework for action recognition, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 2061-2068.
7. T. Wada, and T. Matsuyama Multiobject behavior recognition by event driven selective attention method IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 2000 873 887
8. D. Sadlier, and N. O'Connor Event detection in field sports video using audio-visual features and a support vector machine IEEE Transactions on Circuits and Systems for Video Technology 15 10 2005 1225 1233 (Pubitemid 41640560)
9. M.-H. Hung, and C.-H. Hsieh Event detection of broadcast baseball videos IEEE Transactions on Circuits and Systems for Video Technology 18 12 2008 1713 1726
10. I. Laptev, P. Perez, Retrieving actions in movies, in: IEEE 11th International Conference on Computer Vision, 2007 (ICCV 2007), 2007, pp. 1-8.
11. A. Bobick, and A. Wilson A state-based approach to the representation and recognition of gesture IEEE Transactions on Pattern Analysis and Machine Intelligence 19 12 1997 1325 1337 (Pubitemid 127762325)
12. M.-H. Yang, N. Ahuja, Extraction and classification of visual motion patterns for hand gesture recognition, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998, pp. 892-897.
13. R. Hamid, S. Maddi, A. Bobick, M. Essa, Structure from statistics - unsupervised activity analysis using suffix trees, in: IEEE 11th International Conference on Computer Vision, 2007 (ICCV 2007), 2007, pp. 1-8.
14. R. Poppe A survey on vision-based human action recognition Image and Vision Computing 28 6 2010 976 990
15. W. Hu, T. Tan, L. Wang, and S. Maybank A survey on visual surveillance of object motion and behaviors IEEE Transactions on Systems, Man and Cybernetics, Part C 34 3 2004 334 352
16. L.R. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition Proceedings of the IEEE 77 2 1989 257 286
17. S.P. Chatzis, D.I. Kosmopoulos, and T.A. Varvarigou Robust sequential data modeling using an outlier tolerant hidden Markov model IEEE Transactions on Pattern Analysis and Machine Intelligence 31 9 2009 1657 1669
18. Z. Zeng, J. Tu, B. Pianfetti, and T. Huang Audio-visual affective expression recognition through multistream fused HMM IEEE Transactions on Multimedia 10 4 2008 570 577 (Pubitemid 351711233)
19. D. Kosmopoulos, and S. Chatzis Robust visual behavior recognition Signal Processing Magazine, IEEE 27 5 2010 34 45
20. A. Voulodimos, H. Grabner, D.I. Kosmopoulos, L.J.V. Gool, T.A. Varvarigou, Robust workflow recognition using holistic features and outlier-tolerant fused hidden markov models, in: ICANN (1), 2010, pp. 551-560.
21. S. Eickeler, A. Kosmala, G. Rigoll, Hidden markov model based continuous online gesture recognition, in: International Conference on Pattern Recognition (ICPR), 1998, pp. 1206-1208.
22. F. Lv, R. Nevatia, Recognition and segmentation of 3-d human action using hmm and multi-class adaboost, in: ECCV06, 2006, pp. IV: 359-372. (Pubitemid 44029643)
23. S. Fine, Y. Singer, and N. Tishby The hierarchical hidden markov model: analysis and applications Machine Learning 32 1 1998 41 62
24. N. Padoy, D. Mateus, D. Weinland, M.-O. Berger, and N. Navab Workflow monitoring based on 3D motion features Workshop on Video-Oriented Object and Event Classification in Conjunction with ICCV 2009 2009 IEEE Kyoto Japan 585 592
25. N. Oliver, A. Garg, and E. Horvitz Layered representations for learning and inferring office activity from multiple sensory channels Computer Vision and Image Understanding 96 2 2004 163 180
26. T. Xiang, and S. Gong Optimising dynamic graphical models for video content analysis Computer Vision and Image Understanding 112 2008 310 323
27. H. Jaeger, W. Maass, and J. Principe Special issue on echo state networks and liquid state machines Neural Networks 20 3 2007 287 289 (Pubitemid 46860333)
28. C. Gallicchio, and A. Micheli Architectural and markovian factors of echo state networks Neural Networks 24 5 2011 440 456
29. G.V. Veres, H. Grabner, L. Middleton, L.J.V. Gool, Automatic workflow monitoring in industrial environments, in: ACCV (1), 2010, pp. 200-213.
30. X. Zhang, G.-Y. Xu, X.-L. Xiao, L.-M. Tao, Online analysis of hierarchical events in meetings, in: Usability and Internationalization, HCI and Culture, vol. 2, 2007, pp. 472-479.
31. X. Xiaoling, L. Layuan, Real time analysis of situation events for intelligent surveillance, in: International Symposium on Computational Intelligence and Design, 2008 (ISCID '08), vol. 2, 2008, pp. 122-125.
32. D. Zhang, X. Ning, and X. Liu Smc method for online prediction in hidden markov models Kybernetes 38 10 2009 1819 1827
33. P. Fearnhead, and P. Clifford On-line inference for hidden markov models via particle filters Journal of the Royal Statistical Society Series, B 65 4 2003 887 899 (Pubitemid 37434236)
34. N. Doulamis, and A. Doulamis Evaluation of relevance feedback schemes in content-based retrieval systems Signal Processing: Image Communication 21 4 2006 334 357 (Pubitemid 44316584)
35. J.J. Rocchio Relevance feedback in information retrieval G. Salton, The Smart Retrieval System - Experiments in Automatic Document Processing 1971 Prentice-Hall Englewood Cliffs, NJ 313 323
36. N.D. Doulamis, and A.D. Doulamis Evaluation of relevance feedback schemes in content-based in retrieval systems Signal Processing: Image Communication vol. 21 2006 Elsevier 334 357
37. A. Oerlemans, J.T. Rijsdam, and M.S. Lew Real-time object tracking with relevance feedback Proceedings of the 6th ACM International Conference on Image and Video Retrieval, CIVR '07 2007 ACM New York, NY, USA 101 104 (Pubitemid 350229610)
38. Z. Chengcui, C. Wei-Bang, C. Xin, Y. Lin, and J. John A multiple instance learning and relevance feedback framework for retrieving abnormal incidents in surveillance videos Journal of Multimedia 5 2010 310 321
39. A. Doulamis, and N. Doulamis Generalized nonlinear relevance feedback for interactive content-based retrieval and organization IEEE Transactions on Circuits and Systems for Video Technology 14 5 2004 656 671
40. X.S. Zhou, and T.S. Huang Relevance feedback in image retrieval: a comprehensive review Multimedia Systems 8 6 2003 536 544
41. A. Lam, A.K. Roy-Chowdhury, C.R. Shelton, Interactive event search through transfer learning, 2011, pp. 157-170.
42. X. Sun, M. Chen, A. Hauptmann, Action recognition via local descriptors and holistic features, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 58-65.
43. T. Xiang, and S. Gong Beyond tracking: modelling activity and understanding behaviour International Journal of Computer Vision 67 2006 21 51
44. M.S. Arulampalam, S. Maskell, and N. Gordon A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking IEEE Transactions on Signal Processing 50 2 2002 174 188 (Pubitemid 34291500)
45. D. Arnaud, G. Simon, and A. Christophe On sequential monte carlo sampling methods for bayesian filtering Statistics and Computing 10 3 2000 197 208
46. G. Seber, and C. Wild Nonlinear Regression 2003 Wiley Hoboken, New Jersey
47. L. Breiman Random forests Machine Learning 45 2001 5 32 (Pubitemid 32933532)
48. D.E. Rumelhart, G.E. Hinton, and R.J. Williams Learning representations by back-propagating errors 1988 MIT Press Cambridge, MA, USA pp. 696-699
49. A. Doulamis, Adaptable neural networks for objects' tracking re-initialization, LNCS of Lecture Notes in Computer Science, vol. 5769, 2009, pp. 715-724.
50. A. Doulamis Knowledge Extraction in Stereo Video Sequences Using Adaptive Neural Networks Intelligent Multimedia Processing with Soft Computing 2005 Springer-Verlag Berlin, Heidelberg pp. 235-252
51. D.G. Luenberger Linear and nonlinear programming 1984 Addison-Wesley
52. A. Voulodimos, D. Kosmopoulos, G. Vasileiou, E. Sardis, A. Doulamis, V. Anagnostopoulos, C. Lalos, T. Varvarigou, A dataset for workflow recognition in industrial scenes, in: 18th IEEE International Conference on Image Processing, 2011, pp. 3310-3313.