Online classification of visual tasks for industrial workflow monitoring

Neural Networks

Volumn 24, Issue 8, 2011, Pages 852-860

  Voulodimos, Athanasios ^a   Kosmopoulos, Dimitrios ^b   Veres, Galina ^c   Grabner, Helmut ^d   Van Gool, Luc ^d,e   Varvarigou, Theodora ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

^b University of Texas at Arlington   (United States)

^c UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^d ETH ZURICH   (Switzerland)

^e UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Activity recognition; ESN; Fusion; Genetic algorithm; HMM; Workflow

Indexed keywords

ACTIVITY PATTERNS; ACTIVITY RECOGNITION; ECHO STATE NETWORKS; ESN; HMM; INDUSTRIAL ENVIRONMENTS; INHERENT COMPLEXITY; INPUT STREAMS; LIMITED VISIBILITY; MULTI-CAMERAS; NOVEL METHODS; ON-LINE CLASSIFICATION; PRIOR KNOWLEDGE; TIME SERIES CLASSIFICATIONS; TRACKING MOVING TARGETS; VISUAL TASKS; WORK-FLOWS; WORKFLOW; WORKFLOW MONITORING;

GENETIC ALGORITHMS; HIDDEN MARKOV MODELS; TIME SERIES;

VISION;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATION; CAMERA; CLASSIFICATION; ECHO STATE NETWORK; GENETIC ALGORITHM; HIDDEN MARKOV MODEL; INDUSTRIAL AREA; INTERMETHOD COMPARISON; ONLINE MONITORING; PRIORITY JOURNAL; TIME SERIES ANALYSIS; VISIBILITY; WORKFLOW;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CALIBRATION; COMPUTER SIMULATION; DATABASES, FACTUAL; IMAGE PROCESSING, COMPUTER-ASSISTED; INDUSTRY; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING; VISION, OCULAR; WORKFLOW;

EID: 80051787343     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.06.001     Document Type: Article

References (36)

1. Adam A., Rivlin E., Shimshoni I., Reinitz D. Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Transactions on Pattern Analysis and Machine Intelligence 2008, 30(3):555-560.
2. Antonakaki P., Kosmopoulos D., Perantonis S. Detecting abnormal human behaviour using multiple cameras. Signal Processing 2009, 89(9):1723-1738.
3. Boiman, O., & Irani, M. (2005). Detecting irregularities in images and in video. In Proceedings of the IEEE international conference on computer vision. ICCV 2005. Vol. 1 (pp. 462-469).
4. Breitenstein, M., Grabner, H., & Gool, L. V. (2009). Hunting nessie: real time abnormality detection from webcams. In Proceedings of the IEEE international conference on computer vision workshops. ICCV workshops 2009 (pp. 1243-1250).
5. Chatzis S.P., Kosmopoulos D.I., Varvarigou T.A. Robust sequential data modeling using an outlier tolerant hidden Markov model. IEEE Transactions on Pattern Analysis and Machine Intelligence 2009, 31(9):1657-1669.
6. Dupont S., Luettin J. Audio-visual speech modeling for continuous speech recognition. IEEE Transactions on Multimedia 2000, 2(3):141-151.
7. Efros, A. A., Berg, A. C., Mori, G., & Malik, J. (2003). Recognizing action at a distance. In Proceedings of the IEEE international conference on computer vision. ICCV 2003 (pp. 726-733).
8. Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008). A discriminatively trained, multiscale, deformable part model. In Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR 2008 (pp. 1-8).
9. Fine S., Singer Y., Tishby N. The hierarchical hidden Markov model: analysis and applications. Machine Learning 1998, 32(1):41-62.
10. Gallicchio C., Micheli A. Architectural and Markovian factors of echo state networks. Neural Networks 2011, 24(5):440-456.
11. Grabner, H., & Bischof, H. (2006). On-line boosting and vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR 2006. Vol. 1 (pp. 260-267).
12. Hellbach, S., Strauss, S., Eggert, J., Komer, E., & Gross, H. -M. (2008). Echo state networks for online prediction of movement data-comparing investigations. In Proceedings of the international conference on artificial neural networks. ICANN 2008. Vol. 5163 (pp. 710-719).
13. Huang, C., Wu, B., & Nevatia, R. (2008). Robust object tracking by hierarchical association of detection responses. In Proceedings of the European conference on computer vision. ECCV 2008 (pp. 788-801).
14. Ivanov Y.A., Bobick A.F. Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000, 22(8):852-872.
15. Jaeger, H. (2001). The echo state approach to analysing and training recurrent neural networks. Technical Report GMD Report 148. German National Research Institute for Computer Science.
16. Johnson N., Hogg D. Learning the distribution of object trajectories for event recognition. Image and Vision Computing 1996, 14(8):609-615.
17. Kosmopoulos D., Chatzis S. Robust visual behavior recognition. IEEE Signal Processing Magazine 2010, 27(5):34-45.
18. Laptev, I., & Perez, P. (2007). Retrieving actions in movies. In Proceedings of the IEEE international conference on computer vision. ICCV 2007.
19. Lv, F., & Nevatia, R. (2006). Recognition and segmentation of 3-d human action using HMM and multi-class adaboost. In Proceedings of the European conference on computer vision. ECCV 2006. Vol. IV (pp. 359-372).
20. Nguyen, N., Phung, D., Venkatesh, S., & Bui, H. (2005). Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model. In Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR 2005. Vol. 2 (pp. 955-960).
21. Oliver N., Garg A., Horvitz E. Layered representations for learning and inferring office activity from multiple sensory channels. Computer Vision and Image Understanding 2004, 96(2):163-180.
22. Padoy, N., Mateus, D., Weinland, D., Berger, M., & Navab, N. (2009). Workflow monitoring based on 3d motion features. In Proceedings of the IEEE international conference on computer vision workshops. ICCV workshops 2009 (pp. 585-592).
23. Poppe R. A survey on vision-based human action recognition. Image and Vision Computing 2010, 28(6):976-990.
24. Rabiner L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 1989, 77(2):257-286.
25. Scherer, S., Oubbati, M., Schwenker, F., & Palm, G. (2008). Real-time emotion recognition from speech using echo state networks. In Artificial neural networks in pattern recognition. Vol. 5064 (pp. 205-216).
26. Shi, Y., Huang, Y., Minnen, D., Bobick, A., & Essa, I. (2004). Propagation networks for recognition of partially ordered sequential action. In Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR 2004. Vol. 2 (pp. 862-869).
27. Skowronski M., Harris J. Automatic speech recognition using a predictive echo state network classifier. Neural Networks 2007, 20:414-423.
28. Turaga P., Chellappa R., Subrahmanian V., Udrea O. Machine recognition of human activities: a survey. IEEE Transactions on Circuits and Systems for Video Technology 2008, 18(11):1473-1488.
29. Veres, G., Grabner, H., Middleton, L., & Gool, L. V. (2010). Automatic workflow monitoring in industrial environments. In Proceedings of the Asian conference on computer vision. ACCV 2010 (pp. 200-213).
30. Verplancke T., Looy S.V., Steurbaut K., Benoit D., Turck F.D., Moor G.D., et al. A novel time series analysis approach for prediction of dialysis in critically ill patients using echo-state networks. BMC Medical Informatics and Decision Making 2010, 10(1):414-423.
31. Vogler, C., & Metaxas, D. (1999). Parallel hidden Markov models for American sign language recognition. In Proceedings of the IEEE international conference on computer vision. ICCV 1999 (pp. 116-122).
32. Voulodimos, A., Grabner, H., Kosmopoulos, D., Van Gool, L., & Varvarigou, T. (2010). Robust workflow recognition using holistic features and outlier-tolerant fused hidden Markov models. In Proceedings of the international conference on artificial neural networks. ICANN 2010. Vol. 6352 (pp. 551-560).
33. Wang, X., Ma, K., Ng, G., & Grimson, W. (2008). Trajectory analysis and semantic region modeling using a nonparametric Bayesian model. In Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR 2008 (pp. 1-8).
34. Xiang T., Gong S. Beyond tracking: modelling activity and understanding behaviour. International Journal of Computer Vision 2006, 67:21-51.
35. Zelnik-Manor L., Irani M. Statistical analysis of dynamic actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006, 28(9):1530-1535.
36. Zeng Z., Tu J., Pianfetti B., Huang T. Audiovisual affective expression recognition through multistream fused HMM. IEEE Transactions on Multimedia 2008, 10(4):570-577.