Real-time human action classification using a dynamic neural model

Neural Networks

Volumn 69, Issue , 2015, Pages 29-43

  Yu, Zhibin ^a   Lee, Minho ^a  

^a Kyungpook National University   (South Korea)

Author keywords

Classification; Continuous timescale recurrent neuron network; Human action; Supervised MTRNN

Indexed keywords

CLASSIFICATION (OF INFORMATION); RECURRENT NEURAL NETWORKS;

ACTION CLASSIFICATIONS; ACTION SEQUENCES; HUMAN ACTION CLASSIFICATIONS; HUMAN ACTIONS; MULTIPLE TIMESCALE RECURRENT NEURAL NETWORKS; NEURAL MODELING; NEURON NETWORKS; SUPERVISED MTRNN;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; INFORMATION PROCESSING; MOTION; MOTOR ACTIVITY; MOTOR PERFORMANCE; MULTIPLE TIMESCALE RECURRENT NEURAL NETWORK; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SIGNAL PROCESSING; TASK PERFORMANCE; VISUAL INFORMATION; BEHAVIOR; COMPUTER SYSTEM; HUMAN; MOVEMENT (PHYSIOLOGY);

COMPUTER SYSTEMS; HUMANS; INTENTION; MOVEMENT; NEURAL NETWORKS (COMPUTER);

EID: 84930670819     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2015.04.013     Document Type: Article

References (27)

1. Altman N.S. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician 1992, 46(3):175-185.
2. Arie H., Arakaki T., Sugano S., Tani J. Imitating others by composition of primitive actions: A neuro-dynamic model. Robotics and Autonomous Systems 2012, 60(5):729-774.
3. Arie H., Endo T., Arakaki T., Sugano S., Tani J. Creating novel goal-directed actions at criticality: a neuro-robotic experiment. New Mathematics and Natural Computation 2009.
4. Avilés-Arriaga H.H., Sucar-Succar L.E., Mendoza-Durán C.E., Pineda-Cortés L.A. A comparison of dynamic Naive Bayesian classifiers and hidden Markov models for gesture recognition. Journal of Applied Research and Technology 2011, 9(01). 1665-6423.
5. Cruz, L., Djalma, L., & Luiz, V. (2012). Kinect and RGBD images: Challenges and applications graphics. In 2012 25th SIBGRAPI conference on patterns and images tutorials.
6. Doya K., Yoshizawa S. Adaptive neural oscillator using continuous-time back-propagation learning. Neural Networks 1989, 2:375-386.
7. Goldman A. Imitation, mind reading, and simulation. Perspectives on imitation II 2005, 80-81. MIT Press, Cambridge, MA. S. Hurley, N. Chater (Eds.).
8. Fogassi L., Ferrari P., Gesierich B., Rozzi S., Chersi F., Rizzolatt G. Parietal lobe: From action organization to intention understanding. Science 2005.
9. Funahashi K., Nakamura Y. Approximation of dynamical systems by continuous time recurrent neural networks. Neural Networks 1993, 6(6):801-806.
10. Gazzola V., Keysers C. The observation and execution of actions share motor and somatosensory voxels in all tested subjects: single-subject analyses of unsmoothed fMRI data. Cerebral Cortex 2009, 19(6). PMID 19020203.
11. Hinoshita W., Arie H., Tani J., Okuno H.G., Ogata T. Emergence of hierarchical structure mirroring linguistic composition in a recurrent neural network. Neural Networks 2011, 24(4):311-320.
12. Husken M., Stagge P. Recurrent neural networks for time series classification. Neurocomputing 2003, 50(C):223-235.
13. Jeong S., Arie H., Lee M., Tani J. Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors. Cognitive Neurodynamics 2011, 6:43-59.
14. Joslin, C., El-Sawah, A., Chen, Q., & Georganas, N. (2005). Dynamic gesture recognition. In IMTC 2005-Instrumentation and measurement technology conference.
15. Leslie A.M. Pretense and representation: the origins of theory of mind. Psychological Review 1987, 94:412-426.
16. OpenNI. (Last Updated: May 2012). https://github.com/OpenNI/OpenNI.
17. Oztop E., Wolpert D., Kawato M. Mental state inference using visual control parameters. Cognitive Brain Research 2005, 22:129-151.
18. Poppe R. A survey on vision-based human action recognition. Image and Vision Computing 2010, 28(6):976-990.
19. Rizzolatti G., Fadiga L., Galless V., Fogassi L. Premotor cortex and the recognition of motor actions. Cognitive Brain Research 1996, 3:131-141.
20. Tani J., Ito M., Sugita Y. Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB. Neural Networks 2004, 17:1273-1289.
21. Tani J., Nishimoto R., Paine R. Achieving organic compositionality through self-organization: reviews on brain-inspired robotics experiments. Neural Networks 2008, 21:584-603.
22. Thomas, K., Andre, B., Michalis, F., & Kc, C. (2009). HMM-based human motion recognition with optical flow data. In 9th IEEE-RAS international conference on humanoid robots.
23. Thoroughman K.A., Shadmehr R. Learning of action through adaptive combination of motor primitives. Science 2000, 407:742-747.
24. Yamashita Y., Tani J. Emergence of functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment. PLoS Computational Biology 2008, 4(11).
25. Yu Z., Mallipeddi R., Lee M. Supervised multiple timescale recurrent neuron network model for human action classification. Lecture notes in computer science 2013, Vol. 8227:196-203.
26. Zhang Y., Ogata T., Nishide S., Takahashi T., Okuno G.H. Classification of known and unknown environmental sounds based on self-organized space using a recurrent neural network. Advanced Robotics 2011, 25(17):2127-2141.
27. Zhang, Y., Ogata, T., Takahashi, T., & Okuno, H.G. (2010). Dynamic recognition of environmental sounds with recurrent neural network. In The 28th annual conference of the robotics society of Japan.