Self-organization of spatio-temporal hierarchy via learning of dynamic visual image patterns on action sequences

PLoS ONE

Volumn 10, Issue 7, 2015, Pages

  Jung, Minju ^a   Hwang, Jungsik ^a   Tani, Jun ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BIOLOGICAL MODEL; DATA BASE; DYNAMICS; LEARNING; MENTAL TASK; MENTAL TEST; MOTOR PERFORMANCE; MULTIPLE SPATIO TEMPORAL SCALES NEURAL NETWORK; NERVE CELL NETWORK; NERVE CONDUCTION; PATTERN RECOGNITION; RETINA IMAGE; SPATIAL LEARNING; VISUAL MEMORY; VISUOMOTOR COORDINATION; HUMAN; PHYSIOLOGY; VISUAL CORTEX;

HUMANS; LEARNING; VISUAL CORTEX;

EID: 84940399368     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0131214     Document Type: Article

References (33)

1. Kruger N, Janssen P, Kalkan S, Lappe M, Leonardis A, Piater J, et al. Deep hierarchies in the primate visual cortex: what can we learn for computer vision? IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013; 35(8):1847-1871. doi:10.1109/TPAMI.2012.272 PMID: 23787340.
2. Felleman DJ, Van-Essen DC. Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex. 1991 Jan; 1(1):1-47. doi:10.1093/cercor/1.1.1 PMID: 1822724.
3. Mishkin M, Ungerleider LG. Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys. Behavioural Brain Research. 1982 Sep; 6(1):57-77. PubMed PMID: 7126325. doi:10.1016/0166-4328(82)90081-XPMID: 7126325.
4. Goodale MA, Milner AD. Separate visual pathways for perception and action. Trends in Neurosciences. 1992 Jan; 15(1):20-25. PubMed PMID: 1374953. doi:10.1016/0166-2236(92)90344-8 PMID: 1374953.
5. Giese MA, Poggio T. Neural mechanisms for the recognition of biological movements. Nature Reviews Neuroscience. 2003 Mar; 4(3):179-192. PubMed PMID: 12612631. doi:10.1038/nrn1057 PMID: 12612631.
6. LeCun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE. 1998; 86(11):2278-2324. doi:10.1109/5.726791.
7. Hinton GE, Osindero S, Teh Y. A Fast learning algorithm for deep belief nets. Neural Computation. 2006; 18(7):1527-1554. doi:10.1162/neco.2006.18.7.1527 PMID: 16764513.
8. Hinton GE, Salakhutdinov RR. Reducing the Dimensionality of Data with Neural Networks. Science. 2006 Jul; 313(5786):504-507. doi:10.1126/science.1127647PMID: 16873662.
9. Lee H, Grosse R, Ranganath R, Ng AY. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. Proceedings of the 26th Annual International Conference on Machine Learning; 2009; Montreal, Quebec, Canada: 2009. p. 609-616.
10. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems; 2012: 1097-1105.
11. Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Li F-F. Large-Scale Video Classification with Convolutional Neural Networks. IEEE Conference on Computer Vision and Pattern Recognition; 2014 23-28 June; Columbus, OH: 2014. p. 1725-1732.
12. Simonyan K, Zisserman A. Two-stream convolutional networks for action recognition in videos. Advances in Neural Information Processing Systems; 2014:568-576.
13. Ji S, Xu W, Yang M, Yu K. 3D convolutional neural networks for human action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013; 35(1):221-231. doi:10.1109/TPAMI.2012.59PMID: 22392705.
14. Baccouche M, Mamalet F, Wolf C, Garcia C, Baskurt A. Sequential deep learning for human action recognition. In: Salah AA, Lepri B. Human Behavior Understanding. Lecture Notes in Computer Science. 7065: Springer Berlin Heidelberg; 2011. p. 29-39.
15. Gers FA, Schraudolph NN, Schmidhuber J. Learning precise timing with LSTM recurrent networks. The Journal of Machine Learning Research. 2003; 3:115-143.
16. Yamashita Y, Tani J. Emergence of functional hierarchy in a multiple timescale neural network model: A humanoid robot experiment. PLoS Computational Biology. 2008; 4(11):e1000220. doi:10.1371/journal.pcbi.1000220 PMID: 18989398.
17. Hubel DH. Eye, brain, and vision: Scientific American Library; 1995.
18. Hasson U, Yang E, Vallines I, Heeger DJ, Rubin N. A hierarchy of temporal receptive windows in human cortex. The Journal of Neuroscience. 2008; 28(10):2539-2550. doi:10.1523/JNEUROSCI.5487-07.2008 PMID: 18322098.
19. Blank M, Gorelick L, Shechtman E, Irani M, Basri R. Actions as space-time shapes. IEEE International Conference on Computer Vision; 2005 17-21 Oct; Beijing: 2005. p. 1395-1402.
20. Scherer D, Müller A, Behnke S. Evaluation of pooling operations in convolutional architectures for object recognition. In: Diamantaras K, Duch W, Iliadis L, editors. Artificial Neural Networks-ICANN 2010. Lecture Notes in Computer Science. 6354: Springer Berlin Heidelberg; 2010. p. 92-101.
21. Rumelhart DE, McClelland JL, Group PR. Parallel distributed processing: MIT press; 1986.
22. LeCun Y, Bottou L, Orr GB, Müller K-R. Efficient backprop. In: Montavon G, Orr GB, Müller K-R, editors. Neural Networks: Tricks of the Trade. Lecture Notes in Computer Science. 7700: Springer Berlin Heidelberg; 2012. p. 9-48.
23. Schindler K, Van-Gool L. Action snippets: how many frames does human action recognition require? IEEE Conference on Computer Vision and Pattern Recognition; 2008 23-28 June; Anchorage, AK: 2008. p. 1-8.
24. Pollack J. The induction of dynamical recognizers. Machine Learning. 1991; 7(2-3):227-252. doi:10.1007/BF00114845.
25. Barnsley M. Fractals everywhere. Boston: Academic Press; 1988.
26. Tanaka K. Neuronal mechanisms of object recognition. Science. 1993 Oct 29; 262(5134):685-688. PubMed PMID: 8235589. doi:10.1126/science.8235589 PMID: 8235589.
27. Tanaka K. Inferotemporal cortex and object vision. Annual Review of Neuroscience. 1996; 19:109- 139. PubMed PMID: 8833438. doi:10.1146/annurev.ne.19.030196.000545 PMID: 8833438.
28. Tanji J, Shima K. Role for supplementary motor area cells in planning several movements ahead. Nature. 1994; 371(6496):413-416. doi:10.1038/371413a0 PMID: 8090219.
29. Kiebel SJ, Daunizeau J, Friston KJ. A Hierarchy of time-scales and the brain. PLoS Computational Biology. 2008; 4(11):e1000209. doi:10.1371/journal.pcbi.1000209 PMID: 19008936.
30. Badre D, D'Esposito M. Is the rostro-caudal axis of the frontal lobe hierarchical? Nature Reviews Neuroscience. 2009 Sep; 10(9):659-669. PubMed PMID: 19672274. Pubmed Central PMCID: PMC3258028. doi:10.1038/nrn2667 PMID: 19672274.
31. Uddén J, Bahlmann J. A rostro-caudal gradient of structured sequence processing in the left inferior frontal gyrus. Philosophical Transactions of the Royal Society B: Biological Sciences. 2012; 367 (1598):2023-2032. PubMed PMID: PMC3367683. doi:10.1098/rstb.2012.0009.
32. Friston KJ. The labile brain. III. Transients and spatio-temporal receptive fields. Philosophical Transactions of the Royal Society B: Biological Sciences. 2000; 355:253-265. doi:10.1098/rstb.2000.0562.
33. Rao RPN, Ballard DH. Predictive coding in the visual cortex: A functional interpretation of some extraclassical receptive-field effects. Nature Neuroscience. 1999; 2(1):79-87. doi:10.1038/4580 PMID: 10195184.