Modeling activity-dependent plasticity in BCM spiking neural networks with application to human behavior recognition

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 1, 2011, Pages 1952-1966

  Meng, Yan ^a   Jin, Yaochu ^b   Yin, Jun ^a  

^a Stevens Institute of Technology   (United States)

^b UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

And Munro model; Bienenstock; cooper; evolution strategy; gene regulatory network; human behavior recognition; neural plasticity; spiking neural network

Indexed keywords

BIENENSTOCK; COOPER; EVOLUTION STRATEGIES; GENE REGULATORY NETWORK; HUMAN BEHAVIOR RECOGNITION; NEURAL PLASTICITY; SPIKING NEURAL NETWORKS;

BEHAVIORAL RESEARCH; COMPUTER SIMULATION; GENES; HIDDEN MARKOV MODELS; INTELLIGENT AGENTS; SOCIAL SCIENCES; TIME SERIES;

NEURAL NETWORKS;

ACTION POTENTIAL; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BEHAVIOR; BIOLOGICAL MODEL; BIOMIMETICS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; HUMAN; METHODOLOGY; NERVE CELL NETWORK; NERVE CELL PLASTICITY; PHYSIOLOGY;

ACTION POTENTIALS; ARTIFICIAL INTELLIGENCE; BEHAVIOR; BIOMIMETICS; COMPUTER SIMULATION; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, NEUROLOGICAL; NERVE NET; NEURONAL PLASTICITY; PATTERN RECOGNITION, AUTOMATED;

EID: 83855163551     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2171044     Document Type: Article

References (68)

1. S. M. Bohte, J. N. Kok, and H. L. Poutre, "Error-backpropagation in temporally encoded networks of spiking neurons," Neurocomputing, vol. 48, nos. 1-4, pp. 17-37, 2002. (Pubitemid 36221486)
2. W. Maass, R. A. Legenstein, and H. Markram, "A new approach toward vision suggested by biologically realistic neural microcircuit models," in Proc. 2nd Workshop Biol. Motivated Comput. Vis., 2002, pp. 1-9.
3. W. Maass, T. Natschläger, and H. Markram, "Real-time computing without stable states: A new framework for neural computation based on perturbations," Neural Comput., vol. 14, no. 11, pp. 2531-2560, Nov. 2002.
4. H. Jaeger, "The 'echo state' approach to analysing and training recurrent neural networks," German National Research Center Information Technology, Fraunhofer Institute Autonomous Intelligent Systems, Muenchen, Germany, Tech. Rep. 148, 2001.
5. B. Schrauwen, D. Verstraeten, and J. M. V. Campenhout, "An overview of reservoir computing: Theory, applications andimplementations," in Proc. 15th Eur. Symp. Artif. Neural Netw., 2007, pp. 471-482.
6. E. L. Bienenstock, L. N. Cooper, and P. W. Munro, "Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex," J. Neurosci., vol. 2, no. 1, pp. 32-48, Jan. 1982. (Pubitemid 12146056)
7. S. M. Dudek and M. F. Bear, "Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade," Proc. Nat. Acad. Sci. United States Amer., vol. 89, no. 10, pp. 4363-4367, May 1992.
8. A. Kirkwood, M. G. Rioult, and M. F. Bear, "Experience-dependent modification of synaptic plasticity in visual cortex," Nature, vol. 381, no. 6582, pp. 526-528, Jun. 1996. (Pubitemid 26170931)
9. C. D. Rittenhouse, H. Z. Shouval, M. A. Paradiso, and M. F. Bear, "Monocular deprivation induces homosynaptic long-term depression in visual cortex," Nature, vol. 397, no. 6717, pp. 347-350, Jan. 1999.
10. Y. Ke, R. Sukthankar, and M. Hebert, "Event detection in crowded videos," in Proc. IEEE Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, Oct. 2007, pp. 1-8.
11. J. W. Kalat, Biological Psychology, 10th ed. Belmont, CA: Wadsworth, 2008.
12. S. Flavell and M. E. Greenberg, "Signaling mechanisms linking neuronal activity to gene expression and plasticity of the nervous system," Annu. Rev. Neurosci., vol. 31, pp. 563-590, Jul. 2008.
13. Y. Meng, Y. Jin, J. Yin, and M. Conforth, "Human activity detection using spiking neural networks regulated by a gene regulatory network," in Proc. Int. Joint Conf. Neural Netw., Barcelona, Spain, Jul. 2010, pp. 1-6.
14. N. Hansen, S. D. Müller, and P. Koumoutsakos, "Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES)," Evol. Comput., vol. 11, no. 1, pp. 1-18, 2003. (Pubitemid 37044186)
15. N. Hansen and A. Ostermeier, "Completely derandomized self-adaptation in evolution strategies," Evol. Comput., vol. 9, no. 2, pp. 159-195, Jun. 2001.
16. A. Doulamis and N. Matsatsinis, "Visual understanding industrial workflows under uncertainty on distributed service oriented architectures," Future Generat. Comput. Syst., 2011, to be published.
17. J.-M. Odobez, D. Gatica-Perez, and S. O. Ba, "Embedding motion in model-based stochastic tracking," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3514-3530, Nov. 2006. (Pubitemid 44615145)
18. V. Krüger, D. Kragic, A. Ude, and C. Geib, "The meaning of action: A review on action recognition and mapping," Adv. Robot., vol. 21, no. 13, pp. 1473-1501, 2007. (Pubitemid 47529843)
19. Y. Hu, L. Cao, F. Lv, S. Yan, Y. Gong, and T. S. Huang, "Action detection in complex scenes with spatial and temporal ambiguities," in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, Sep.-Oct. 2009, pp. 128-135.
20. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach," in Proc. Int. Conf. Pattern Recognit., vol. 3. Aug. 2004, pp. 32-36.
21. V. Petridis, B. Deb, and V. Syrris, "Detection and identification of human actions using predictive modular neural networks," in Proc. 17th Medit. Conf. Control Autom., Thessaloniki, Greece, Jun. 2009, pp. 406-411.
22. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, pp. 211-244, Jun. 2001. (Pubitemid 33687203)
23. H. Burgsteiner, "On learning with recurrent spiking neural networks and their applications to robot control with real-world devices," Ph.D. dissertation, Faculty Comput. Sci., Graz Univ. Technology, Graz, Austria, 2005.
24. J. Hertzberg, H. Jaeger, and F. Schönherr, "Learning to ground fact symbols in behavior-based robots," in Proc. 15th Eur. Conf. Artif. Intell., 2002, pp. 708-712.
25. A. Graves, D. Eck, N. Beringer, and J. Schmidhuber, "Biologically plausible speech recognition with LSTM neural nets," in Proc. BIO-ADIT, 2004, pp. 127-136. (Pubitemid 39742705)
26. L. Zelnik-Manor and M. Irani, "Event-based analysis of video," in Proc. Comput. Vis. Pattern Recognit., vol. 2. Sep. 2001, pp. 123-130.
27. T. Duong, H. Bui, D. Phung, and S. Venkatesh, "Activity recognition and abnormality detection with the switching hidden semi-Markov model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2005, pp. 838-845. (Pubitemid 43897280)
28. B. Van, S. Garcia-Salicetti, and B. Dorizzi, "On using the viterbi path along with HMM likelihood information for online signature verification," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 37, no. 5, pp. 1237-1247, Oct. 2007. (Pubitemid 47534589)
29. T. Xiang and S. Gong, "Video behavior profiling for anomaly detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 5, pp. 893-908, May 2008. (Pubitemid 351486756)
30. Y. Ke, R. Sukthankar, and M. Hebert, "Efficient visual event detection using volumetric features," in Proc. IEEE Int. Conf. Comput. Vis., vol. 1. Oct. 2005, pp. 166-173. (Pubitemid 44054955)
31. A. A. Efros, A. C. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. IEEE Int. Conf. Comput. Vis., vol. 2. Nice, France, Oct. 2003, pp. 726-733.
32. I. Laptev and T. Lindeberg, "Space-time interest points," in Proc. IEEE Int. Conf. Comput. Vis., vol. 1. Nice, France, Oct. 2003, pp. 432-439.
33. C. Harris and M. J. Stephens, "A combined corner and edge detector," in Proc. Alvey Vis. Conf., 1988, pp. 147-152.
34. P. Dolĺar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. 2nd Joint IEEE Int. Workshop Visual Surveill. Perform. Eval. Track. Surveill., Oct. 2005, pp. 65-72. (Pubitemid 46178025)
35. C. Christodoulou, G. Bugmann, and T. G. Clarkson, "A spiking neuron model: Applications and learning," Neural Netw., vol. 15, no. 7, pp. 891-908, Sep. 2002. (Pubitemid 35303334)
36. C. Dance, J. Willamowski, L. Fan, C. Bray, and G. Csurka, "Visual categorization with bags of keypoints," in Proc. ECCV Int. Workshop Stat. Learn. Comput. Vis., 2004, pp. 1-15.
37. F. Li and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 2005, pp. 524-531.
38. J. C. Niebles and F. Li, "A hierarchical model of shape and appearance for human action classification," in Proc. Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, Jun. 2007, pp. 1-8.
39. N. Y. Liang, G. B. Huang, P. Saratchandran, and N. Sundararajan, "A fast and accurate online sequential learning algorithm for feedforward networks," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1411-1423, Nov. 2006. (Pubitemid 44824256)
40. A. G. Tijsseling, "Sequential information processing using time-delay connections in ontogenic CALM networks," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 145-159, Jan. 2005. (Pubitemid 40241916)
41. W. Gerstner and W. Kistler, Spiking Neuron Models. Cambridge, U.K.: Cambridge Univ. Press, 2002.
42. P. Arena, L. Fortuna, M. Frasca, and L. Patane, "Learning anticipation via spiking networks: Application to navigation control," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 202-216, Feb. 2009.
43. Q. Wu, T. M. Mcginnity, L. Maguire, J. Cai, and G. D. Valderrama-Gonzalez, "Motion detection using spiking neural network model," in Proc. Int. Conf. Intell. Comput.: Adv. Intell. Comput. Theories Appl.-Aspects Artif. Intell., Shanghai, China, 2008, pp. 76-83.
44. W. Gerstner and W. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity, 1st ed. Cambridge, U.K.: Cambridge Univ. Press, 2002.
45. P. Rowcliffe, J. Feng, and H. Buxton, "Spiking perceptrons," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 803-807, May 2006.
46. J. H. Shin, D. Smith, W. Swiercz, K. Staley, T. Rickard, J. Montero, L. A. Kurgan, and K. J. Cios, "Recognition of partially occluded and rotated images with a network of spiking neurons," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1697-1709, Nov. 2010.
47. S. Edelman, N. Intrator, and J. S. Jacobson, "Unsupervised learning of visual structure," in Proc. Biol. Motivat. Comput. Vis., vol. 2525. 2002, pp. 629-642.
48. H. Kurashige and Y. Sakai, "BCM-type synaptic plasticity model using a linear summation of calcium elevations as a sliding threshold," in Proc. Int. Conf. Neural Inf. Process., LNCS 4232. 2006, pp. 19-29. (Pubitemid 44681486)
49. H. Z. Shouval, G. C. Castellani, B. S. Blais, L. C. Yeung, and L. N. Cooper, "Converging evidence for a simplified biophysical model of synaptic plasticity," Biol. Cybern., vol. 87, nos. 5-6, pp. 383-391, Dec. 2002. (Pubitemid 135689599)
50. D. Baras and R. Meir, "Reinforcement learning, spike-time-dependent plasticity, and the BCM rule," Neural Comput., vol. 19, no. 8, pp. 2245-2279, Aug. 2007.
51. J. J. Wade, L. J. McDaid, J. A. Santos, and H. M. Sayers, "SWAT: A spiking neural network training algorithm for classification problems," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1817-1830, Nov. 2010.
52. L. Benuskova and N. Kasabov, Computational Neurogenetic Modeling. New York: Springer-Verlag, 2007.
53. L. Benuskova, V. Jain, S. G. Wysoski, and N. K. Kasabov, "Computational neurogenetic modelling: A pathway to new discoveries in genetic neuroscience," Int. J. Neural Syst., vol. 16, no. 3, pp. 215-226, Jun. 2006. (Pubitemid 44127765)
54. U. Alon, An Introduction to Systems Biology: Design Principles of Biological Circuits, 1st ed. London, U.K.: Chapman & Hall, 2006.
55. D. Endy and R. Brent, "Modelling cellular behavior," Nature, vol. 409, no. 6818, pp. 391-395, Jan. 2001.
56. E. Mjolsness, D. H. Sharp, and J. Reinitz, "A connectionist model of development," J. Theoret. Biol., vol. 152, no. 4, pp. 429-453, Oct. 1991.
57. N. Hansen. The CMA Evolution Strategy: A Tutorial [Online]. Available: http://www.lri.fr/-hansen/cmatutorial.pdf
58. D. D. O'Leary and S. Sahara, "Genetic regulation of arealization of the neocortex," Current Opin. Neurobiol., vol. 18, no. 1, pp. 90-100, Feb. 2008.
59. R. O. L. Wong and A. Ghosh, "Activity-dependent regulation of dendritic growth and patterning," Nature Rev. Neurosci., vol. 3, no. 10, pp. 803-812, Oct. 2002. (Pubitemid 135706691)
60. H. Jaeger, "Discovering multiscale dynamical features with hierarchical echo state networks," School Eng. Sci., Jacobs Univ., Bremen, Germany, Tech. Rep. 10, Jul. 2007.
61. P. Collet and J.-P. Eckmann, Iterated Maps on the Interval as Dynamical System. Boston, MA: Birkhäuser, 1980.
62. W. Maass, T. Natschläger, and H. Markram, "A model for real-time computation in generic neural microcircuits," in Proc. Neural Inf. Process. Syst., 2003, pp. 229-236.
63. L. E. Baum, T. Petrie, G. Soules, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," Ann. Math. Stat., vol. 41, no. 1, pp. 164-171, 1970.
64. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Soc., vol. 39, no. 1, pp. 1-38, 1977.
65. A. Viterbi, "Error bounds for convolutional codes and an asymptotically optimum decoding algorithm," IEEE Trans. Inf. Theory, vol. 13, no. 2, pp. 260-269, Apr. 1967.
66. O. Antonios, P. Maja, and P. Ioannis, "Sparse B-spline polynomial descriptors for human activity recognition," Image Vis. Comput., vol. 27, no. 12, pp. 1814-1825, Nov. 2009.
67. J. Liu, S. Ali, and M. Shah, "Recognizing human actions using multiple features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, Jun. 2008, pp. 1-8.
68. A. Voulodimos, D. Kosmopoulos, G. Veres, H. Grabner, L. Van Gool, and T. Varvarigou, "Online classification of visual tasks for industrial workflow monitoring," Neural Netw., vol. 24, no. 8, pp. 852-860, 2011.