A spiking neural network based cortex-like mechanism and application to facial expression recognition

Computational Intelligence and Neuroscience

Volumn 2012, Issue , 2012, Pages

  Fu, Si Yao ^a   Yang, Guo Sheng ^a   Kuai, Xin Kai ^a  

^a MINZU UNIVERSITY OF CHINA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MECHANISMS; COGNITIVE ANALYSIS; COGNITIVE MODEL; COMPLEX ENVIRONMENTS; COMPUTING POWER; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; FEED-FORWARD; FUNCTIONAL DECOMPOSITION; HIERARCHICAL SIMULATION; LOGICAL STRUCTURE; PATTERN RECOGNITION PROBLEMS; PROOF OF PRINCIPLES; SPIKING NEURAL NETWORKS; SPIKING NEURON MODELS; THEORETICAL MODELS; VENTRAL STREAMS; VISUAL CORTEXES;

COMPUTER SIMULATION; FACE RECOGNITION; GESTURE RECOGNITION; INTELLIGENT AGENTS;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER SIMULATION; FACIAL EXPRESSION; HUMAN; NERVE CELL; PHYSIOLOGY; VISUAL CORTEX;

COMPUTER SIMULATION; FACIAL EXPRESSION; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; PATTERN RECOGNITION, AUTOMATED; VISUAL CORTEX;

EID: 84870170141     PISSN: 16875265     EISSN: 16875273     Source Type: Journal    
DOI: 10.1155/2012/946589     Document Type: Article

References (53)

1. Laughlin S. B., Sejnowski T. J., Communication in neuronal networks. Science 2003 301 5641 1870 1874 2-s2.0-0141645490 10.1126/science.1089662 (Pubitemid 37221384)
2. Barlow H., Possible principles underlying the transformation of sensory messages. Sensory Communication 1961 217 2234
3. Fukushima K., Miyake S., Neocognitron, a Self-Organizing Neural Network Model for A Mechanism of Visual Pattern Recognition 1982 Springer Lecture Notes in Biomathematics
4. LeCun Y., Bengio: Y., Convolutional Networks for Images, Speech, and Time-Series. The Handbook of Brain theory and Neural Networks 1995 MIT Press
5. LeCun Y., Bengio Y., Pattern Recognition and Neural Networks. The Handbook of Brain theory and Neural Networks 1995 MIT Press
6. Ullman S., Soloviev S., Computation of pattern invariance in brain-like structures. Neural Networks 1999 12 7-8 1021 1036 2-s2.0-0033213769 10.1016/S0893-6080(99)00048-9 (Pubitemid 29389714)
7. Ullman S., Vidal-Naquet M., Sali E., Visual features of intermediate complexity and their use in classification. Nature Neuroscience 2002 5 7 682 687 2-s2.0-0036307392 10.1038/nn870 (Pubitemid 34742985)
8. Wersing H., Körner E., Learning optimized features for hierarchical models of invariant object recognition. Neural Computation 2003 15 7 1559 1588 2-s2.0-0038159929 10.1162/089976603321891800 (Pubitemid 37041466)
9. Riesenhuber M., Poggio T., Hierarchical models of object recognition in cortex. Nature Neuroscience 1999 2 11 1019 1025 2-s2.0-0033316361 10.1038/14819 (Pubitemid 30599567)
10. Serre T., Wolf L., Bileschi S., Riesenhuber M., Poggio T., Robust object recognition with cortex-like mechanisms. IEEE Transactions on Pattern Analysis and Machine Intelligence 2007 29 3 411 426 2-s2.0-33847380121 10.1109/TPAMI.2007.56 (Pubitemid 46336417)
11. Serre T., Kouh M., Cadieu C., Knoblich U., Kreiman G., Poggio T., Theory of Object Recognition: computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex Cambridge, Mass, USA MIT Press AI Memo 2005-036/CBCL Memo 259
12. HODGKIN A. L., HUXLEY A. F., A quantitative description of membrane current and its application to conduction and excitation in nerve. The Journal of Physiology 1952 117 4 500 544 2-s2.0-35649001607
13. Gerstern W., Kistler W. M., Spiking Neuron Models 2002 Cambridge University Press
14. Izhikevich E. M., Simple model of spiking neurons. IEEE Transactions on Neural Networks 2003 14 6 1569 1572 2-s2.0-0742268989 10.1109/TNN.2003.820440
15. Thorpe S., Fize D., Marlot C., Speed of processing in the human visual system. Nature 1996 381 6582 520 522 2-s2.0-0029895137 10.1038/381520a0 (Pubitemid 26170929)
16. Delorme A., Gautrais J., Van Rullen R., Thorpe S., SpikeNET: a simulator for modeling large networks of integrate and fire neurons. Neurocomputing 1999 26-27 989 996 2-s2.0-0032871941 10.1016/S0925-2312(99)00095-8 (Pubitemid 29447413)
17. Wysoski S. G., Benuskova L., Kasabov N., Fast and adaptive network of spiking neurons for multi-view visual pattern recognition. Neurocomputing 2008 71 13-15 2563 2575 2-s2.0-47849122135 10.1016/j.neucom.2007.12.038
18. Wysoski S. G., Benuskova L., Kasabov N., Evolving spiking neural networks for audiovisual information processing. Neural Networks 2010 23 7 819 835 2-s2.0-77955058561 10.1016/j.neunet.2010.04.009
19. Dolan R. J., Neuroscience and psychology: emotion, cognition, and behavior. Science 2002 298 5596 1191 1194 2-s2.0-0037044663 10.1126/science. 1076358 (Pubitemid 35285474)
20. Dailey M. N., Cottrell G. W., Padgett C., Adolphs R., Empath: a neural network that categorizes facial expressions. Journal of Cognitive Neuroscience 2002 14 8 1158 1173 2-s2.0-0037111647 10.1162/089892902760807177 (Pubitemid 35305822)
21. Dailey M. N., Joyce C., Lyons M. J., Kamachi M., Ishi H., Gyoba J., Cottrell G. W., Evidence and a computational explanation of cultural differences in facial expression recognition. Emotion 2010 10 6 874 893 2-s2.0-78650711086 10.1037/a0020019
22. Fu S.-Y., Yang G.-S., Hou Z.-G., Spiking neural networks based cortex like mechanism: a case study for facial expression recognition. Proceedings of the International Joint Conference on Neural Networks (IJCNN '11) 2011 1637 1642 6033421 2-s2.0-80054743864 10.1109/IJCNN.2011.6033421
23. Zhaoping L., Theoretical understanding of the early visual processes by data compression and data selection. Network: Computation in Neural Systems 2006 17 4 301 334 2-s2.0-33847767957
24. Serre T., Learning a dictionary of shape-components in visual cortex: comparison with neurons, humans and machines [Ph.D. thesis] 2006 MIT Press
25. Hyvärinen A., Hoyer P. O., Inki M., Topographic independent component analysis. Neural Computation 2001 13 7 1527 1558 2-s2.0-0035409349 10.1162/089976601750264992 (Pubitemid 33595031)
26. Olshausen B. A., Field D. J., Sparse coding with an overcomplete basis set: a strategy employed by V1? Vision Research 1997 37 23 3311 3325 2-s2.0-0030779611 10.1016/S0042-6989(97)00169-7 (Pubitemid 27493805)
27. Vinje W. E., Gallant J. L., Sparse coding and decorrelation in primary visual cortex during natural vision. Science 2000 287 5456 1273 1276 2-s2.0-0034681515 10.1126/science.287.5456.1273 (Pubitemid 30112150)
28. Poggio T., Serre T., Models of Visual Cortex 2011 Scholarpedia
29. VanRullen R., Thorpe S. J., Surfing a spike wave down the ventral stream. Vision Research 2002 42 23 2593 2615 2-s2.0-0036810687 10.1016/S0042-6989(02) 00298-5 (Pubitemid 35350846)
30. Gross C. G., Brain Vision and Memory: Tales in the History of Neuroscience 1998 MIT Press
31. Zheng W., Zhou X., Zou C., Zhao L., Facial expression recognition using kernel canonical correlation analysis (KCCA). IEEE Transactions on Neural Networks 2006 17 1 233 238 2-s2.0-33144473787 10.1109/TNN.2005.860849 (Pubitemid 43263953)
32. Bell A. J., Sejnowski T. J., The 'independent components' of natural scenes are edge filters. Vision Research 1997 37 23 3327 3338 2-s2.0-0030832881 10.1016/S0042-6989(97)00121-1 (Pubitemid 27493806)
33. JAFEE dataset, http://www.kasrl.org/jaffe.html
34. Shih F. Y., Chuang C. F., Wang P. S. P., Performance comparisons of facial expression recognition in JAFFE database. International Journal of Pattern Recognition and Artificial Intelligence 2008 22 3 445 459 2-s2.0-44349157046 10.1142/S0218001408006284 (Pubitemid 351730129)
35. Deng H. B., Jin L. W., Zhen L. X., Huang J. C., A new facial expression recognition method based on local gabor filter bank and PCA plus LDA. International Journal of Information Technology 2005 11 11 86 96
36. Fu S. Y., Yang G. S., Hou Z. G., Multiple kernel learning with ICA: local discriminative image descriptors for recognition. Proceedings of the International Joint Conference on Neural Networks (IJCNN '10) July 2010 2-s2.0-79959425134 10.1109/IJCNN.2010.5596572
37. Tian Y., Kanade T., Cohn J., Evaluation of gabor wavelet based facial action unit recognition in image sequences of inceasing complexity. Proceedings of the International Conference on Multi-Modal Interface 2002
38. Cheng F., Yu J., Xiong H., Facial expression recognition in JAFFE dataset based on Gaussian process classification. IEEE Transactions on Neural Networks 2010 21 10 1685 1690 2-s2.0-77957765197 10.1109/TNN.2010.2064176
39. Alves N. T., Aznar-Casanova J. A., Fukusima S. S., Patterns of brain asymmetry in the perception of positive and negative facial expressions. Laterality 2009 14 3 256 272 2-s2.0-68549115342 10.1080/13576500802362927
40. Cohn-Kanada AU-Coded dataset, http://www.pitt.edu/jeffcohn/CKandCK+.htm
41. Jack R. E., Blais C., Scheepers C., Schyns P. G., Caldara R., Cultural confusions show that facial expressions are not universal. Current Biology 2009 19 18 1543 1548 2-s2.0-70349289081 10.1016/j.cub.2009.07.051
42. Jack R. E., Caldara R., Schyns P. G., Internal representations reveal cultural diversity in expectations of facial expressions of emotion. Journal of Experimental Psychology 2012 141 1 19 25 2-s2.0-84861744563 10.1037/a0023463
43. Olshausen B. A., Field D. J., Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 1996 381 6583 607 609 2-s2.0-0029938380 10.1038/381607a0 (Pubitemid 26177476)
44. Sharpee T. O., Sugihara H., Kurgansky A. V., Rebrik S. P., Stryker M. P., Miller K. D., Adaptive filtering enhances information transmission in visual cortex. Nature 2006 439 7079 936 942 2-s2.0-33644556164 10.1038/nature04519 (Pubitemid 43292406)
45. Connor C. E., A new viewpoint on faces. Science 2010 330 6005 764 765 2-s2.0-78149334239 10.1126/science.1198348
46. Freiwald W. A., Tsao D. Y., Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 2010 330 6005 845 851 2-s2.0-78149355557 10.1126/science.1194908
47. Freiwald W. A., Tsao D. Y., Livingstone M. S., A face feature space in the macaque temporal lobe. Nature Neuroscience 2009 12 9 1187 1196 2-s2.0-69449101218 10.1038/nn.2363
48. Kasabov N., To spike or not to spike: a probabilistic spiking neuron model. Neural Networks 2010 23 1 16 19 2-s2.0-70649084995 10.1016/j.neunet.2009. 08.010
49. Herz A. V. M., Gollisch T., Machens C. K., Jaeger D., Modeling single-neuron dynamics and computations: a balance of detail and abstraction. Science 2006 314 5796 80 85 2-s2.0-33749595018 10.1126/science.1127240 (Pubitemid 44547744)
50. Braje W. L., Kersten D., Tarr M. J., Troje N. F., Illumination effects in face recognition. Psychobiology 1998 26 4 371 380 2-s2.0-0032415354 (Pubitemid 29068431)
51. Yamane Y., Carlson E. T., Bowman K. C., Wang Z., Connor C. E., A neural code for three-dimensional object shape in macaque inferotemporal cortex. Nature Neuroscience 2008 11 11 1352 1360 2-s2.0-54949090307 10.1038/nn.2202
52. Rahman Z. U., Jobson D. J., Woodell G. A., Multi-scale retinex for color image enhancement. Proceedings of the 1996 IEEE International Conference on Image Processing (ICIP '96) September 1996 1003 1006 2-s2.0-0030416492
53. Sim T., Baker S., Bsat M., The CMU pose, illumination, and expression database. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003 25 12 1615 1618 2-s2.0-0347380229 10.1109/TPAMI.2003.1251154