Action recognition via bio-inspired features: The richness of center-surround interaction

Computer Vision and Image Understanding

Volumn 116, Issue 5, 2012, Pages 593-605

  Escobar, María José ^a   Kornprobst, Pierre ^b  

^a DEPARTAMENTO DE FÍSICA   (Chile)

^b INRIA   (France)

Author keywords

Action recognition; Bio inspired models; Center surround interaction; Motion analysis; MT; V1

Indexed keywords

ACTION RECOGNITION; BIO-INSPIRED; CENTER-SURROUND INTERACTION; MOTION ANALYSIS; MT; V1;

CELLS; COMPUTER VISION; CYTOLOGY; DATABASE SYSTEMS; GEOMETRY;

MOTION ESTIMATION;

EID: 84856804426     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2012.01.002     Document Type: Article

References (65)

1. E. Adelson, and J. Bergen Spatiotemporal energy models for the perception of motion Journal of the Optical Society of America A 2 1985 284 299 (Pubitemid 15466457)
2. D.G. Albrecht, W.S. Geisler, and A.M. Crane Nonlinear properties of visual cortex neurons: Temporal dynamics, stimulus selectivity, neural performance L.M. Challupa, J.S. Werner, The Visual Neurosciences Vol. 1 2004 MIT press 747 764
3. P. Bayerl, and H. Neumann Disambiguating visual motion by form-motion interaction - a computational model International Journal of Computer Vision 72 1 2007 27 45 (Pubitemid 44876075)
4. C. Beck, T. Ognibeni, and H. Neumann Object segmentation from motion discontinuities and temporal occlusions - a biologically inspired model PLoS ONE 3 11 2008 1 14
5. J. Berzhanskaya, S. Grossberg, and E. Mingolla Laminar cortical dynamics of visual form and motion interactions during coherent object motion perception Spatial Vision 20 4 2007 337 395 (Pubitemid 47184828)
6. Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R., 2005. Actions as space-time shapes. Proceedings of the 10th International Conference on Computer Vision. Vol. 2. pp. 1395-1402. (Pubitemid 44042342)
7. R.T. Born Center-surround interactions in the middle temporal visual area of the owl monkey Journal of Neurophysioly 84 2000 2658 2669
8. Bouecke, J.D., Tlapale, É., Kornprobst, P., Neumann, H., 2011. Neural mechanisms of motion detection, integration, and segregation: From biology to artificial image processing systems. EURASIP, special issue on Biologically inspired signal processing: Analysis, algorithms, and applications 2011.
9. N. Bruce, and J. Tsotsos Saliency, attention, and visual search: An information theoretic approach Journal of Vision 9 3 2009 1 24 5
10. Bruce, N.D.B., Kornprobst, P., 2009. Harris corners in the real world: A principled selection criterion for interest points based on ecological statistics. cvp (2009).
11. G.T. Buracas, and T.D. Albright Contribution of area MT to perception of three-dimensional shape: a computational study Vision Res 36 6 1996 869 887 (Pubitemid 26073848)
12. M. Carandini, J.B. Demb, V. Mante, D.J. Tollhurst, Y. Dan, B.A. Olshausen, J.L. Gallant, and N.C. Rust Do we know what the early visual system does? Journal of Neuroscience 25 46 2005 10577 10597 (Pubitemid 41681906)
13. A. Casile, and M. Giese Critical features for the recognition of biological motion Journal of Vision 5 2005 348 360 (Pubitemid 41519257)
14. B. Conway, and M. Livingstone Space-time maps and two-bar interactions of different classes of direction-selective cells in macaque V1 Journal of Neurophysiology 89 2003 2726 2742 (Pubitemid 36570234)
15. R. De Valois, and N. Cottaris Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity Vision Research 40 2000 3685 3702
16. A. Destexhe, M. Rudolph, and D. Paré The high-conductance state of neocortical neurons in vivo Nature Reviews Neuroscience 4 2003 739 751 (Pubitemid 37280153)
17. Dollar, P., Rabaud, V., Cottrell, G., Belongie, S., 2005. Behavior recognition via sparse spatio-temporal features. VS-PETS. pp. 65-72. (Pubitemid 46178025)
18. Efros, A., Berg, A., Mori, G., Malik, J., Oct. 2003. Recognizing action at a distance. Proceedings of the 9th International Conference on Computer Vision. Vol. 2. pp. 726-734.
19. M.-J. Escobar, G.S. Masson, T. Vieville, and P. Kornprobst Action recognition using a bio-inspired feedforward spiking network International Journal of Computer Vision 82 3 2009 284
20. M. Giese, and T. Poggio Neural mechanisms for the recognition of biological movements and actions Nature Reviews Neuroscience 4 2003 179 192 (Pubitemid 37280183)
21. N. Grzywacz, and A. Yuille A model for the estimate of local image velocity by cells on the visual cortex Proc R Soc Lond B Biol Sci. 239 1295 1990 129 161 (Pubitemid 20124730)
22. X. Huang, T.D. Albright, and G.R. Stoner Stimulus dependency and mechanisms of surround modulation in cortical area mt Journal of Neuroscience 28 51 2008 13889 13906
23. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 20 11 1998 1254 1259 (Pubitemid 128742001)
24. Jhuang, H., Serre, T., Wolf, L., Poggio, T., 2007. A biologically inspired system for action recognition. Proceedings of the 11th International Conference on Computer Vision. pp. 1-8.
25. P. Kornprobst, R. Deriche, and G. Aubert Image sequence analysis via partial differential equations Journal of Mathematical Imaging and Vision 11 1 1999 5 26
26. Kuo, C.-H., Huang, C., Nevatia, R., 2010. Multi-target tracking by on-line learned discriminative appearance models. Proceedings of the International Conference on Computer Vision and Pattern Recognition. IEEE, p. 685+692.
27. L. Lagae, S. Raiguel, and G.A. Orban Speed and direction selectivity of macaque middle temporal neurons Journal of Neurophysiology 69 1 1993 19 39 (Pubitemid 23071083)
28. I. Laptev, B. Caputo, C. Schuldt, and T. Linderberg Local velocity-adapted motion events for spatio-temporal recognition Computer vision and image understanding 108 2007 207 229 (Pubitemid 350016963)
29. Le, Q., Zou, W., Yeung, S., Ng, A., 2009. Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis. cvp (2009), pp. 3361-3368.
30. Li, Y., Huang, C., Nevatia, R., 2009. Learning to associate: Hybridboosted multi-target tracker for crowded scene. cvp (2009), p. 2953+2960.
31. J. Liu, and W.T. Newsome Functional organization of speed tuned neurons in visual area MT Journal of Neurophysiology 89 2003 246 256 (Pubitemid 36134018)
32. L.L. Lui, J.A. Bourne, and M.G.P. Rosa Spatial summation, end inhibition and side inhibition in the middle temporal visual area MT Journal of Neurophysiology 97 2 2007 1135
33. V. Mante, and M. Carandini Mapping of stimulus energy in primary visual cortex Journal of Neurophysiology 94 2005 788 -798 (Pubitemid 40923287)
34. R. Masland, and P. Martin The unsolved mystery of vision Current Biology 17 15 2007 R577 R582
35. L. Michels, M. Lappe, and L. Vaina Visual areas involved in the perception of human movement from dynamic analysis Brain Imaging 16 10 2005 1037 1041 (Pubitemid 41017602)
36. S. Nowlan, and T. Sejnowski A selection model for motion processing in area MT of primates J. Neuroscience 15 1995 1195 1214
37. B. Olshausen, and D. Field How close are we to understanding V1? Neural Computation 17 8 2005 1665 1699 (Pubitemid 40864606)
38. J.-J. Orban de Xivry, S. Coppe, P. Lefvre, and M. Missal Biological motion drives perception and action Journal of Vision 10 2 2010 1 11
39. C. Pack, B. Conway, R. Born, and M. Livingstone Spatiotemporal structure of nonlinear subunits in macaque visual cortex Journal of Neuroscience 26 3 2006 893 907 (Pubitemid 43237082)
40. C. Pack, A. Gartland, and R. Born Integration of contour and terminator signals in visual area MT of alert macaque The Journal of Neuroscience 24 13 2004 3268 3280 (Pubitemid 38451893)
41. J. Perge, B. Borghuis, R. Bours, M. Lankheet, and R. van Wezel Temporal dynamics of direction tuning in motion-sensitive macaque area mt Journal of Neurophysiology 93 2005 pp. 2194-2116
42. J. Perrone A visual motion sensor based on the properties of V1 and MT neurons Vision Research 44 2004 1733 1755 (Pubitemid 38609059)
43. J. Perrone, and R. Krauzlis Spatial integration by mt pattern neurons: a closer look at pattern-to-component effects and the role of speed tuning Journal of Vision 8 9 2008 1 14
44. J. Perrone, and A. Thiele Speed skills: measuring the visual speed analyzing properties of primate mt neurons Nature Neuroscience 4 5 2001 526 532 (Pubitemid 32397191)
45. R. Poppe Vision-based human motion analysis: An overview Computer Vision and Image Understanding 108 1-2 2007 4 18 (Pubitemid 47333391)
46. R. Poppe A survey on vision-based human action recognition Image and Vision Computing 28 2010 976 990
47. N. Priebe, C. Cassanello, and S. Lisberger The neural representation of speed in macaque area MT/V5 Journal of Neuroscience 23 13 2003 5650 5661 (Pubitemid 36807843)
48. Rodriguez, M., Shah, M., 2007. Detecting and segmenting humans in crowded scenes. ACM MM.
49. N. Rust, V. Mante, E. Simoncelli, and J. Movshon How mt cells analyze the motion of visual patterns Nature Neuroscience 9 2006 1421 1431 (Pubitemid 44646215)
50. A. Safford, E. Hussey, R. Parasuraman, and J. Thompson Object-based attentional modulation of biological motion processing: Spatiotemporal dynamics using functional magnetic resonance imaging and electroencephalography The Journal of Neuroscience 30 27 2010 9064 9073
51. Serre, T., apr 2006. Learning a dictionary of shape-components in visual cortex: Comparison with neurons, humans and machines. Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA.
52. E.P. Simoncelli, and D. Heeger A model of neuronal responses in visual area MT Vision Research 38 1998 743 761 (Pubitemid 28081676)
53. M. Smith, N. Majaj, and A. Movshon Dynamics of motion signaling by neurons in macaque area mt Nature Neuroscience 8 2 2005 220 228 (Pubitemid 40194053)
54. É. Tlapale, G.S. Masson, and P. Kornprobst Modelling the dynamics of motion integration with a new luminance-gated diffusion mechanism Vision Research 50 17 2010 1676 1692
55. J. Tsotsos, Y. Liu, J. Martinez-Trujillo, M. Pomplun, E. Simine, and K. Zhou Attending to visual motion Computer Vision and Image Understanding 100 2005 3 40 (Pubitemid 41329895)
56. P. Turaga, R. Chellappa, V. Subrahmanian, and O. Udrea Machine recognition of human activities: a survey IEEE Transactions on Circuits and Systems for Video Technology 18 11 2008 1473 1488
57. H. Wang, M.M. Ullah, A. Klaser, I. Laptev, and C. Schmid Evaluation of local spatio-temporal features for action recognition Proceedings of the British Machine Vision Conference 2010 BMVA Press
58. A. Watson, and A. Ahumada Model of human visual-motion sensing J Opt Soc Am A 2 2 1985 322 342
59. M. Weliky, J. Fiser, R. Hunt, and D. Wagner Coding of natural scenes in primary visual cortex Neuron 37 2003 703 718 (Pubitemid 36262990)
60. D. Xiao, S. Raiguel, V. Marcar, J. Koenderink, and G.A. Orban Spatial heterogeneity of inhibitory surrounds in the middle temporal visual area Proceedings of the National Academy of Sciences 92 24 1995 11303 11306
61. D.K. Xiao, S. Raiguel, V. Marcar, and G.A. Orban The spatial distribution of the antagonistic surround of MT/V5 neurons Cereb Cortex 7 7 1997 662 677 (Pubitemid 27467977)
62. Xing, J., Ai, H., Lao, S., 2009. Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses. cvp (2009), p. 1200+1207.
63. Yeffet, L., Wolf, L., sept 2009. Local trinary patterns for human action recognition. Proceedings of the 12th International Conference on Computer Vision. pp. 492-497.
64. Zelnik-Manor, L., Irani, M., 2001. Event-based analysis of video. Proceedings of the International Conference on Computer Vision and Pattern Recognition. Vol. 2. pp. 123-128.
65. T. Zhao, R. Nevatia, and B. Wu Segmentation and tracking of multiple humans in crowded environments IEEE Transactions on Pattern Analysis and Machine Intelligence 30 7 2007 1198 1211