Extended coding and pooling in the HMAX model

IEEE Transactions on Image Processing

Volumn 22, Issue 2, 2013, Pages 764-777

  Theriault, Christian ^a   Thome, Nicolas ^a   Cord, Matthieu ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

Convolutional network; multiscale; object recognition; spatial pooling; vision

Indexed keywords

CLASSIFICATION RESULTS; COMPLEX FILTERS; CONVOLUTIONAL NETWORKS; GEOMETRICAL TRANSFORMATION; IMAGE DATASETS; IMAGE SIGNATURE; LOCAL FILTERS; LOCAL INFORMATION; MULTI-RESOLUTIONS; MULTIPLE SCALE; MULTISCALES; NEURAL NETWORK MODEL; OBJECT REGION; SPATIAL INFORMATIONS; SPATIAL POOLING; SYNTHETIC IMAGES; VISUAL CLASSIFICATION;

NETWORK ARCHITECTURE; OBJECT RECOGNITION; VISION;

CLASSIFICATION (OF INFORMATION);

EID: 84872311376     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2222900     Document Type: Article

References (57)

1. J. Mutch and D. G. Lowe, "Object class recognition and localization using sparse features with limited receptive fields," Int. J. Comput. Vis., vol. 80, pp. 45-57, Oct. 2008.
2. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 886-893. (Pubitemid 43897286)
3. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. Int. Conf. Comput. Vis., vol. 2. 2003, pp. 1470-1477.
4. D. Hubel and T. Wiesel, "Receptive fields of single neurones in the cat's striate cortex," J. Physiol., vol. 148, pp. 574-591, Oct. 1959.
5. F. W. Campbell and J. G. Robson, "Application of Fourier analysis to the visibility of gratings," J. Physiol., vol. 197, no. 3, pp. 551-566, 1968.
6. D. E. Broadbent G. B. Henning, and B. G. Hertz, "Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency," Vis. Res., vol. 15, nos. 8-9, pp. 887-897, 1975.
7. D. J. Field and B. A. Olshausen, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, pp. 607-609, Jun. 1996. (Pubitemid 26177476)
8. R. A. Young, "The Gaussian derivative model for spatial vision: I. Retinal mechanisms," J. Physiol., vol. 2, no. 4, pp. 273-293, 1987.
9. A. P. Witkin, "Scale-space filtering," in Proc. 8th Int. Joint Conf. Artif. Intell., vol. 8. 1983, pp. 1019-1022.
10. M. J. Luc, B. M. T. H. Romeny, J. J. Koenderink, and M. A. Viergever, "Scale and the differential structure of images," Image Vis. Comput., vol. 10, no. 6, pp. 376-388, 1992.
11. J. J. Koenderink, "Operational significance of receptive field assemblies," Biol. Cybern., vol. 58, no. 3, pp. 163-171, 1988.
12. J. J. Koenderink and A. J. van Doorn, "Representation of local geometry in the visual system," Biol. Cybern., vol. 55, no. 6, pp. 367-375, 1987. (Pubitemid 17030735)
13. T. Lindeberg, "Feature detection with automatic scale selection," Int. J. Comput. Vis., vol. 30, no. 2, pp. 77-116, 1998.
14. E. T. Rolls and G. Deco, Computaitonal Neuroscience of Vision, 1st ed. New York: Oxford, 2006.
15. K. Fukushima and S. Miyake, "Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position," Pattern Recognit., vol. 15, no. 6, pp. 455-469, 1982. (Pubitemid 13546813)
16. E. T. Rolls and T. T.Milward, "A model of invariant object recognition in the visual system: Learning rules, activation functions, lateral inhibition, and information-based performance measures," Neural Comput., vol. 12, pp. 2547-2572, Nov. 2000.
17. M. A. Ranzato, F. J. Huang, Y.-L. Boureau, and Y. LeCun, "Unsupervised learning of invariant feature hierarchies with applications to object recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Mar. 2007, pp. 1-8.
18. M. Riesenhuber and T. Poggio, "Hierarchical models of object recognition in cortex," Nature Neurosci., vol. 2, pp. 1019-1025, Nov. 1999. (Pubitemid 30599567)
19. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 411-426, Mar. 2007. (Pubitemid 46336417)
20. L. Wolf, S. M. Bileschi, and E. Meyers, "Perception strategies in hierarchical vision systems," in Proc. Conf. Comput. Vis. Pattern Recognit., vol. 2. 2006, pp. 2153-2160. (Pubitemid 44931580)
21. S. Bileschi, "Image representations beyond histograms of gradients: The role of gestalt descriptors," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Mar. 2007, pp. 1-8.
22. S. Hochstein and M. Ahissar, "View from the top: Hierarchies and reverse hierarchies in the visual system," Neuron, vol. 36, no. 5, pp. 791-804, 2002. (Pubitemid 35447852)
23. Y. Huang, K. Huang, D. Tao, T. Tan, and X. Li, "Enhanced biologically inspired model for object recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 6, pp. 1668-1680, Dec. 2011.
24. M. Cord C. Theriault, and N. Thome, "HMAX-S: Deep scale representation for biologically inspired image categorization," in Proc. IEEE Int. Conf. Image Process., Sep. 2011, pp. 1261-1264.
25. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Mar. 2010, pp. 2559-2566.
26. J. C. van Gemert, C. J. Veenman, A. W. M. Smeulders, and J.-M. Geusebroek, "Visual word ambiguity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1271-1283, Jul. 2010.
27. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Sep. 2010, pp. 3360-3367.
28. H. Goh, N. Thome, M. Cord, and J.-H. Lim, "Unsupervised and supervised visual codes with restricted Boltzmann machines," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 1-14.
29. S. Avila, N. Thome, M. Cord, E. Valle, and A. de Albuquerque Araújo, "BOSSA: Extended BoW formalism for image classification," in Proc. 18th IEEE Int. Conf. Image Process., Sep. 2011, pp. 2966-2969.
30. F. Perronnin, J. Sanchez, and T. Mensink, "Improving the Fisher kernel for large-scale image classification," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 143-156.
31. P. J. Lazebnik and C. Schmid, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. Conf. Comput. Vis. Pattern Recognit., vol. 2. 2006, pp. 2169-2178. (Pubitemid 44931582)
32. J. C. van Gemert, "Exploiting photographic style for category-level image classification by generalizing the spatial pyramid," in Proc. 1st ACM Int. Conf. Multimedia Retr., 2011, pp. 14:1-14:8.
33. S. Savarese, J. Winn, and A. Criminisi, "Discriminative object class models of appearance and shape by correlatons," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Washington, DC, Nov. 2006, pp. 2033-2040. (Pubitemid 44931565)
34. H. Ling and S. Soatto, "Proximity distribution kernels for geometric context in category recognition," in Proc. 10th IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
35. D. Picard, N. Thome, and M. Cord, "An efficient system for combining complementary kernels in complex visual categorization tasks," in Proc. 17th IEEE Int. Conf. Image Process., Mar. 2010, pp. 3877-3880.
36. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
37. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations," in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 609-616.
38. M. Zeiler, D. Krishnan, G. Taylor, and R. Fergus, "Deconvolutional networks for feature learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Dec. 2010, pp. 1-2.
39. T. Masquelier and S. J. Thorpe, "Unsupervised learning of visual features through spike timing dependent plasticity," PLOS, vol. 3, no. 2, p. e31, Feb. 2007.
40. S. Fidler, B. Boben, and A. Leonardis, "Similarity-based cross-layered hierarchical representation for object categorization," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
41. K. Fukushima, "Neocognitron for handwritten digit recognition," Neurocomputing, vol. 51, pp. 161-180, Apr. 2003. (Pubitemid 36367231)
42. N. Pinto, Y. Barhomi, D. D. Cox, and J. J. DiCarlo, "Comparing stateof-the-art visual features on invariant object recognition tasks," in Proc. IEEE Workshop Appl. Comput. Vis., Jan. 2011, pp. 463-470.
43. M. Cord and P. Cunningham, Machine Learning Techniques for Multimedia: Case Studies on Organization and Retrieval (Cognitive Technologies), 1st ed. New York: Springer-Verlag, 2008.
44. R. Fergus L. Fei-Fei, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories," in Proc. Conf. Comput. Vis. Pattern Recognit. Workshop Generat.-Model Based Vis., 2004, pp. 59-70. (Pubitemid 46528761)
45. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset," Dept. Comput. Sci., California Inst. Technology, Pasadena, Tech. Rep. 7694, 2007.
46. K. Jarrett, K. Kavukcuoglu, M. A. Ranzato, and Y. LeCun, "What is the best multi-stage architecture for object recognition?" in Proc. Int. Conf. Comput. Vis., 2009, pp. 2146-2153.
47. M. D. Zeiler, G. W. Taylor, and R. Fergus, "Adaptive deconvolutional networks for mid and high level feature learning," in Proc. Int. Conf. Comput. Vis., 2011, pp. 2018-2025.
48. H. Zhang, A. C. Berg, M. Maire, and J. Malik, "SVM-KNN: Discriminative nearest neighbor classification for visual category recognition," in Proc. IEEE comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Dec. 2006, pp. 2126-2136. (Pubitemid 44931577)
49. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1794-1801.
50. K. Sohn, D. Y. Jung, H. Lee, and A. Hero, "Efficient learning of sparse, distributed, convolutional feature representations for object recognition," in Proc. 13th Int. Conf. Comput. Vis., Nov. 2011, pp. 2643-2650.
51. Y.-L. Boureau, N. Le Roux, F. Bach, J. Ponce, and Y. LeCun, "Ask the locals: Multi-way local pooling for image recognition," in Proc. Int. Conf. Comput. Vis., 2011, pp. 2651-2658.
52. N. Pinto, D. D. Cox, and J. J. DiCarlo, "Why is real-world visual object recognition hard?" PLoS Comput. Biol., vol. 4, no. 1, p. e27, Jan. 2008.
53. J. L. Gallant, S. V. David, and B. Y. Hayden, "Spectral receptive field properties explain shape selectivity in area V4," J. Neurophysiol., vol. 96, no. 6, pp. 3492-3505, 2006. (Pubitemid 44837890)
54. C. Cadieu, M. Kouh, A. Pasupathy, C. E. Conner, M. Riesenhuber, and T. Poggio, "A model of V4 shape selectivity and invariance," J. Neurophysiol., vol. 98, no. 3, pp. 1733-1750, 2007. (Pubitemid 47435915)
55. A. Pasupathy and C. Connor, "Shape representation in area V4: Positionspecific tuning for boundary conformation," J. Neurophysiol., vol. 86, no. 5, pp. 2505-2519, 2001. (Pubitemid 34000610)
56. N. C. Aggelopoulos and E. T. Rolls, "Scene perception: Inferior temporal cortex neurons encode the positions of different objects in the scene," Eur. J. Neurosci., vol. 22, no. 11, pp. 2903-2916, 2005. (Pubitemid 41811287)
57. E. T. Rolls, N. C. Aggelopoulos, and F. Zheng, "The receptive fields of inferior temporal cortex neurons in natural scenes," J. Neurosci., vol. 23, no. 1, pp. 339-348, 2003. (Pubitemid 36050436)