Using object affordances to improve object recognition

IEEE Transactions on Autonomous Mental Development

Volumn 3, Issue 3, 2011, Pages 207-215

  Castellini, C ^a   Tommasi, T ^b   Noceti, N ^c   Odone, F ^c   Caputo, B ^b  

^a GERMAN AEROSPACE CENTER DLR   (Germany)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c UNIVERSITY OF GENOA   (Italy)

Author keywords

Biologically inspired feature extraction; learning systems; robot tactile systems; robot vision systems

Indexed keywords

AFFORDANCES; CAMERA IMAGES; DATA SETS; FUNCTION MAPPING; HUMAN BEING; OBJECT MODEL; RECOGNITION RATES; ROBOT TACTILE SYSTEMS; ROBOT VISION SYSTEMS; VISUAL FEATURE;

COMPUTER VISION; LEARNING SYSTEMS; OBJECT RECOGNITION;

FEATURE EXTRACTION;

EID: 80052914679     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2011.2106782     Document Type: Conference Paper

References (35)

1. J. J. Gibson, The Theory of Affordances. Hillsdale, NJ: Erlbaum, 1977.
2. J. J. Gibson, The Ecological Approach to Visual Perception. Hillsdale, NJ: Erlbaum, 1986.
3. B. Leibe, A. Leonardis, and B. Schiele, "Robust object detection with interleaved categorization and segmentation," Int. J. Comput. Vis., vol. 77, no. 1-3, pp. 259-289, 2008.
4. M. R. Cutkosky, "On grasp choice, grasp models, and the design of hands for manufacturing tasks," IEEE Trans. Robot. Autom., vol. 5, no. 3, pp. 269-279, Jun. 1989.
5. V. Gallese, L. Fadiga, L. Fogassi, and G. Rizzolatti, "Action recognition in the premotor cortex," Brain, vol. 119, pp. 593-609, 1996. (Pubitemid 26149371)
6. G. Rizzolatti and L. Craighero, "The mirror-neuron system," Annu. Rev. Neurosci., vol. 27, pp. 169-192, 2004. (Pubitemid 39050401)
7. M. Umiltá, E. Kohler, V. Gallese, L. Fogassi, L. Fadiga, C. Keysers, and G. Rizzolatti, "I know what you are doing: A neurophysiological study," Neuron, vol. 31, pp. 1-20, 2001.
8. J. M.Kilner, A. Neal,N. Weiskopf, K. J. Friston, and C. D. Frith, "Evidence of mirror neurons in human inferior frontal gyrus," J. Neurosci., vol. 29, pp. 10 153-10 159, 2009.
9. G. Metta, G. Sandini, L. Natale, L. Craighero, and L. Fadiga, "Understanding mirror neurons: A bio-robotic approach," Interact. Stud., vol. 7, pp. 197-232, 2006.
10. M. Lopes and J. Santos-Victor, "Visual learning by imitation with motor representations," IEEE Trans. Syst., Man, Cybern., Part B Cybern., vol. 35, no. 3, pp. 438-449, Jun. 2005. (Pubitemid 40794856)
11. G. Griffin and P. Perona, "Learning and using taxonomies for fast visual categorization," in Proc. 21st IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Anchorage, AK, 2008.
12. K.Woods, D. Cook, L. Hall, K. Bowyer, and L. Stark, "Learning membership functions in a function-based object recognition system," J. Artif. Intell. Res., vol. 3, pp. 187-222, 1995.
13. A. Gupta and L. Davis, "Objects in action: An approach for combining action understanding and object perception," in Proc. 21st IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Anchorage, AK, 2008.
14. H. Kyellstrom, J. Romero, D. Martinez, and D. Kragic, "Simultaneous visual recognition of manipulation actions and manipulated objects," in Proc Eur. Conf. Comput. Vis. (ECCV), Marseille, France, 2008.
15. CyberGlove ReferenceManual. PaloAlto, CA:Virtual Technologies, Inc., Aug. 1998.
16. The Flock of Birds-Installation and Operation Guide. Burlington, VT: Ascension Technology Corporation, Jan. 1999.
17. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Stat. Learn. Comput. Vis., ECCV, Prague, Czech Republic, 2004, pp. 1-22.
18. N. Noceti, B. Caputo, C. Castellini, L. Baldassarre, A. Barla, L. Rosasco, F. Odone, and G. Sandini, "Towards a theoretical framework for learning multi-modal patterns for embodied agents," in Proc. 15th Int. Conf. Image Anal. Process. (ICIAP), Solerno, Italy, 2009.
19. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
20. T. Cover and P. Hart, "Nearest neighbor pattern classification, " IEEE Trans. Inf. Theory, vol. 13, no. 1, pp. 21-27, Jan. 1967.
21. D. Pelleg and A. Moore, "X-means: Extending k-means with efficient estimation of the number of clusters," in Proc. 17th Int. Conf. Mach. Learn., Stanford, CA, 2000, pp. 727-734.
22. M. F. Moller, "A scaled conjugate gradient algorithm for fast supervised learning," Neural Netw., vol. 6, pp. 525-533, 1993.
23. G. Papcun, J. Hochberg, T. R. Thomas, F. Laroche, J. Zacks, and S. Levy, "Inferring articulation and recognizing gestures from acoustics with a neural network trained on X-ray microbeam data," J. Acoust. Soc. Amer., vol. 92, no. 2, 1992.
24. K. Richmond, "Trajectory mixture density networks with multiple mixtures for acoustic-articulatory inversion," in Proc. Int. Conf. Adv. Nonlinear Speech Process., M. Chetouani, A. Hussain, B. Gas, M. Milgram, and J.-L. Zarader, Eds., Dec. 2007, vol. 4885, pp. 263-272, Springer-Verlag Berlin Germany, ser. Lecture Notes in Computer Science. (Pubitemid 351153968)
25. R. Polikar, "Ensemble based systems in decision making.," IEEE Circuits Syst. Mag., vol. 6, no. 3, pp. 21-45, Sep. 2006.
26. C. Sanderson and K. K. Paliwal, "Identity verification using speech and face information," Digital Signal Process., vol. 14, no. 5, pp. 449-480, 2004.
27. B. E. Boser, I. M. Guyon, and V. N. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. ACM Workshop Comput. Learn. Theory (COLT), D. Haussler, Ed., Pittsburgh, PA, 1992, pp. 144-152, ACM press.
28. M. Nilsback and B. Caputo, "Cue integration through discriminative accumulation," in Proc. IEEE Computer Soc. Conf. Comput. Vis. Pattern Recogn., Washington, DC, 2004, vol. 2, pp. 578-585.
29. T. Tommasi, F. Orabona, and B. Caputo, "Discriminative cue integration for medical image annotation," Pattern Recognit. Lett., vol. 29, no. 15, pp. 1996-2002, 2008.
30. F. Orabona, L. Jie, and B. Caputo, "Online-batch strongly convex multi kernel learning," in Proc. 23rd IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), San Francisco, CA, 2010.
31. K. Richmond, S. King, and P. Taylor, "Modelling the uncertainty in recovering articulation from acoustics," Comput. Speech Lang., vol. 17, no. 2, pp. 153-172, 2003.
32. A. A.Wrench and K. Richmond, "Continuous speech recognition using articulatory data," in Proc. Int. Conf. Spoken Lang. Process., Beijing, China, 2000.
33. S. King, J. Frankel, K. Livescu, E. McDermott, K. Richmond, and M. Wester, "Speech production knowledge in automatic speech recognition," J. Acoust. Soc. Amer., vol. 121, no. 2, pp. 723-742, 2007. (Pubitemid 46192674)
34. C. Bard, J. Troccaz, and G. Vercelli, "Shape analysis and hand preshaping for grasping," in Proc. IEEE/RSJ Int. Workshop Intell. Robots Syst., Tokyo, Japan, Nov. 1991, vol. 1, pp. 64-69.
35. S. A. Winges, D. J. Weber, and M. Santello, "The role of vision on hand preshaping during reach to grasp," Exp. Brain Res., vol. 153, pp. 489-498, 2003. (Pubitemid 37266996)