Detecting object affordances with convolutional neural networks

IEEE International Conference on Intelligent Robots and Systems

Volumn 2016-November, Issue , 2016, Pages 2765-2770

  Nguyen, Anh ^a   Kanoulas, Dimitrios ^a   Caldwell, Darwin G ^a   Tsagarakis, Nikos G ^a  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ANTHROPOMORPHIC ROBOTS; CONVOLUTION; INPUT OUTPUT PROGRAMS; NEURAL NETWORKS; OBJECT DETECTION; ROBOTS;

CONVOLUTIONAL NEURAL NETWORK; DETECTING OBJECTS; DETECTION METHODS; ENCODER-DECODER ARCHITECTURE; LABEL PREDICTIONS; MULTIPLE MODALITIES; REAL TIME METHODS; STATE-OF-THE-ART METHODS;

INTELLIGENT ROBOTS;

EID: 85006448751     PISSN: 21530858     EISSN: 21530866     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2016.7759429     Document Type: Conference Paper

References (33)

1. J. J. Gibson, The Ecological Approach to Visual Perception. Boston: Houghton Mifflin, 1979.
2. E. Oztop, M. Kawato, and M. Arbib, "Mirror Neurons and Imitation: A Computationally Guided Review", Neural Networks, vol. 19, 2006.
3. L. Montesano, M. Lopes, A. Bernardino, and J. Santos-Victor, "Learning Object Affordances: From Sensory-Motor Coordination to Imitation", IEEE Transactions on Robotics, 2008.
4. I. Lenz, H. Lee, and A. Saxena, "Deep Learning for Detecting Robotic Grasps", International Journal of Robotics Research, 2015.
5. I. Gori, U. Pattacini, V. Tikhanoff, and G. Metta, "Ranking the Good Points: A Comprehensive Method for Humanoid Robots to Grasp Unknown Objects", in ICAR, 2013.
6. A. Myers, C. L. Teo, C. Fermüller, and Y. Aloimonos, "Affordance Detection of Tool Parts from Geometric Features", in IEEE International Conference on Robotics and Automation (ICRA), 2015.
7. J. Bohg and D. Kragic, "Grasping Familiar Objects using Shape Context", in Int. Conf. on Advanced Robotics (ICAR), 2009.
8. A. Ten Pas and R. Platt, "Using Geometry to Detect Grasp Poses in 3D Point Clouds", in Int. Symp. on Robotics Research (ISRR), 2015.
9. L. Montesano and M. Lopes, "Learning Grasping Affordances from Local Visual Descriptors", in IEEE 8th International Conference on Development and Learning, June 2009.
10. A. Aldoma, F. Tombari, and M. Vincze, "Supervised Learning of Hidden and Non-Hidden 0-Order Affordances and Detection in Real Scenes", IEEE Int. Conf. on Robotics and Automation (ICRA), 2012.
11. T. Mar, V. Tikhanoff, G. Metta, and L. Natale, "Self-supervised Learning of Grasp Dependent Tool Affordances on the iCub Humanoid Robot", in IEEE Int. Conf. on Robotics and Automation (ICRA), 2015.
12. Y. Sun, L. Bo, and D. Fox, "Attribute Based Object Identification", in IEEE ICRA, May 2013, pp. 2096-2103.
13. B. Moldovan and L. De Raedt, "Occluded Object Search by Relational Affordances", in IEEE ICRA, May 2014, pp. 169-174.
14. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks", in Advances in Neural Information Processing Systems 25, 2012.
15. L. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs", CoRR, vol. abs/1412.7062, 2014.
16. V. Badrinarayanan, A. Handa, and R. Cipolla, "SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling", arXiv preprint arXiv:1505.07293, 2015.
17. A. Nguyen, D. Kanoulas, D. G. Caldwell, and N. G. Tsagarakis, "Preparatory Object Reorientation for Task-Oriented Grasping", in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2016.
18. C. Farabet, C. Couprie, L. Najman, and Y. LeCun, "Learning Hierarchical Features for Scene Labeling", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 8, 2013.
19. A. Srikantha and J. Gall, "Weakly Supervised Learning of Affordances", CoRR, vol. abs/1605.02964v1, 2016.
20. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng, "Multimodal Deep Learning", in ICML, 2011.
21. S. Gupta, R. Girshick, P. Arbelaez, and J. Malik, "Learning Rich Features from RGB-D Images for Object Detection and Segmentation", in European Conference on Computer Vision (ECCV), 2014.
22. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition", CoRR, vol. abs/1409.1556, 2014.
23. K. He, X. Zhang, S. Ren, and J. Sun, "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification", CoRR, vol. abs/1502.01852, 2015.
24. H. Noh, S. Hong, and B. Han, "Learning Deconvolution Network for Semantic Segmentation", arXiv preprint arXiv:1505.04366, 2015.
25. Y. Jia et al., "Caffe: Convolutional Architecture for Fast Feature Embedding", in 22nd ACM Int. Conf. on Multimedia, 2014.
26. J. Long, E. Shelhamer, and T. Darrell, "Fully Convolutional Networks for Semantic Segmentation", CoRR, vol. abs/1411.4038, 2014.
27. R. Margolin, L. Zelnik-Manor, and A. Tal, "How to Evaluate Foreground Maps", in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014, pp. 248-255.
28. N. G. Tsagarakis et al., "WALK-MAN: A High Performance Humanoid Platform for Realistic Environments", JFR, 2016.
29. M. Catalano, G. Grioli, A. Serio, E. Farnioli, C. Piazza, and A. Bicchi, "Adaptive Synergies for a Humanoid Robot Hand", in International Conference on Humanoid Robots (Humanoids), 2012, pp. 7-14.
30. G. Metta, P. Fitzpatrick, and L. Natale, "YARP: Yet Another Robot Platform", International Journal on Advanced Robotics Systems, 2006.
31. A. Rocchi, E. Hoffman, D. Caldwell, and N. Tsagarakis, "OpenSoT: A Whole-Body Control Library for the Compliant Humanoid Robot COMAN", in IEEE ICRA, 2015, pp. 6248-6253.
32. D. Comaniciu and P. Meer, "Mean Shift: a Robust Approach Toward Feature Space Analysis", IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 24, no. 5, pp. 603-619, May 2002.
33. H. Freeman and R. Shapira, "Determining the Minimum-area Encasing Rectangle for an Arbitrary Closed Curve", Commun. ACM, vol. 18, no. 7, pp. 409-413, July 1975.