An adaptable robot vision system performing manipulation actions with flexible objects

IEEE Transactions on Automation Science and Engineering

Volumn 11, Issue 3, 2014, Pages 749-765

  Bodenhagen, Leon ^a   Fugl, Andreas R ^a   Jordt, Andreas ^b   Willatzen, Morten ^d,e   Andersen, Knud A ^c   Olsen, Martin M ^c   Koch, Reinhard ^b   Petersen, Henrik G ^a   Krüger, Norbert ^a  

^a UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^b UNIVERSITY OF KIEL   (Germany)

^c DANISH TECHNOLOGICAL INSTITUTE   (Denmark)

^d UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^e TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

3D modeling; Action learning; deformation modeling; flexible objects; shape tracking

Indexed keywords

COMPUTER VISION; DEFORMATION; SILICONES;

3D-MODELING; ACTION LEARNING; DEFORMATION MODELING; FLEXIBLE OBJECT; SHAPE TRACKING;

MODELS;

EID: 84904401465     PISSN: 15455955     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASE.2014.2320157     Document Type: Article

References (49)

1. Scape Technologies - Standardized Bin-Picking Systems. [Online]. Available: http://www.scapetechnologies.com
2. D. Kraft, L.-P. Ellekilde, and J. A. Jørgensen, "Automatic grasp generation and improvement for industrial bin-picking," in Gearing up and Accelerating Cross-Fertilization Between Academic and Industrial Robotics Research In Europe, ser. Springer Tracts in Advanced Robotics, F. Röhrbein, G. Veiga, and C. Natale, Eds. New York, NY, USA: Springer, 2014, vol. 94, pp. 155-176.
3. L. D. Landau, L. P. Pitaevskii, E. M. Lifshitz, and A. M. Kosevich, Theory of Elasticity. London, U.K.: Butterworth, 1986.
4. D. L. Russell and L. White, "An elementary nonlinear beam theory with finite buckling deformation properties," in SIAM J. Appl. Math., 2002, pp. 1394-1413.
5. R. Detry, D. Kraft, O. Kroemer, L. Bodenhagen, J. Peters, N. Krüger, and J. Piater, "Learning grasp affordance densities," Paladyn J. Behavioral Robot., vol. 2, pp. 1-17, 2011.
6. B. W. Silverman, Density Estimation for Statistics and Data Analysis. London, U.K.: Chapman & Hall, 1986.
7. M. Bell, "Flexible objectmanipulation," Ph.D. dissertation, Dartmouth College, Hanover, NH, USA, 2010.
8. A. Howard and G. Bekey, "Recursive learning for deformable object manipulation," in Proc. 8th Int. Conf. Adv. Robot., Monterey, CA, USA, 1997, pp. 939-944.
9. G. Foresti and F. Pellegrino, "Automatic visual recognition of deformable objects for grasping and manipulation," IEEE Trans. Syst., Man, Cybern., Part C: Appl. Rev., vol. 34, no. 3, pp. 325-333, Aug. 2004.
10. J. Acker and D. Henrich, "Manipulation of deformable linear objects: From geometric model towards program generation," in Proc. Int. Conf. Robot. Autom. (ICRA), Barcelona, Spain, 2005, pp. 1541-1547. (Pubitemid 46084009)
11. C. Elbrechter, R. Haschke, and H. Ritter, "Folding paper with anthropomorphic robot hands using real-time physics-based modeling," in Proc. Int. Conf. Humanoids, Osaka, Japan, 2012, pp. 210-215.
12. A. Jordt and R. Koch, "Fast tracking of deformable objects in depth and color video," in Proc. British Machine Vision Conf., BMVC'11, S. McKenna, J. Hoey, and M. Trucco, Eds., Sep. 2011, pp. 114.1-114.11.
13. A. Jordt and R. Koch, "Direct model-based tracking of 3D object deformations in depth and color video," Int. J. Comput. Vis., vol. 102, pp. 239-255, 2013, 10.1007/s11263-012-0572-1.
14. A. Jordt, I. Schiller, J. Bruenger, and R. Koch, "High-resolution object deformation reconstruction with active range camera," in Pattern Recognition. Berlin, Germany: Springer-Verlag, 2010.
15. A. R. Fugl, H. G. Petersen, and M. Willatzen, "Simulation of flexible objects in robotics," in Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR), Tsukuba, Japan, Nov. 2012, vol. 7628, Lecture Notes in Computer Science, pp. 89-100.
16. A. R. Fugl, A. Jordt, H. G. Petersen, M. Willatzen, and R. Koch, "Estimation of material properties and pose for deformable objects from depth and color images," in Proc. Joint Pattern Recognit. Symp. (DAGM-OAGM), Graz, Austria, Aug. 2012, pp. 165-174.
17. L. Bodenhagen, A. R. Fugl, M. Willatzen, H. G. Petersen, and N. Krüger, "Learning peg-in-hole actions with flexible objects," in Proc. 4th Int. Conf. Agents Artif. Intell.-Special Session for Intell. Robot., Vilamoura, Portugal, Feb. 2012, pp. 624-631.
18. D. Nehab, "Advances in 3D shape acquisition," Ph.D. dissertation, Princeton Univ., Princeton, NJ, USA, Sep. 2007.
19. A. Griesser, T. P. Koninckx, and L. V. Gool, "Adaptive real-time 3D acquisition and contour tracking within a multiple structured light system," in Proc. 12th Pacific Conf. Comput. Graph. Appl., ser. PG'04, Seoul, Korea, Oct. 2004, pp. 361-370. (Pubitemid 40540332)
20. B. Rosenhahn, U. Kersting, K. Powell, R. Klette, G. Klette, and H.-P. Seidel, "A system for articulated tracking incorporating a clothing model," Mach. Vis. Appl., vol. 18, no. 1, pp. 25-40, 2007. (Pubitemid 46197028)
21. C. Cagniart, E. Boyer, and S. Ilic, "Probabilistic deformable surface tracking from multiple videos," in Proc. ECCV, 2010, vol. 6314, Lecture Notes in Computer Science, pp. 326-339.
22. S. Shen, Y. Zheng, and Y. Liu, "Deformable surface stereo tracking by-detection using second order cone programming," in Proc. IEEE ICPR, 2008, pp. 1-4.
23. M. Salzmann, V. Lepetit, and P. Fua, "Deformable surface tracking ambiguities," in Proc. IEEE Comput. Soc. CVPR, Sep. 2007, pp. 1-8.
24. J. D. Schulman, A. Lee, J. Ho, and P. Abbeel, "Tracking deformable objects with point clouds," in Proc. Int. Conf. Robot. Autom. (ICRA), 2013, pp. 1130-1137.
25. C. Elbrechter, R. Haschke, and H. Ritter, "Bi-manual robotic paper manipulation based on real-timemarker tracking and physicalmodelling," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2011, pp. 1427-1432.
26. L. Piegl, "On nurbs: A survey," IEEE Comput. Graph. Appl., vol. 11, no. 1, pp. 55-71, Jan. 1991.
27. R. Erkamp, P. Wiggins, A. Skovoroda, S. Emelianov, and M. ODonnell, "Measuring the elastic modulus of small tissue samples," Ultrasonic Imag., vol. 20, pp. 17-28, 1998. (Pubitemid 28326008)
28. I. Meththananda, S. Parker, M. Patel, and M. Braden, "The relationship between shore hardness of elastomeric dental materials and Youngs modulus," Dental Mater., vol. 25, no. 8, pp. 956-959, 2009.
29. E. J. Chen, J. Novakofski, W. K. Jenkins, and W. D. O. Jr, "Youngs modulus measurements of soft tissues with application to elasticity imaging," IEEE Trans. Ultrason., Ferroelectr. Freq. Control, vol. 43, no. 1, Jan. 1996.
30. A. Howard and G. Bekey, "Intelligent learning for deformable object manipulation," in Proc. Comput. Intell. Robot. Autom., 1999, pp. 15-20.
31. B. Frank, R. Schmedding, C. Stachniss, M. Teschner, and W. Burgard, "Learning the elasticity parameters of deformable objects with a manipulation robot," in Proc. Int. Conf. Intell. Robot. Syst. (IROS), Taipei, Taiwan, Oct. 2010, pp. 1877-1883.
32. M. Willatzen and L. Wang, "Mathematical modelling of one-dimensional piezoelectric transducers based on monoclinic crystals," Acta Acustica United With Acustica, vol. 93, no. 6, pp. 716-721, 2007. (Pubitemid 350072481)
33. J. Mosegaard, "Cardiac surgery simulation-Graphics hardware meets congenital heart disease," Ph.D. dissertation, Dept. Comput. Sci., Univ. Aarhus, Aarhus, Denmark, 2006.
34. D. Reznik and C. Laugier, "Dynamic simulation and virtual control of a deformable fingertip," in Proc. IEEE Int. Conf. Robot. Autom., 1996, vol. 2, pp. 1669-1674, IEEE.
35. O. Kroemer, R. Detry, J. Piater, and J. Peters, "Combining active learning and reactive control for robot grasping," Robot. Auton. Syst., vol. 58, no. 9, pp. 1105-1116, Sep. 2010.
36. A. J. Ijspeert, J. Nakanishi, and S. Schaal, "Movement imitation with nonlinear dynamical systems in humanoid robots," in Proc. IEEE Int. Conf. Robot. Autom., 2002, pp. 1398-1403. (Pubitemid 34916443)
37. A. Ude, A. Gams, T. Asfour, and J. Morimoto, "Task-specific generalization of discrete and periodic dynamic movement primitives," IEEE Trans. Robot., vol. 26, no. 5, pp. 800-815, Oct. 2010.
38. P. Jiménez, "Survey on model-based manipulation planning of deformable objects," Robot. Comput.-Integr. Manuf., vol. 28, no. 2, pp. 154-163, Apr. 2012.
39. I. Schiller, C. Beder, and R. Koch, "Calibration of a PMD camera using a planar calibration object together with a multi-camera setup," in International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2008, vol. XXXVII, Part B3a.
40. N. Hansen, "The CMA evolution strategy: A comparing review," in Towards a new Evolutionary Computation. Advances on Estimation of Distribution Algorithms. New York, NY, USA: Springer, 2006.
41. S. M. Han, H. Benaroya, and T. Wei, "Dynamics of transversely vibrating beams using four engineering theories," J. Sound Vibration, vol. 225, pp. 935-988, 1999. (Pubitemid 129536982)
42. A. R. Fugl, "Modeling and simulation of grasping of deformable objects," Ph.D. dissertation, Univ. Southern Denmark, Odense, Denmark, 2012.
43. L.-P. Ellekilde and J. A. Jorgensen, "RobWork: A flexible toolbox for robotics research and education," in Proc. Robotics (ISR), 41st Int. Symp. and 6th German Conf. Robot. (ROBOTIK) 2010, Jun. 2010, pp. 1-7.
44. A. Wächter and L. T. Biegler, "On the implementation of an interior point filter line-search algorithm for large-scale nonlinear programming," Math. Program., vol. 106, no. 1, pp. 25-57, 2006. (Pubitemid 41813168)
45. P. R. Amestoy, I. S. Duff, J. Koster, and J.-Y. L'Excellent, "A fully asynchronous multifrontal solver using distributed dynamic scheduling," SIAM J. Matrix Anal. Appl., vol. 23, no. 1, pp. 15-41, 2001.
46. P. R. Amestoy, A. Guermouche, J.-Y. L'Excellent, and S. Pralet, "Hybrid scheduling for the parallel solution of linear systems," Parallel Comput., vol. 32, no. 2, pp. 136-156, 2006. (Pubitemid 43120206)
47. L. Piegl and W. Tiller, The NURBS Book, 2nd ed. New York, NY, USA: Springer, 1997.
48. M. A. Carreira-Perpinan, "Mode-finding for mixtures of Gaussian distributions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 11, pp. 1318-1323, Nov. 2000.
49. SMAC moving coil actuators. [Online]. Available: http://www.smac-mca.com