Representations and algorithms for force-feedback display

Proceedings of the IEEE

Volumn 101, Issue 9, 2013, Pages 2068-2080

  Otaduy, Miguel A ^a   Garre, Carlos ^b   Lin, Ming C ^c  

^a UNIVERSIDAD REY JUAN CARLOS   (Spain)

^b UNIVERSITY OF CALABRIA   (Italy)

^c University of North Carolina   (United States)

Author keywords

Collision detection; contact modeling; force feedback display; haptic rendering; physically based simulation

Indexed keywords

CONSTRAINED OPTIMIZATION; VIRTUAL REALITY;

COLLISION DETECTION; CONTACT MODELING; FORCE FEEDBACK; HAPTIC RENDERING; PHYSICALLY-BASED SIMULATION;

FEEDBACK;

EID: 84883050988     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2013.2246131     Document Type: Article

References (98)

1. I. Sutherland, ''The ultimate display,'' in Proc. Int. Fed. Inf. Process. Congr., 1965, pp. 506-508.
2. J. K. S. , Jr., D. L. Brock, T.Massie, N. Swarup, and C. B. Zilles, ''Haptic rendering: Programming touch interaction with virtual objects,'' in Proc. Symp. Interactive 3D Graphics, 1995, pp. 123-130.
3. G. Burdea, Force and Touch Feedback for Virtual Reality. New York, NY, USA: Wiley, 1996.
4. M. A. Srinivasan and C. Basdogan, ''Haptics in virtual environments: Taxonomy, research status, and challenges,'' Comput. Graph., vol. 21, no. 4, pp. 393-404, 1997. (Pubitemid 127407896)
5. K. Salisbury, F. Conti, and F. Barbagli, ''Haptic rendering: Introductory concepts,'' IEEE Comput. Graph. Appl., vol. 24, no. 2, pp. 24-32, Mar.-Apr. 2004.
6. M. C. Lin and M. A. Otaduy, Haptic Rendering: Foundations, Algorithms, and Applications. New York, NY, USA: AK Peters, 2008.
7. R. S. Avila and L. M. Sobierajski, ''A haptic interaction method for volume visualization,'' in Proc. Visualization, 1996, pp. 197-204.
8. W. A. McNeely, K. D. Puterbaugh, and J. J. Troy, ''Six degrees-of-freedom haptic rendering using voxel sampling,'' in Proc. SIGGRAPH, Aug. 1999, pp. 401-408.
9. R. M. Taylor, II, W. Robinett, V. L. Chi, F. P. Brooks, Jr., W. V. Wright, R. S. Williams, and E. J. Snyder, ''The nanomanipulator: A virtual reality interface for a scanning tunnelling microscope,'' in Proc. SIGGRAPH, Aug. 1993, pp. 127-134.
10. M. Agus, A. Giachetti, E. Gobbetti, G. Zanetti, and A. Zorcolo, ''Real-time haptic and visual simulation of bone dissection,'' Presence, vol. 12, no. 1, pp. 110-122, 2003. (Pubitemid 36414330)
11. M. Eriksson, M. Dixon, and J. Wikander, ''A haptic VR milling surgery simulatorVUsing high-resolution CT-data,'' in Proc. 14th Med. Meets Virtual Reality (MMVR) Conf., 2006, pp. 138-143.
12. D. Morris, C. Sewell, F. Barbagli, K. Salisbury, N. Blevins, and S. Girod, ''Visuohaptic simulation of bone surgery for training and evaluation,'' IEEE Comput. Graph. Appl., vol. 26, no. 6, pp. 48-57, Nov.-Dec. 2006. (Pubitemid 44824068)
13. W. Baxter, V. Scheib, M. Lin, and D. Manocha, ''Dab: Interactive haptic painting with 3D virtual brushes,'' in Proc. 28th Annu. Conf. Comput. Graph. Interactive Tech., 2001, pp. 461-468. (Pubitemid 33047333)
14. A. Gregory, S. Ehmann, and M. Lin, ''Intouch: Interactive multiresolution modeling and 3D painting with a haptic interface,'' in Proc. IEEE Virtual Reality Conf., 1999, pp. 45-52. (Pubitemid 30585853)
15. D. Johnson, T. Thompson, T. Thompson, M. Kaplan, D. Nelson, and E. Cohen, ''Painting textures with a haptic interface,'' in Proc. IEEE Virtual Reality Conf., 1999, pp. 282-285.
16. H. Chen and H. Sun, ''Real-time haptic sculpting in virtual volume space,'' in Proc. ACM Symp. Virtual Reality Softw. Technol., 2002, pp. 81-88.
17. F. D. H. Qin, A. Kaufman, and J. El-Sana, ''Haptic sculpting of dynamic surfaces,'' in Proc. Symp. Interactive 3D Graph., 1999, pp. 103-110.
18. C. Cadoz, A. Luciani, J. Florens, and N. Castagné, ''ACROE-ICA. Artistic creation and computer interactive multisensory simulation force feedback gesture transducers,'' in Proc. Int. Conf. New Interfaces Musical Expression, 2003, pp. 235-246.
19. S. Snibbe and K. MacLean, ''Haptic techniques for media control,'' in Proc. 14th Annu. ACM Symp. User Interface Softw. Technol., 2001, pp. 199-208. (Pubitemid 34991285)
20. F. Cosco, C. Garre, F. Bruno, M. Muzzupappa, andM. A. Otaduy, ''Visuo-haptic mixed reality with unobstructed tool-hand integration,'' IEEE Trans. Vis. Comput. Graph., vol. 19, no. 1, pp. 159-172, Jan. 2013.
21. L. Raya,M. A. Otaduy, and M. Garc?́a, ''Haptic navigation along filiform neural structures,'' in Proc. IEEE World Haptics Conf., 2011, pp. 71-76.
22. L. Corenthy, J. San Mart?́n, M. A. Otaduy, and M. Garc?́a, ''Volume haptic rendering with dynamically extracted isosurface,'' in Proc. IEEE Haptics Symp., 2012, pp. 133-139.
23. C. Zilles and K. Salisbury, ''A constraint-based god object method for haptics display,'' in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 1995, vol. 3, pp. 146-151.
24. D. Ruspini, K. Kolarov, and O. Khatib, ''The haptic display of complex graphical environments,'' in Proc. ACM SIGGRAPH, 1997, pp. 345-352.
25. C. Ho, C. Basdogan, and M. Srinivasan, ''Efficient point-based rendering techniques for haptic display of virtual objects,'' Presence, vol. 8, no. 5, pp. 477-491, 1999.
26. C. Mendoza, K. Sundaraj, and C. Laugier, ''Faithful force feedback in medical simulators,'' in Proc. Int. Symp. Exp. Robot., 2002, vol. 8, pp. 414-423.
27. K. L. Palmerius, A. Ynnerman, and B. Gudmundsson, ''Proxy-based haptic feedback from volumetric density data,'' in Proc. Eurohaptics Conf., 2002, pp. 104-109.
28. M. Minsky, ''Computational haptics: The sandpaper system for synthesizing texture for a force-feedback display,'' Ph.D. dissertation, Dept. Comput. Sci., Univ. North Carolina Chapel Hill, Chapel Hill, NC, USA, 1995.
29. S. Choi and H. Z. Tan, ''An analysis of perceptual instability during haptic texture rendering,'' in Proc. 10th Int. Symp. Haptic Interfaces Virtual Environ. Teleoperator Syst., 2002, pp. 1261-1268. (Pubitemid 34916422)
30. J. Siira and D. K. Pai, ''Haptic textures: A stochastic approach,'' in Proc. IEEE Int. Conf. Robot. Autom., 1996, pp. 557-562.
31. A. Okamura, J. Dennerlein, and R. Howe, ''Vibration feedback models for virtual environments,'' in Proc. IEEE Int. Conf. Robot. Autom., 1998, pp. 674-679.
32. S. Wall and W. Harwin, ''Modeling of surface identifying characteristics using Fourier series,'' in Proc. ASME Dyn. Syst. Control Div., 1999, vol. 67, pp. 65-71.
33. C. Basdogan, C. Ho, and M. Srinivasan, ''A ray-based haptic rendering technique for displaying shape and texture of 3D objects in virtual environments,'' in Proc. ASME Winter Annu. Meeting, 1997, vol. 61, pp. 77-84.
34. C. Forest, H. Delingette, and N. Ayache, ''Surface contact and reaction force models for laparoscopic simulation,'' in Proc. Int. Symp. Med. Simul., 2004, pp. 168-176.
35. D. D. Nelson and E. Cohen, ''Optimization-based virtual surface contact manipulation at force control rates,'' in Proc. IEEE Virtual Reality Conf., 2000, pp. 37-44. (Pubitemid 30585854)
36. A. Gregory, A. Mascarenhas, S. Ehmann, M. Lin, and D. Manocha, ''Six degree-of-freedom haptic display of polygonal models,'' in Proc. IEEE Visualization, 2000, pp. 139-146.
37. D. Johnson and P. Willemsen, ''Six degree of freedom haptic rendering of complex polygonal models,'' in Proc. Haptics Symp., 2003, pp. 229-235.
38. Y. Kim, M. Otaduy, M. Lin, and D. Manocha, ''Six-degree-of-freedom haptic rendering using incremental and localized computations,'' Presence, vol. 12, no. 3, pp. 277-295, 2003. (Pubitemid 36739309)
39. M. A. Otaduy and M. C. Lin, ''Sensation preserving simplification for haptic rendering,'' in Proc. ACM SIGGRAPH, 2003, pp. 543-553.
40. M. A. Otaduy, N. Jain, A. Sud, and M. C. Lin, ''Haptic display of interaction between textured models,'' Proc. IEEE Visualization, pp. 297-304, 2004. (Pubitemid 40497936)
41. M. Wan and W. A. McNeely, ''Quasi-static approximation for 6 degrees-of-freedom haptic rendering,'' Proc. IEEE Visualization, pp. 257-262, 2003.
42. D. Constantinescu, S. E. Salcudean, and E. A. Croft, ''Haptic rendering of rigid contacts using impulsive and penalty forces,'' IEEE Trans. Robot., vol. 21, no. 3, pp. 309-323, Jun. 2005. (Pubitemid 40858148)
43. M. A. Otaduy and M. C. Lin, ''A modular haptic rendering algorithm for stable and transparent 6-DoF manipulation,'' IEEE Trans. Robot., vol. 22, no. 4, pp. 751-762, Aug. 2006. (Pubitemid 44263862)
44. M. Ortega, S. Redon, and S. Coquillart, ''A six-degree-of-freedom god-object method for haptic display of rigid bodies with surface properties,'' IEEE Trans. Vis. Comput. Graph., vol. 13, no. 3, pp. 458-469, May-Jun. 2007.
45. S. Cotin and H. Delinguette, ''Real-time surgery simulation with haptic feedback using finite elements,'' in Proc. IEEE Int. Conf. Robot. Autom., 1998, vol. 4, pp. 3739-3744.
46. M. Mahvash and V. Hayward, ''Haptic simulation of a tool in contact with a nonlinear deformable body,'' in Proc. Int. Symp. Surgery Simul. Soft Tissue Model., 2003, pp. 311-320.
47. M. Mahvash and V. Hayward, ''High-fidelity haptic synthesis of contact with deformable bodies,'' IEEE Comput. Graph. Appl., vol. 24, no. 2, pp. 48-55, Mar.-Apr. 2004.
48. C. Duriez, C. Andriot, and A. Kheddar, ''Signorini's contact model for deformable objects in haptic simulations,'' in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2004, vol. 4, pp. 3232-3237. (Pubitemid 40276091)
49. C. Duriez, F. Dubois, A. Kheddar, and C. Andriot, ''Realistic haptic rendering of interacting deformable objects in virtual environments,'' IEEE Trans. Vis. Comput. Graph., vol. 12, no. 1, pp. 36-47, Jan.-Feb. 2006. (Pubitemid 43170170)
50. S. Laycock and A. Day, ''Incorporating haptic feedback for the simulation of a deformable tool in a rigid scene,'' Comput. Graph., vol. 29, pp. 341-351, 2005. (Pubitemid 40691049)
51. J. Barbic? and D. L. James, ''Six-DoF haptic rendering of contact between geometrically complex reduced deformable models,'' IEEE Trans. Haptics, vol. 1, no. 1, pp. 39-52, Jan.-Jun. 2008.
52. C. Garre and M. A. Otaduy, ''Haptic rendering of complex deformations through handle-space force linearization,'' in Proc. World Haptics Conf., 2009, pp. 422-427.
53. C. W. Borst and A. P. Indugula, ''Realistic virtual grasping,'' in Proc. IEEE Virtual Reality Conf., 2005, pp. 91-98.
54. X. Han and H. Wan, ''A framework for virtual hand haptic interaction,'' in Transactions on Edutainment IV, vol. 4. Berlin, Germany: Springer-Verlag, 2010, pp. 229-240.
55. R. Ott, F. Vexo, and D. Thalmann, ''Two-handed haptic manipulation for CAD and VR applications,'' Comput. Aided Design Appl., vol. 7, no. 1, pp. 125-138, 2010.
56. M. Ciocarlie, C. Lackner, and P. Allen, ''Soft finger model with adaptive contact geometry for grasping and manipulation tasks,'' in Proc. World Haptics Conf., 2007, pp. 219-224. (Pubitemid 47298007)
57. C. Garre, F. Hernández, A. Gracia, and M. A. Otaduy, ''Interactive simulation of a deformable hand for haptic rendering,'' in Proc. IEEE World Haptics Conf., 2011, pp. 239-244.
58. J. E. Colgate and G. G. Schenkel, ''Passivity of a class of sampled-data systems: Application to haptic interfaces,'' in Proc. Amer. Control Conf., 1994, pp. 3236-3240.
59. J. E. Colgate and J. M. Brown, ''Factors affecting the z-width of a haptic display,'' in Proc. IEEE Int. Conf. Robot. Autom., 1994, pp. 3205-3210.
60. J. E. Colgate, M. C. Stanley, and J. M. Brown, ''Issues in the haptic display of tool use,'' in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 1995, pp. 140-145.
61. R. Adams and B. Hannaford, ''Stable haptic interaction with virtual environments,'' IEEE Trans. Robot. Autom., vol. 15, no. 3, pp. 465-474, Jun. 1999.
62. Y. S. Kim and B. Hannaford, ''Some practical issues in time domain passivity control of haptic interfaces,'' in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2001, vol. 3, pp. 1744-1750. (Pubitemid 34683896)
63. K. J. Kuchenbecker, J. Fiene, and G. Niemeyer, ''Improving contact realism through event-based haptic feedback,'' IEEE Trans. Vis. Comput. Graph., vol. 12, no. 2, pp. 219-230, Mar.-Apr. 2006.
64. M. A. Otaduy and M. C. Lin, ''User-centric viewpoint computation for haptic exploration and manipulation,'' Proc. IEEE Visualization, pp. 311-318, 2001. (Pubitemid 33068242)
65. L. Dominjon, A. Lecuyer, J. Burkhardt, G. Andrade-Barroso, and S. Richir, ''The bubble technique: Interacting with large virtual environments using haptic devices with limitedworkspace,'' in Proc. World Haptics Conf., 2005, vol. 1, pp. 639-640.
66. F. Conti and O. Khatib, ''Spanning large workspaces using small haptic devices,'' in Proc. World Haptics Conf., 2005, vol. 1, pp. 183-188.
67. T. L. Brooks, ''Telerobotic response requirements,'' in Proc. IEEE Int. Conf. Syst. Man Cybern., 1990, pp. 113-120.
68. J. Florens, A. Luciani, C. Cadoz, and N. Castagné, ''ERGOS: Multi-degrees of freedom and versatile force-feedback panoply,'' in Proc. Eurohaptics Conf., 2004, pp. 356-360.
69. M. O. Ernst and M. S. Banks, ''Humans integrate visual and haptic information in a statistically optimal fashion,'' Nature, vol. 415, no. 1, pp. 429-433, 2002. (Pubitemid 34100953)
70. M. A. Otaduy, C. Garre, J. Gascón, E. Miguel, A ́ . G. Pérez, and J. S. Zurdo, ''Modeling and simulation of a human shoulder for interactive medical applications,'' in Proc. Spanish Conf. Comput. Graph., 2010, pp. 229-237.
71. A. A. Shabana, Dynamics of Multibody Systems, 3rd ed. Cambridge, U.K.: Cambridge Univ. Press, 2005.
72. T. J. R. Hugues, The Finite Element Method: Linear Static and Dynamic Finite Element Analysis. New York, NY, USA: Dover, 2000.
73. J. Barbic? and D. James, ''Real-time subspace integration for St. Venant-Kirchhoff deformable models,'' ACM Trans. Graph., vol. 24, no. 3, pp. 982-990, Aug. 2005.
74. M. Nesme, P. G. Kry, L. Jer?ábková, and F. Faure, ''Preserving topology and elasticity for embedded deformable models,'' ACM Trans. Graph., vol. 28, no. 3, pp. 52:1-52:9, Jul. 2009.
75. Y. Adachi, T. Kumano, and K. Ogino, ''Intermediate representation for stiff virtual objects,'' in Proc. Virtual Reality Annu. Int. Symp., 1995, pp. 203-210.
76. I. Peterlik, M. Nouicer, C. Duriez, S. Cotin, and A. Kheddar, ''Constraint-based haptic rendering of multirate compliant mechanisms,'' IEEE Trans. Haptics, vol. 4, no. 3, pp. 175-187, May-Jun. 2011.
77. D. Baraff and A. P. Witkin, ''Large steps in cloth simulation,'' in Proc. 25th Annu. Conf. Comput. Graph. Interactive Tech., 1998, pp. 43-54.
78. A. Nealen, M. Müller, R. Keiser, E. Boxermann, and M. Carlson, ''Physically based deformable models in computer graphics,'' Comput. Graph. Forum, vol. 25, no. 4, pp. 809-836, Dec. 2006. (Pubitemid 44893282)
79. M. Müller and M. Gross, ''Interactive virtual materials,'' in Proc. Graphics Interface, 2004, pp. 239-246.
80. C. Basdogan, ''Real-time simulation of dynamically deformable finite element models using modal analysis and spectral Lanczos decomposition methods,'' in Proc. Med. Meets Virtual Reality Conf., 2001, pp. 46-52. (Pubitemid 33320034)
81. C. Basdogan, C. Ho, and M. Srinivasan, ''Virtual environments for medical training: Graphical and haptic simulation of laparoscopic common bile duct exploration,'' IEEE/ASME Trans. Mechatron., vol. 6, no. 3, pp. 267-285, Sep. 2001.
82. J. Nocedal and S. J. Wright, Numerical Optimization, 2nd ed. New York, NY, USA: Springer-Verlag, 2006.
83. X. Zhang, D. Wang, Y. Zhang, and J. Xiao, ''Configuration-based optimization for six degree-of-freedom haptic rendering using sphere-trees,'' in Proc. IEEE Int. Conf. Intell. Robot. Syst., 2011, pp. 2602-2607.
84. D. Baraff and A. Witkin, ''Physically based modeling,'' in SIGGRAPH Course Notes, 2001.
85. R. Cottle, J. Pang, and R. Stone, The Linear Complementarity Problem. New York, NY, USA: Academic, 1992.
86. G. Saupin, C. Duriez, S. Cotin, and L. Grisoni, ''Efficient contact modeling using compliance warping,'' in Proc. Comput. Graph. Int., 2008.
87. M. A. Otaduy, R. Tamstorf, D. Steinemann, and M. Gross, ''Implicit contact handling for deformable objects,'' Comput. Graph. Forum, vol. 28, no. 2, pp. 559-568, Apr. 2009.
88. S. Fisher and M. C. Lin, ''Fast penetration depth estimation for elastic bodies using deformed distance fields,'' in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2001, vol. 1, pp. 330-336. (Pubitemid 34690183)
89. A. Sud, N. K. Govindaraju, R. Gayle, and D. Manocha, ''Interactive 3D distance field computation using linear factorization,'' in Proc. ACM Symp. Interactive 3D Graph. Games, 2006, pp. 117-124.
90. S. Gottschalk, M. Lin, and D. Manocha, ''OBB-Tree: A hierarchical structure for rapid interference detection,'' in Proc. ACM SIGGRAPH, 1996, pp. 171-180.
91. G. V. den Bergen, ''Efficient collision detection of complex deformable models using AABB trees,'' J. Graph. Tools, vol. 2, no. 4, pp. 1-14, 1997.
92. S. Redon, A. Kheddar, and S. Coquillart, ''Fast continuous collision detection between rigid bodies,'' in Proc. Eurographics, 2002, pp. 279-287.
93. M. Tang, S. Curtis, S.-E. Yoon, and D. Manocha, ''ICCD: Interactive continuous collision detection between deformable models using connectivity-based culling,'' IEEE Trans. Vis. Comput. Graph., vol. 15, no. 4, pp. 544-557, Jul.-Aug. 2009.
94. C. Syllebranque and C. Duriez, ''Six degree-of freedom haptic rendering for dental implantology simulation,'' in Proc. Int. Symp. Comput. Models Biomed. Simul., 2010, pp. 139-149.
95. G. Cirio, M. Marchal, S. Hillaire, and A. Lécuyer, ''Six degrees-of-freedom haptic interaction with fluids,'' IEEE Trans. Vis. Comput. Graph., vol. 17, no. 11, pp. 1714-1727, Nov. 2011.
96. R. Höver, M. Di Luca, G. Székely, and M. Harders, ''Computationally efficient echniques for data-driven haptic rendering,'' in Proc. World Haptics Conf., 2009, pp. 39-44.
97. N. Raghuvanshi and M. C. Lin, ''Interactive sound synthesis for large scale environments,'' in Proc. Interactive 3D Graph. Symp., 2006, pp. 101-108.
98. Z. Ren, H. Yeh, and M. C. Lin, ''Synthesizing contact sounds between textured models,'' in Proc. IEEE Virtual Reality Conf., 2010, pp. 139-146.