Point cloud-based model-mediated teleoperation with dynamic and perception-based model updating

IEEE Transactions on Instrumentation and Measurement

Volumn 63, Issue 11, 2014, Pages 2558-2569

  Xu, Xiao ^a   Cizmeci, Burak ^a   Al Nuaimi, Anas ^a   Steinbach, Eckehard ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Model mediated teleoperation (MMT); model update; packet rate reduction; point cloud based haptic rendering (pcbHR).

Indexed keywords

CLOUD-BASED; HAPTIC RENDERING; MODEL UPDATING; MODEL-MEDIATED TELEOPERATION (MMT); MODEL-UPDATE; PACKET RATE; PERCEPTION-BASED;

EID: 84908042737     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2014.2323139     Document Type: Article

References (43)

1. W. Ferrell and T. Sheridan, "Supervisory control of remote manipulation," IEEE Spectr., vol. 4, no. 10, pp. 81-88, Oct. 1967.
2. E. Saddik, "The potential of haptics technologies," IEEE Instrum. Meas. Mag., vol. 10, no. 1, pp. 10-17, Feb. 2007.
3. A. Alamri, M. Eid, R. Iglesias, S. Shirmohammadi, and A. El Saddik, "Haptic virtual rehabilitation exercises for poststroke diagnosis," IEEE Trans. Instrum. Meas., vol. 57, no. 9, pp. 1876-1884, Sep. 2008.
4. D. Lawrence, "Stability and transparency in bilateral teleoperation," IEEE Trans. Robot. Autom., vol. 9, no. 5, pp. 624-637, Oct. 1993.
5. G. Niemeyer and J.-J. Slotine, "Stable adaptive teleoperation," IEEE J. Ocean. Eng., vol. 16, no. 1, pp. 152-162, Jan. 1991.
6. R. Anderson and M. Spong, "Bilateral control of teleoperators with time delay," IEEE Trans. Autom. Control, vol. 34, no. 5, pp. 494-501, May 1989.
7. Y. Ye and P. Liu, "Improving haptic feedback fidelity in wave-variablebased teleoperation orientated to telemedical applications," IEEE Trans. Instrum. Meas., vol. 58, no. 8, pp. 2847-2855, Aug. 2009.
8. R. Daniel and P. McAree, "Fundamental limits of performance for force reflecting teleoperation," Int. J. Robot. Res., vol. 17, no. 8, pp. 811-830, 1998.
9. A. Bejczy, W. Kim, and S. Venema, "The phantom robot: Predictive displays for teleoperation with time delay," in Proc. IEEE Int. Conf. Robot. Autom., Cincinnati, OH, USA, May 1990, pp. 546-551.
10. A. Bejczy and W. Kim, "Predictive displays and shared compliance control for time-delayed telemanipulation," in Proc. Int. Conf. IROS, Ibaraki, Japan, Jul. 1990.
11. T. Burkert, J. Leupold, and G. Passig, "A photorealistic predictive display," Presence, Teleoperat. Virtual Environ., vol. 13, no. 1, pp. 22-43, 2004.
12. P. Mitra and G. Niemeyer, "Model-mediated telemanipulation," Int. J. Robot. Res., vol. 27, no. 2, pp. 253-262, 2008.
13. B. Willaert, J. Bohg, H. Brussel, and G. Niemeyer, "Towards multi-DOF model mediated teleoperation: Using vision to augment feedback," in Proc. IEEE Int. Workshop HAVE, Munich, Germany, Oct. 2012, pp. 25-31.
14. B. Hannaford, "A design framework for teleoperators with kinesthetic feedback," IEEE Trans. Robot. Autom., vol. 5, no. 4, pp. 426-434, Aug. 1989.
15. X. Xu, B. Cizmeci, and E. Steinbach, "Point-cloud-based modelmediated teleoperation," in Proc. IEEE Int. Symp. HAVE, Istanbul, Turkey, Oct. 2013, pp. 69-74.
16. H. Li and A. Song, "Virtual-environment modeling and correction for force-reflecting teleoperation with time delay," IEEE Trans. Ind. Electron., vol. 54, no. 2, pp. 1227-1233, Apr. 2007.
17. F. Mobasser and K. Hashtrudi-Zaad, "Predictive teleoperation using laser rangefinder," in Proc. Can. Conf. Elect. Comput. Eng., Ottawa, ON, Canada, May 2006.
18. X. Xu, J. Kammerl, R. Chaudhari, and E. Steinbach, "Hybrid signalbased and geometry-based prediction for haptic data reduction," in Proc. IEEE Int. Workshop HAVE, Hebei, China, Oct. 2011, pp. 68-73.
19. A. Achhammer, C. Weber, A. Peer, and M. Buss, "Improvement of model-mediated teleoperation using a new hybrid environment estimation technique," in Proc. Int. Conf. Robot. Autom., Anchorage, AK, USA, May 2010.
20. C. Tzafestas, S. Velanas, and G. Fakiridis, "Adaptive impedance control in haptic teleoperation to improve transparency under time-delay," in Proc. IEEE Int. Conf. Robot. Autom., Pasadena, CA, USA, May 2008, pp. 212-219.
21. W. Yoon et al., "Model-based space robot teleoperation of ETS-VII manipulator," IEEE Trans. Robot. Autom., vol. 20, no. 3, pp. 602-612, Jun. 2004.
22. C. Zhao, "Real time haptic simulation of deformable bodies," Ph.D. thesis, Inst. Appl. Mech., Faculty Mech. Eng., Technische Univ. München, München, Germany, 2010.
23. A. Haddadi and K. Hashtrudi-Zaad, "Online contact impedance identification for robotic systems," in Proc. IEEE/RSJ Int. Conf. IROS, Nice, France, Sep. 2008, pp. 974-980.
24. D. Verscheure, J. Swevers, H. Bruyninckx, and J. Schutter, "On-line identification of contact dynamics in the presence of geometric uncertainties," in Proc. IEEE Int. Conf. Robot. Autom., Pasadena, CA, USA, May 2008, pp. 851-856.
25. B. Willaert, H. Brussel, and G. Niemeyer, "Stability of model-mediated teleoperation: Discussion and experiments," in Proc. Eurohapt., Tampere, Finland, Jun. 2012.
26. X. Xu, G. Paggetti, and E. Steinbach, "Dynamic model displacement for model-mediated teleoperation," in Proc. IEEE World Hapt. Conf., Daejeon, Korea, Apr. 2013, pp. 313-318.
27. M. M. Oliveira, B. Bowen, R. McKenna, and Y.-S. Chang, "Fast digital image inpainting," in Proc. Int. Conf. VIIP, Marbella, Spain, 2001.
28. P. Hinterseer, S. Hirche, S. Chaudhuri, E. Steinbach, and M. Buss, "Perception-based data reduction and transmission of haptic data in telepresence and teleaction systems," IEEE Trans. Signal Process., vol. 56, no. 2, pp. 588-597, Feb. 2008.
29. P. Hinterseer, E. Steinbach, S. Hirche, and M. Buss, "A novel, psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., Mar. 2005, pp. 1097-1100.
30. E. Steinbach, S. Hirche, J. Kammerl, I. Vittorias, and R. Chaudhari, "Haptic data compression and communication," IEEE Signal Process. Mag., vol. 28, no. 1, pp. 87-96, Jan. 2011.
31. E. Steinbach et al., "Haptic communications," Proc. IEEE, vol. 100, no. 4, pp. 937-956, Apr. 2012.
32. J. Kammerl, R. Chaudhari, and E. Steinbach, "Combining contact models with perceptual data reduction for efficient haptic data communication in networked VEs," IEEE Trans. Instrum. Meas., vol. 60, no. 1, pp. 57-68, Jan. 2011.
33. N. Sakr, N. D. Georganas, and J. Zhao, "Human perception-based data reduction for haptic communication in six-DoF telepresence systems," IEEE Trans. Instrum. Meas., vol. 60, no. 11, pp. 3534-3546, Nov. 2011.
34. L. Jones and I. Ilunter, "A perceptual analysis of stiffness," Experim. Brain Res., vol. 79, no. 1, pp. 150-156, Jan. 1990.
35. F. Freyberger and B. Färber, "Compliance discrimination of deformable objects by squeezing with one and two fingers," in Proc. Eurohapt., Paris, France, 2006.
36. F. Ryden, S. Kosari, and H. Chizeck, "Proxy method for fast haptic rendering from time varying point clouds," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., San Francisco, CA, USA, Sep. 2011, pp. 2614-2619.
37. F. Ryden and H. Chizeck, "A proxy method for real-time 3-DOF haptic rendering of streaming point cloud data," IEEE Trans. Hapt., vol. 6, no. 3, pp. 257-267, Jul./Sep. 2013.
38. N. El-Far, N. Georganas, and A. El Saddik, "An algorithm for haptically rendering objects described by point clouds," in Proc. CCECE, Niagara Falls, ON, Canada, May 2008.
39. A. Leeper, S. Chan, and K. Salisbury, "Point clouds can be represented as implicit surfaces for constraint-based haptic rendering," in Proc. IEEE ICRA, Saint Paul, MN, USA, May 2012, pp. 5000-5005.
40. W. Harwin and N. Melder, "Improved haptic rendering for multi-finger manipulation using friction cone based god-objects," in Proc. Eurohapt., Edinburgh, U.K., Jul. 2002.
41. P. Mitra, D. Gentry, and G. Niemeyer, "User perception and preference in model mediated telemanipulation," in Proc. 2nd Joint IEEE World Hapt. Conf., Tsukaba, Japan, Mar. 2007, pp. 368-273.
42. I. Vittorias, J. Kammerl, S. Hirche, and E. Steinbach, "Perceptual coding of haptic data in time-delayed teleoperation," in Proc. IEEE World Hapt. Conf., Salt Lake City, UT, USA, Mar. 2009, pp. 208-213.
43. J. Kammerl and E. Steinbach, "High-fidelity recording, compression, and replay of visual-haptic telepresence sessions," in Proc. IEEE ICIP, Hong Kong, Sep. 2010, pp. 3217-3220.