A Kinect-based natural interface for quadrotor control

Entertainment Computing

Volumn 4, Issue 3, 2013, Pages 179-186

  Sanna, Andrea ^a   Lamberti, Fabrizio ^a   Paravati, Gianluca ^a   Manuri, Federico ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Interactive systems; Kinect; Natural user interface; Quadrotor control; Visual odometry

Indexed keywords

EID: 84885833941     PISSN: 18759521     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.entcom.2013.01.001     Document Type: Article

References (43)

1. M. Achtelik, A. Bachrach, R. He, S. Prentice, N. Roy, Autonomous navigation and exploration of a quadrotor helicopter in GPS-denied indoor environments, in: Int. Aerial Robotics Competition, 1st Symposium on Indoor Flight Isssues, 2009.
2. Ar.Drone web site, http://ardrone.parrot.com.
3. Artoolkit documentation, http://www.hitl.washington.edu/artoolkit.
4. S.J. Hong, N.A. Setiawan, C.W. Lee, Real-time vision based gesture recognition for human-robot interaction, in: Proc. of the 11th International Conference KES 2007 and XVII Italian Workshop on Neural Networks Conference on Knowledge-based Intelligent Information and Engineering Systems: Part I, 2007, pp. 493-500.
5. Bolt R.A. Put-that-there: voice and gesture at the graphics interface. Proc. Siggraph 1980, 262-270. ACM, NY.
6. Caballero F., Merino L., Ferruz J., Ollero A. Vision-based Odometry and SLAM for medium and high altitude flying UAVs. Journal of Intelligent and Robotic Systems 2009, 54:137-161.
7. Celozzi C., Paravati G., Sanna A., Lamberti F. A 6-DOF ARTag-based tracking system. IEEE Transactions on Consumer Electronics 2010, 56(1):203-210.
8. N. Chao, M.Q. Meng, P. Xiaoping Liu, X. Wmg, Visual gesutre recognition for human-machine interface of robot teleoperation, in: the IEEE/RSJ Intl. Conference on Intelligent Robots and Systems, 2003, pp. 1560-1565.
9. De Amici S., Sanna A., Lamberti F., Pralio B. A Wii Remote-based infrared-optical tracking system. Entertainment Computing 2010, 1:119-124.
10. Interaction with a Quadrotor via the Kinect, ETH Zurich, http://www.youtube.com/watch?v=A52FqfOi0Ek.
11. FAAST web site, http://projects.ict.usc.edu/mxr/faast/.
12. Kofman J., Xianghai Wu., Luu T.J., Verma S. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE Transactions on Industrial Electronics 2005, 52:1206-1219.
13. Lowe D.G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 2004, 60:91-110.
14. Lu C.-P., Hager G.D., Mjolsness E. Fast and globally convergent pose estimation from video images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000, 22(6).
15. Microsoft Kinect web site, http://www.xbox.com/en-US/kinect/.
16. OpenKinect web site, http://openkinect.org/wiki/Main_Page.
17. OpenNI web site, http://www.openni.org/.
18. Paravati G., Celozzi C., Sanna A., Lamberti F. A feedback-based control technique for interactive live streaming systems to mobile devices. IEEE Transactions on Consumer Electronics 2010, 56(1):190-197.
19. Sanna A., Pralio B., Lamberti F., Paravati G. A novel ego-motion compensation strategy for automatic target tracking in FLIR video sequences taken from UAVs. IEEE Transactions on Aerospace and Electronic Systems 2009, 45(2):723-734.
20. Lamberti F., Sanna A., Paravati G. Improving robustness of infrared target tracking algorithms based on template matching. IEEE Transactions on Aerospace and Electronic Systems 2011, 47(2):1467-1480.
21. Paravati G., Sanna A., Pralio B., Lamberti F. A genetic algorithm for target tracking in FLIR video sequences using intensity variation function. IEEE Transactions on Instrumentation and Measurement 2009, 58(10):3457-3467.
22. G. Paravati, A. Sanna, F. Lamberti, C. Celozzi, A reconfigurable multi-touch framework for teleoperation tasks, in: 16th IEEE International Conference on Emerging Technologies and Factory Automation, 2011, pp. 1-4.
23. G. Paravati, B. Pralio, A. Sanna, F. Lamberti, A reconfigurable multi-touch remote control system for teleoperated robots, in: 29th IEEE International Conference on Consumer Electronics, 2011, pp. 153-154.
24. V.I. Pavlovic, R. Sharma, T.S. Huang, Gestural interface to a visual computing environment for molecular biologists, in: Proc. of the 2nd Int. Conference on Automatic Face and Gesture Recognition, 1996, 52-73.
25. Pavlovic V.I., Sharma R., Huang T.S. Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Transactions on Pattern Analysis and machine Intelligence 1997, 19:677-695.
26. V.S. Rao, C. Mahanta, Gesture based robot control, in: Proc. of the 4th International Conference on Intelligent Sensing and Information Processing, 2006, pp. 145-148.
27. Se S., Jasiobedzki P. Stereo-vision based 3D modeling and localization for unmanned vehicles. International Journal 2008, 13:46-57.
28. Selker T. Touching the future. Communications of the ACM 2008, 51:14-16.
29. S.P. Soundararaj, A.K. Sujeeth, A. Saxena, Autonomous indoor helicopter flight using a single onboard camera, in: Proc. of the IEEE/RSJ Int. Conference on Intelligent Robots and Systems, 2009, pp. 5307-5314.
30. C.J.P. Soshi Iba, J. Michael Vande Weghe, P.K. Khosla, An architecture for gesture-based control of mobile robots, in: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 1999, pp. 851-857.
31. J. Sugiyama, D. Tsetserukou, J. Miura, NAVIgoid: robot navigation with haptic vision, in: Proc. Int. Conf. on Computer Graphics and Interactive Technologies (ACM SIGGRAPH Asia 2011), Emerging Technologies, Article No. 9, Hong Kong, China, December 12-15, 2011.
32. Sturman D.J., Zetler D. A survey of glove based input. IEEE Computer Graphics and Applications 1994, 14:30-39.
33. Controlling the AR Drone with Microsoft Surface, http://blogs.msdn.com/b/surface/archive/2011/01/27/controlling-the-ar-drone-with-surface.aspx.
34. D. Tsetserukou, J. Sugiyama, J. Miura, Belt tactile interface for communication with mobile robot allowing intelligent obstacle detection, in: Proc. IEEE World Haptics Conference (WHC 2011), Istanbul, Turkey, June 21-24, 2011, pp. 113-118.
35. J.P. Wachs, H. Stern, Y. Eden, Parameter search for an image processing-Fuzzy c-Means hand gesture recognition system, in: Proc. of the IEEE Int. Conference on Image Processing, 2003, pp. 341-344.
36. Wachs J.P., Stern H., Edan Y. Cluster labeling and parameter estimation for the automated setup of a hand gesture recognition system. IEEE Transactions Systems and Humans 2005, 35:932-944.
37. Y. Wang, A. Camargo, R. Fevig, F. Martel, R.R. Schultz, Image mosaicking from uncooled thermal IR video captured by a small UAV, in: Proc. of the IEEE Southwest Symposium on Image Analysis and Interpretation, 2008, pp. 161-164.
38. Controlling the AR Drone with Nintendo Wiimote, http://www.youtube.com/watch?v=zJ50H-_431w&feature=player_embedded.
39. Wright A. Making sense of sensors. Communications of the ACM 2009, 52:14-15.
40. The Virtual-Reality Peripheral Network, http://www.cs.unc.edu/Research/vrpn/.
41. Controlling the AR Drone with Microsoft Kinect, http://www.youtube.com/watch?v=jDJpb4xXAJM.
42. Hand tracking to control the AR Drone with Microsoft Kinect, http://dronehacks.com/2010/12/21/controlling-the-ar-drone-with-a-kinect-controller/.
43. Hand tracking to control the AR Drone with Microsoft Kinect, http://www.youtube.com/watch?v=mREorv0hbY8.