Hand-writing motion tracking with vision-inertial sensor fusion: Calibration and error correction

Sensors (Switzerland)

Volumn 14, Issue 9, 2014, Pages 15641-15657

  Zhou, Shengli ^a   Fei, Fei ^b   Zhang, Guanglie ^b   Liu, Yunhui ^c   Li, Wen J ^b  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Human motion tracking; Inertial sensor calibration; MEMS based motion tracking; Sensors fusion; Stochastic error modeling; Vision based motion tracking

Indexed keywords

CALIBRATION; ERROR CORRECTION; STOCHASTIC SYSTEMS; TARGET TRACKING;

CONVENTIONAL SENSORS; ERROR CORRECTION MODELS; HUMAN MOTION TRACKING; INERTIAL SENSOR CALIBRATIONS; MOTION TRACKING; RELATIVE ROTATION; STOCHASTIC ERROR MODELS; VISION SENSOR FUSION;

INERTIAL NAVIGATION SYSTEMS;

ACCELEROMETRY; ALGORITHM; CALIBRATION; DEVICE FAILURE ANALYSIS; DEVICES; EQUIPMENT DESIGN; EVALUATION STUDY; HAND; HANDWRITING; HUMAN; MICROELECTROMECHANICAL SYSTEM; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; STANDARDS; THREE DIMENSIONAL IMAGING; TRANSDUCER;

ACCELEROMETRY; ALGORITHMS; CALIBRATION; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HAND; HANDWRITING; HUMANS; IMAGING, THREE-DIMENSIONAL; INSTRUMENTATION; MICRO-ELECTRICAL-MECHANICAL SYSTEMS; MOVEMENT; PHYSIOLOGY; STANDARDS; TRANSDUCERS;

EID: 84906871899     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s140915641     Document Type: Article

References (33)

1. Shin, D.H.; Jang, W.S. Utilization of Ubiquitous Computing for Construction AR Technology. Autom. Constr. 2009, 18, 1063-1069.
2. Welch, G.; Foxlin, E. Motion Tracking: No Silver Bullet, but a Respectable Arsenal. IEEE Comput. Graph. Appl. 2002, 22, 24-38.
3. Zhou, S.; Shan, Q.; Fei, F.; Li, W.J.; Kwong, C.P.; Wu, P.C.K.; Meng, B.; Chan, C.K.H.; Liou, J.Y.J. Gesture Recognition for Interactive Controllers Using MEMS Motion Sensors. In Proceedings of the 4th IEEE International Conference on Nano/Micro Engineered and Molecular Systems, Shenzhen, China, 5-8 January 2009; pp. 935-940.
4. Aron, M.; Simon, G.; Berger, M.O. Use of Inertial Sensors to Support Video Tracking. Comput. Animat. Virtual Worlds 2007, 18, 57-68.
5. Saeedi, P.; Lawrence, P.D.; Lowe, D.G. Vision-Based 3D Trajectory Tracking for Unknown Environments. IEEE Trans. Robot. 2006, 22, 119-136.
6. Dias, J.; Vinzce, M.; Corke, P.; Lobo, J. Editorial Special Issue: 2nd Workshop on Integration of Vision and Inertial Sensors. Int. J. Robot. Res. 2007, 26, 515-517.
7. Lobo, J.; Dias, J. Relative Pose Calibration between Visual and Inertial Sensors. Int. J. Robot. Res. 2007, 26, 561-575.
8. Bishop, G.; Welch, G. An Introduction to the Kalman Filter. In Proceedings of SIGGRAPH, Course 8, Los Angeles, CA, USA, 12-17 August 2001.
9. Syed, Z.; Aggarwal, P.; Goodall, C.; Niu, X.; El-Sheimy, N. A New Multi-Position Calibration Method for MEMS Inertial Navigation Systems. Meas. Sci. Technol. 2007, 18, 1897-1907.
10. Frosio, I.; Pedersini, F.; Borghese, N.A. Autocalibration of MEMS Accelerometers. IEEE Trans. Instrum. Meas. 2009, 58, 2034-2041.
11. Petkov, P.; Slavov, T. Stochastic Modeling of MEMS Inertial Sensors. Cybern. Inf. Technol. 2010, 10, 31-40.
12. Saini, V.; Rana, S.; Kuber, M. Online Estimation of State Space Error Model for MEMS IMU. J. Model. Simul. Syst. 2010, 1, 219-225.
13. Brown, R.G.; Hwang, P.Y. Introduction to Random Signals and Applied Kalman Filtering; John Wiley & Sons: New York, NY, USA, 1992; pp. 80-111.
14. Lee, J.; Hong, S.; Moon, N.; Oh, S.-J. Acoustic Sensor-Based Multiple Object Tracking with Visual Information Association. EURASIP J. Adv. Signal. Process. 2010, 2010, 591340.
15. El-Sheimy, N.; Hou, H.; Niu, X. Analysis and Modeling of Inertial Sensors Using Allan Variance. IEEE Trans. Instrum. Meas. 2008, 57, 140-149.
16. Friedland, B. Analysis Strapdown Navigation Using Quaternions. IEEE Trans. Aerosp. Electron. Syst. 1978, 764-768.
17. Chroust, S.; Vincze, M. Fusion of Vision and Inertial Data for Motion and Structure Estimation. J. Robot. Syst. 2004, 21, 73-83.
18. Armesto, L.; Tornero, J.; Vincze, M. Fast Ego-Motion Estimation with Multi-Rate Fusion of Inertial and Vision. Int. J. Robot. Res. 2007, 26, 577-589.
19. Armesto, L.; Tornero, J.; Vincze, M. On Multi-Rate Fusion for Non-Linear Sampled-Data Systems: Application to a 6D Tracking System. Robot. Auton. Syst. 2008, 56, 706-715.
20. Hol, J.D.; Schön, T.B.; Luinge, H.; Slycke, P.J.; Gustafsson, F. Robust Real-Time Tracking by Fusing Measurements from Inertial and Vision Sensors. J. Real-Time Image Process. 2007, 2, 149-160.
21. Yi, Y. On Improving the Accuracy and Reliability of GPS/INS-Based Direct Sensor Georeferencing; Ohio State University: Columbus, OH, USA, 2007.
22. Lu, C.-P.; Hager, G.D.; Mjolsness, E. Fast and Globally Convergent Pose Estimation from Video Images. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 610-622.
23. Titterton, D.; Weston, J. Strapdown Inertial Navigation Technology, 2nd ed.; Zarchan, P., Ed.; American Institute of Aeronautics & Astronautics: Reston, VA, USA, 2004.
24. Seong, S.M.; Lee, J.G.; Park, C.G. Equivalent Arma Model Representation for RLG Random Errors. IEEE Trans. Aerosp. Electron. Syst. 2000, 36, 286-290.
25. IEEE Standard Specification Format Guide and Test Procedure for Linear, Single-Axis, Non-Gyroscopic Accelerometers. In IEEE Std 1293-1998; The Institute of Electrical and Electronics Engineers, Inc.: New York, NY, USA, 1999; pp. 166-176.
26. Quinchia, A.G.; Ferrer, C.; Falco, G.; Falletti, E.; Dovis, F. Analysis and Modelling of MEMS Inertial Measurement Unit. In Proceedings of International Conference on Localization and GNSS, Starnberg, Germany, 25-27 June 2012; pp. 1-7.
27. IEEE Standard Specification Format Guide and Test Procedure for Single-Axis Laser Gyros. In IEEE Std 647-1995; The Institute of Electrical and Electronics Engineers, Inc.: New York, NY, USA, 1996; pp. 68-79.
28. Niu, X.; Chen, Q.; Zhang, Q.; Zhang, H.; Niu, J.; Chen, K.; Shi, C.; Liu, J. Using Allan Variance to Analyze the Error Characteristics of GNSS Positioning. GPS Solut. 2013, 1-12.
29. Tehrani, M. Ring Laser Gyro Data Analysis with Cluster Sampling Technique. In Proceedings of 1983 Technical Symposium East, Washington, DC, USA, 4-8 April 1983; pp. 207-220.
30. Bouguet, J.-Y. Camera Calibration Toolbox for Matlab. Available online: http://www.vision.caltech.edu/bouguetj/calib_doc/ (accessed on 12 November 2011).
31. Horn, B.K. Closed-Form Solution of Absolute Orientation Using Unit Quaternions. J. Opt. Soc. Am. 1987, 4, 629-642.
32. Woodman, O.J. An Introduction to Inertial Navigation; University of Cambridge: Cambridge, UK, 2007.
33. Zhou, S.; Fei, F.; Zhang, G.; Mai, J.D.; Liu, Y.; Liou, J.Y.J.; Li, W.J. 2D Human Gesture Tracking and Recognition by the Fusion of MEMS Inertial and Vision Sensors. IEEE Sens. J. 2014, 14, 1160-1170.