Multisensor fusion and integration: A review on approaches and its applications in mechatronics

IEEE Transactions on Industrial Informatics

Volumn 8, Issue 1, 2012, Pages 49-60

  Luo, Ren C ^a   Chang, Chih Chia ^a,b  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

Author keywords

Intelligent robotics; mechatronics; multisensor fusion and integration (MFI)

Indexed keywords

BIOMEDICAL APPLICATIONS; CLASSIFICATION METHODS; ESTIMATION METHODS; FUTURE PERSPECTIVES; INDUSTRIAL AUTOMATION; INFERENCE METHODS; INTELLIGENT ROBOTICS; MULTI-SENSOR FUSION; MULTIPLE SENSORS; OPTIMAL DECISIONS; REDUNDANT INFORMATIONS; ROBOTIC APPLICATIONS; SENSOR FUSION;

ALGORITHMS; INFERENCE ENGINES; INTEGRATION; INTELLIGENT MECHATRONICS; INTELLIGENT ROBOTS; MECHATRONICS; MEDICAL APPLICATIONS; ROBOTICS; SENSORS;

MILITARY APPLICATIONS;

EID: 84863011601     PISSN: 15513203     EISSN: None     Source Type: Journal    
DOI: 10.1109/TII.2011.2173942     Document Type: Article

References (85)

1. R. C. Luo and M. G. Kay, "A tutorial on multisensor integration and fusion," in Proc. 16th Annu. Conf. IEEE Ind. Electron. Soc., 1990, vol. 1, pp. 707-722.
2. D. L. Hall, Mathematical Techniques in Multisensor Data Fusion. Boston, MA: Artech House, 1992.
3. D. L. Hall and J. Llinas, "An introduction to multisensor data fusion," Proc. IEEE, vol. 85, no. 1, pp. 6-23, Jan. 1997. (Pubitemid 127745544)
4. US Dept. of Defense, Data Fusion Subpanel of the Joint Directors of Laboratories, "Technical panel for C3," Data Fusion Lexicon 1991.
5. W. Elmenreich, "A review on system architectures for sensor fusion applications," in Proc. Int. Federat. Inf. Process., 2007, pp. 547-559.
6. D. Smith and S. Singh, "Approaches to multisensor data fusion in target tracking: A survey," IEEE Trans. Knowl. Data Eng., vol. 18, no. 12, pp. 1696-1710, Dec. 2006. (Pubitemid 44711727)
7. S. Yi, H. Min, Y. Cho, and J. Hong, "Adaptive multilevel code update protocol for real-time sensor operating systems," IEEE Trans. Ind. Informat., vol. 4, no. 4, pp. 250-260, Nov. 2008.
8. J. Heo, J. Hong, and Y. Cho, "EARQ: Energy aware routing for real-time and reliable communication in wireless industrial sensor network," IEEE Trans. Ind. Informat., vol. 5, no. 1, pp. 3-11, Feb. 2009.
9. S. Shin, T. Kwon, G. Y. Jo, Y. Park, and H. Rhy, "An experimental study of hierarchical intrusion detection for wireless industrial sensor networks," IEEE Trans. Ind. Informat., vol. 6, no. 4, pp. 744-757, Nov. 2010.
10. D. Auslander and C. J. Kempf, Mechatronics, Mechanical System Interfacing. Englewood Cliffs, NJ: Prentice-Hall, 1996.
11. R. C. Luo, Y. T. Chou, C. T. Liao, C. C. Lai, and A. C. Tsai, "NCCU security warrior: An intelligent security robot system," in Proc. 33rd Annu. Conf. IEEE Ind. Electron. Soc., Nov. 2007, pp. 2960-2965.
12. M. K. Habib, "Mechatronics engineering the evolution, the needs and the challenges," in Proc. IEEE Annu. Conf. Ind. Electron., 2006, pp. 4510-4515.
13. T. R. Hsu, "Mechatronics-an overview," IEEE Trans. Compon., Packag. Manuf. Technol. C, vol. 20, no. 1, pp. 4-7, Jan. 1997.
14. R. Isermann, "Mechatronic systems-Innovative products with embedded control," Control Eng. Practice, vol. 16, no. 1, pp. 14-29, Jan. 2008. (Pubitemid 350029020)
15. Y. Yang, C. Han, X. Kang, and D. Han, "An overview on pixel-level image fusion in remote sensing," in Proc. IEEE Int. Conf. Autom. Logist., Aug. 2007, pp. 2339-2344. (Pubitemid 351370796)
16. J. Yue, R. Yang, and R. Huan, "Pixel level fusion for multiple SAR images using PCA and wavelet transform," in Proc. Int. Conf. Radar, Oct. 2006, pp. 1-4.
17. L. Zhang, J. Stiens, and H. Sahli, "Multispectral image fusion for active millimeter wave imaging application," in Proc. Global Symp. Millimeter Waves, Apr. 2008, pp. 131-134.
18. A. Rattani, D. R. Kisku, M. Bicego, and M. Tistarelli, "Feature level fusion of face and fingerprint biometrics," in Proc. IEEE Int. Conf. Biometr.: Theory, Appl., Syst., Sep. 2007, pp. 1-6.
19. G. A. Wilkin and X. Huang, "K-means clustering algorithms: Implementation and comparison," in Proc. Int. Multi-Symp. Comput. Comput. Sci., Aug. 2007, pp. 133-136.
20. K. Venkatalakshmi and S. M. Shalinie, "Classification of multispectral images using support vector machines based on PSO and k-means clustering," in Proc. Int. Conf. Intell. Sens. Inf. Process., Jan. 2005, pp. 127-133. (Pubitemid 44595985)
21. N. Flouda, A. Polychronopoulos, O. Aycard, J. B. Urlet, and M. Ahrholdt, "High level sensor data fusion approaches for object recognition in road environment," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 136-141.
22. B. R. Bracio, W. Horn, and D. P. F. Moller, "Sensor fusion in biomedical systems," in Proc. 19th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., Nov. 1997, vol. 3, pp. 1387-1390.
23. R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME, J. Basic Eng., pp. 35-45, Mar. 1960.
24. F. Widjaja, C. Y. Shee, W. T. Latt, W. L. Au, P. Poignet, and W. T. Ang, "Kalman filtering of accelerometer and electromyography (EMG) data in pathological tremor sensing system," in Proc. IEEE Int. Conf. Robot. Autom., May 19-23, 2008, pp. 3250-3255.
25. R. C. Luo, C. C. Yih, and K. L. Su, "Multisensor fusion and integration: Approaches, applications, and future research directions," IEEE Sens. J., vol. 2, no. 2, pp. 107-119, Apr. 2002. (Pubitemid 44357916)
26. D. Fox, J. Hightower, L. Liao, D. Schulz, and G. Borriello, "Bayesian filtering for location estimation," IEEE Pervasive Comput., vol. 2, no. 3, pp. 24-33, Jul. 2003.
27. S. Matzka and R. Altendorfer, "A comparison of track-to-track fusion algorithms for automotive sensor fusion," in Proc. IEEE Int. Conf. Multisensor Fusion Integrat. Intell. Syst., Aug. 2008, pp. 189-194.
28. B. L. Scala and A. Farina, "Effects of cross-covariance and resolution on track association," in Proc. Int. Conf. Inf. Fusion, Jul. 2000, vol. 2, pp. WeD1/10-Wed1/16.
29. G. W. Ng and R. Yang, "Comparison of decentralized tracking algorithms," in Proc. 6th Int. Conf. Inf. Fusion, 2003, vol. 1, pp. 107-113.
30. G. W. Ng, C. H. Tan, and T. P. Ng, "Tracking ground targets using state vector fusion," in Proc. 7th Int. Conf. Inf. Fusion, 2005, pp. 297-302.
31. Y. Ooi, L. H. T. Chang, Y. P. Wong, and A. R. M. Piah, "A choice of weights for convex combination methods in estimation partial derivatives," in Proc. Int. Conf. Comput. Graph., Imag., Visualization, 2004, pp. 233-236. (Pubitemid 40266879)
32. J. A. Garcia, A. R. F. Vidal, and A. H. Sayed, "Mean-square performance of a convex combination of two adaptive filters," IEEE Trans. Signal Process., vol. 54, no. 3, pp. 1078-1090, Mar. 2006. (Pubitemid 43280582)
33. M. T. M. Silva and V. H. Nascimento, "Convex combination of adaptive filters with different tracking capabilities," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Apr. 2007, vol. 3, pp. III-925-III-928. (Pubitemid 47178150)
34. S. J. Julier and J. K. Uhlmann, "A non-divergent estimation algorithm in the presence of unknown correlations," in Proc. Amer. Control Conf., 1997, vol. 4, pp. 2369-2373.
35. L. Chen, P. O. Arambel, and R. K. Mehra, "Estimation under unknown correlation: Covariance intersection revisited," IEEE Trans. Automat. Control, vol. 47, no. 11, pp. 1879-1882, Nov. 2002. (Pubitemid 35422586)
36. S. B. Lazarus, I. Ashokaraj, A. Tsourdos, R. Zbikowski, P. M. G. Silson, N. Aouf, and B. A. White, "Vehicle localization using sensor data fusion via integration of covariance intersection and interval analysis," IEEE Sens. J., vol. 7, no. 9, pp. 1302-1314, Sep. 2007. (Pubitemid 47171277)
37. R. C. Luo, O. Chen, and L. C. Tu, "Nodes localization through data fusion in sensor network," in Proc. 19th Int. Conf. Adv. Inf. Netw. Appl., 2005, pp. 337-342. (Pubitemid 43803856)
38. R. C. Luo, C. T. Liao, and S. C. Lin, "Multi-sensor fusion for reduced uncertainty in autonomous mobile robot ducking and recharging," in Proc. Int. Conf. Intell. Robots Syst., Oct. 11-15, 2009, pp. 2203-2208.
39. O. Bochardt, R. Calhoun, J. K. Uhlmann, and S. J. Julier, "Generalized information representation and compression using covariance union," in Proc. 9th Int. Conf. Inf. Fusion, Jul. 2006, pp. 1-7.
40. R. C. Luo, Y. C. Chou, and O. Chen, "Multisensor fusion and integration: algorithms, applications, and future research directions," in Proc. IEEE Int. Conf. Mechatron. Autom., Aug. 2007, pp. 1986-1991. (Pubitemid 350244941)
41. D. Nicholson, "An automatic method for eliminating spurious data from sensor networks," in IEE Target Tracking 2004: Algorithms Appl., Mar. 2004, pp. 57-61. (Pubitemid 40954812)
42. B. Waske and J. A. Benediktsson, "Fusion of support vector machines for classification of multisensor data," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 3858-3866, Dec. 2007. (Pubitemid 350157824)
43. K. Tanaka, M. Sano, S. Ohara, and M. Okudaira, "A parametric template method and its application to robust matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2000, vol. 1, pp. 620-627.
44. D. Jiang, C. Tang, and A. Zhang, "Cluster analysis for gene expression data: A survey," IEEE Trans. Knowl. Data Eng., vol. 16, no. 11, pp. 1370-1386, Nov. 2004. (Pubitemid 40242326)
45. H. Lin, "Identification of spinal deformity classification with total curvature analysis and artificial neural network," IEEE Trans. Biomed. Eng., vol. 55, no. 1, pp. 376-382, Jan. 2008. (Pubitemid 350308393)
46. J. Alirezaie, M. E. Jernigan, and C. Nahmias, "Neural network-based segmentation of magnetic resonance images of brain," IEEE Trans. Nucl. Sci., vol. 44, no. 2, pp. 194-198, Apr. 1997. (Pubitemid 127762132)
47. C. Corts and V. Vapnik, "Support vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sep. 1995.
48. C. J. C. Burges, Bell Lab., Lucent Technologies, "A tutorial on support vector machines for pattern recognition," Data Mining Knowl. Discov., vol. 2, pp. 121-167, 1998. (Pubitemid 128695475)
49. S. Avidan, "Support vector tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 1064-1072, Aug. 2004.
50. K. Tanaka, K. Yamano, E. Kondo, and Y. Kimuro, "A vision system for detecting mobile robots in office environments," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2004, pp. 2279-2284.
51. J. Tian, M. Gao, and E. Lu, "Dynamic collision avoidance path planning for mobile robot based on multi-sensor fusion by support vector machine," in Proc. IEEE Int. Conf. Mechatron. Autom., Aug. 2007, pp. 2779-2783.
52. J. Shen and H. Hu, "SVM based SLAM algorithm for autonomous mobile robots," in Proc. IEEE Int. Conf. Mechatronics Autom., Aug. 2007, pp. 337-342. (Pubitemid 350244651)
53. S. Bitzer and P. Smagt, "Learning EMG control of a robotic hand: Towards active prostheses," in Proc. Int. Conf. Robot. Autom., May 2006, pp. 2819-2823. (Pubitemid 44940491)
54. M. Yoshikawa, M. Mikawa, and K. Tanaka, "A myoelectric interface for robotic hand control using support vector machine," in Proc. Int. Conf. Intell. Robots Syst., Oct. 29-Nov. 2 2007, pp. 2723-2728.
55. D. M. Buede and P. Girardi, "A target identification comparison of Bayesian and Dempster-Shafer multisensor fusion," IEEE Trans. Syst., Man, Cybern. A: Syst. Humans, vol. 27, no. 5, pp. 569-577, Sep. 1998. (Pubitemid 127770723)
56. Y. Liu, B. Wang, W. He, J. Zhao, and Z. Ding, "Fundamental principles and applications of particle filters," in Proc. 6th World Congr. Intell. Control Autom., Jun. 2006, pp. 5327-5331. (Pubitemid 46540488)
57. A. Gning, F. Abdallah, and P. Bonnifait, "A new estimation method for multisensor fusion by using interval analysis and particle filtering," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2007, pp. 3844-3849. (Pubitemid 350140780)
58. J. Wolf, W. Burgard, and H. Burkhardt, "Robust vision-based localization by combining an image-retrieval system with Monte Carlo localization," IEEE Trans. Robot., vol. 21, no. 2, pp. 208-216, Apr. 2005. (Pubitemid 40608451)
59. P. Vadakkepat and L. Jing, "Improved particle filter in sensor for tracking randomly moving object," IEEE Trans. Instrum. Meas., vol. 55, no. 5, pp. 1823-1832, Oct. 2006. (Pubitemid 44489700)
60. H. J. Chang, C. S. G. Lee, Y. H. Lu, and Y. C. Hu, "P-SLAM: Simultaneous localization and mapping with environmental-structure prediction," IEEE Trans. Robot., vol. 23, no. 2, pp. 281-293, Apr. 2007. (Pubitemid 46621554)
61. A. P. Dempster, "A generalization of Bayesian inference," J. Royal Statist. Soc. B, vol. 30, no. 2, pp. 205-247, 1968.
62. G. Shafer, A Mathematical Theory of Evidence. Princeton, NJ: Princeton Univ. Press, 1976.
63. T. Denoeux, "A neural network classifier based on Dempster-Shafer theory," IEEE Trans. Syst., Man, Cybern. -Part A: Syst. Humans, vol. 30, no. 2, pp. 131-150, Mar. 2000. (Pubitemid 30593865)
64. Y. Zhan, H. Leung, K. C. Kwak, and H. Yoon, "Automated speaker recognition for home service robots using genetic algorithm and Dempster-Shafer fusion technique," IEEE Trans. Instrum. Meas., vol. 58, no. 9, pp. 3058-3068, Sep. 2009.
65. V. Mitra, C. J. Wang, and S. Banerjee, "Lidar detection of underwater objects using a neuro-SVM-based architecture," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 717-731, May 2006.
66. J. A. Stover, D. L. Hall, and R. E. Gibson, "A fuzzy-logic architecture for autonomous multisensor data fusion," IEEE Trans. Ind. Electron., vol. 43, no. 3, pp. 403-410, Jun. 1996. (Pubitemid 126772885)
67. K. C. Ng and M. M. Trivedi, "A neuro-fuzzy controller for mobile robot navigation and multirobot convoying," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 28, no. 6, pp. 829-840, Dec. 1998. (Pubitemid 128748034)
68. H. A. Hagras, "A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots," IEEE Trans. Fuzzy Syst., vol. 12, no. 4, pp. 524-539, Aug. 2004.
69. X. Yang, M. Moallem, and R. V. Patel, "A layered goal-oriented fuzzy motion planning strategy for mobile robot navigation," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 35, no. 6, pp. 1214-1224, Dec. 2005. (Pubitemid 41800421)
70. T. Das and I. N. Kar, "Design and implementation of an adaptive fuzzy logic-based controller for wheeled mobile robots," IEEE Trans. Control Syst. Technol., vol. 14, no. 3, pp. 501-510, May 2006.
71. R. C. Luo and K. L. Su, "A review of high-level multisensor fusion: Approaches and applications," in Proc. IEEE Int. Conf. Multisensor Fusion Integrat. Intell. Syst., Aug. 1999, pp. 25-31.
72. R. C. Luo and K. L. Su, "Autonomous fire-detection system using adaptive sensor fusion for intelligent security robot," IEEE/ASME Trans. Mechatronics, vol. 12, no. 3, pp. 274-281, Jun. 2007. (Pubitemid 47018778)
73. R. C. Luo and K. L. Su, "Multilevel multisensory-based intelligent recharging system for mobile robot," IEEE Trans. Ind. Electron., vol. 55, no. 1, pp. 270-279, Jan. 2008.
74. P. Vadakkepat, P. Lim, L. C. De Silva, L. Jing, and L. L. Ling, "Multimodal approach to human-face detection and tracking," IEEE Trans. Ind. Electron., vol. 55, no. 3, pp. 1385-1393, Mar. 2008. (Pubitemid 351447579)
75. T. W. Manikas, K. Ashenayi, and R. L. Wainright, "Genetic algorithms for autonomous robot navigation," IEEE Instrum. Meas. Mag., vol. 10, no. 6, pp. 26-31, Dec. 2007. (Pubitemid 351284869)
76. T. M. Chen and R. C. Luo, "Integrated multi-behavior mobile robot navigation using decentralized control," in Proc. Int. Conf. Intell. Robot. Syst., Oct. 1998, pp. 564-569.
77. E. Ivanjko, M. Vasak, and I. Petrovic, "Kalman filter theory based mobile robot pose tracking using occupancy grid maps," in Proc. Int. Conf. Control Autom., Jun. 2005, pp. 869-874. (Pubitemid 41651637)
78. J. L. Jones, "Robots at the tipping point: The road to iRobot Roomba," IEEE Robot. Autom. Mag., vol. 13, no. 1, pp. 76-78, Mar. 2006. (Pubitemid 43329241)
79. D. Voth, "A new generation of military robots," IEEE Intell. Syst., vol. 19, no. 4, pp. 2-3, Jul.-Aug. 2004.
80. J. Morimoto, G. Endo, J. Nakanishi, and G. Cheng, "A biologically inspired biped locomotion strategy for humanoid robots: Modulation of sinusoidal patterns by a coupled oscillator model," IEEE Trans. Robot., vol. 24, no. 1, pp. 185-191, Feb. 2008. (Pubitemid 351411207)
81. E. S. Neo, K. Yokoi, S. Kajita, and K. Tanie, "Whole-body motion generation integrating operator's intention and robot's autonomy in controlling humanoid robots," IEEE Trans. Robot., vol. 23, no. 4, pp. 763-775, Aug. 2007. (Pubitemid 47308114)
82. K. Harada, S. Kajita, F. Kanehiro, K. Fujiwara, K. Kaneko, K. Yokoi, and H. Hirukawa, "Real-time planning of humanoid robot's gait for force-controlled manipulation," IEEE/ASME Trans. Mechatronics, vol. 12, no. 1, pp. 53-62, Feb. 2007. (Pubitemid 46444218)
83. H. Suzuki and M. Minami, "Visual servoing to catch fish using global/local GA search," IEEE/ASME Trans. Mechatronics, vol. 10, no. 3, pp. 352-357, Jun. 2005. (Pubitemid 41064275)
84. A. Muis and K. Ohnishi, "Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing," IEEE/ASME Trans. Mechatronics, vol. 10, no. 4, pp. 404-410, Aug. 2005. (Pubitemid 41489321)
85. S. Huang, E. Ertbelien, and H. V. Brussel, "A constraint-based behavior fusion mechanism on mobile manipulator," in Proc. ECSIS Symp. Learning Adapt. Behav. Robot. Syst., Aug. 2008, pp. 83-88.