Multisensor fusion and integration: Approaches, applications, and future research directions

IEEE Sensors Journal

Volumn 2, Issue 2, 2002, Pages 107-119

  Luo, Ren C ^a,b   Yih, Chih Chen ^b   Su, Kuo Lan ^b  

^a IEEE   (Taiwan)

^b NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

Author keywords

Classification of sensors; Fusion algorithms; Multisensor fusion; Multisensor integration; Smart sensors

Indexed keywords

FUSION ALGORITHMS; MULTISENSOR FUSION; MULTISENSOR INTEGRATION; SMART SENSORS;

ARTIFICIAL INTELLIGENCE; CONTROL THEORY; MICROSENSORS; MONITORING; REMOTE SENSING; ROBOTICS; SENSORS; SIGNAL PROCESSING;

SENSOR DATA FUSION;

EID: 0142163128     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2002.1000251     Document Type: Article

References (76)

1. R. C. Luo and M. G. Kay, "A tutorial on multisensor integration and fusion," in Proc. 16th Annu. Conf. IEEE Ind. Electron., vol. 1, 1990, pp. 707-722.
2. _, "Multisensor integration and fusion in intelligent systems," IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 901-931, Sept./Oct. 1989.
3. D. L. Hall and J. Llinas, "An introduction to multisensor data fusion," Proc. IEEE, vol. 85, pp. 6-23, Jan. 1997.
4. D. Hall, Mathematical Techniques in Multisensor Data Fusion. Boston, MA: Artech House, 1992.
5. J. Llinas and E. Waltz, Multisensor Data Fusion. Boston, MA: Artech House, 1990.
6. P. K. Varshney, "Scanning the special issue on the data fusion," Proc. IEEE, vol. 85, pp. 6-23, Jan. 1997.
7. B. V. Dasarathy, Decision Fusion. Los Alamitos, CA: IEEE Comput. Soc. Press, 1994.
8. M. Kokar and K. Kim, "Review of multisensor data fusion architectures and techniques," in Proc. 1993 Int. Symp. Intell. Control, Chicago, IL.
9. B. V. Dasarathy, "Sensor fusion potential exploitation-innovative architectures and illustrative applications," Proc. IEEE, vol. 85, pp. 24-38, Jan., 1997.
10. P. K. Varshney, "Multisensor data fusion," Electron. Comm. Eng. J., vol. 9, no. 6, pp. 245-253, 1997.
11. R. C. Luo, "Sensor technologies and microsensor issues for mechatronics systems," IEEE/ASME Trans. Mechatron., vol. 1, pp. 39-49, Jan. 1996.
12. R. C. Luo and T. M. Chen, "Target tracking by gray prediction theory and look-ahead fuzzy logic control," in Proc. 1999 IEEE Int. Conf. Robot. Automat., vol. 2, 1999, pp. 1176-1181.
13. H. R. Hashemipour, S. Roy, and A. J. Laub, "Decentralized structures for parallel Kalman filtering," IEEE Trans. Automat. Control, vol. 33, pp. 88-93, Jan. 1988.
14. E. Waltz, "Data fusion for C3I: A tutorial," Command, Control, Communications Intelligence (C3I) Handbook, EW Communications, Inc., Palo Alto, CA, 1986.
15. L. A. Klein, "Sensor and Data Fusion Concepts and Applications," in SPIE Optical Engineering Press. Bellingham, WA: Tutorial Texts, 1993, vol. 14, p. 131.
16. P. Lehner, M. Seyed-Solorforough, M. F. O'Connor, S. Sak, and T. Mullin, "Cognitive biases and time stress in team decision making," IEEE Trans. Syst., Man, Cybern. A: Systems and Humans, vol. 27, pp. 698-703, Sept. 1997.
17. V. R. Lesser, "Cooperative multiagent systems: A personal view of the state of the art," IEEE Trans. Knowledge Data Eng., vol. 11, pp. 133-142, Jan. 1999.
18. B. R. Bracio, W. Horn, and D. P. F. Moller, "Sensor fusion in biomedical systems," in Proc. 19th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., vol. 3, 1997, pp. 1387-1390.
19. T. Kohonen, Self-Organization and Associative Memory. New York: Springer-Verlag, 1988.
20. S. C. A. Thomopoulos, "Sensor integration and data fusion," J. Robot. Syst., vol. 7, no. 3, pp. 337-372, 1990.
21. S. G. Goodridge, M. G. Kay, and R. C. Luo, "Multilayered fuzzy behavior fusion for real-time reactive control of systems with multiple sensors," IEEE Trans. Ind. Electron., vol. 43, June 1996.
22. J. A. Stover, D. L. Hall, and R. E. Gibson, "A fuzzy-logic architecture for autonomous multisensor data fusion," IEEE Trans. Ind. Electron., vol. 43, June 1996.
23. R. C. Luo, M.-H. Lin, and R. S. Scherp, "Dynamic multi-sensor data fusion system for intelligent robots," IEEE J. Robot. Automat., vol. 4, Aug. 1988.
24. R. Joshi and A. C. Sanderson, "Minimal representation multisensor fusion using differential evolution," IEEE Trans. Syst., Man, Cybern. A: Systems and Humans, vol. 29, Jan. 1999.
25. B. Siciliano, "Control in robotics: Open problems and future directions," in Proc. 1998 IEEE Int. Conf. Control Applicat., vol. 1, 1998, pp. 81-85.
26. K. Hirai, M. Hirose, Y. Haikawa, and T. Takenaka, 'The development of Honda humanoid robot," in Proc. IEEE Int. Conf. Robot. Automat., vol. 2, 1998, pp. 1321-1326.
27. B. Solaiman, R. K. Koffi, M.-C. Mouchot, and A. Million, "An information fusion method for multispectral image classification postprocessing," IEEE Trans. Geosci. Remote Sensing, vol. 36, no. 2, pp. 395-406, 1998.
28. B. S. Y. Rao, H. H. F. Durrant-Whyte, and J. A. Sheen, "A fully decentralized multi-sensor system for tracking and surveillance," Int. J. Robot. Res., vol. 12, Feb. 1993.
29. M. Kam, X. Zhu, and P. Kalata, "Sensor fusion for mobile robot navigation," Proc. IEEE, vol. 85, no. 1, Jan. 1997.
30. V. V. S. Sarma and S. Raju, "Multisensor data fusion and decision support for airborne target identification," IEEE Trans. Syst., Man, Cybern., vol. 21, Sept. 1991.
31. A. Filippidis, L. C. Jain, and N. Martin, "Multisensor data fusion for surface land-mine detection," IEEE Trans. Syst., Man, Cybern. C: Applications and Reviews, vol. 30, pp. 145-150, Feb. 2000.
32. R. R. Carson, Jr., M. P. Meyer, and D. J. Peters, "Fusion of IFF and radar data," in Proc. 16th DASC AIAA/IEEE Digital Avionics Syst. Conf., vol. 1, 1997, pp. 5.3-9-15.
33. P. Valin, J. Couture, and M. Simard, "Position and attribute fusion of radar, ESM, IFF and datalink for AAW missions of the Canadian patrol frigate," in Proc. 1996 IEEE/SICE/RSJ Int. Conf. Multisensor Fusion Integration Intell. Syst., 1996, pp. 63-71.
34. T. E. Bell, "Remote sensing," IEEE Spectrum, vol. 32, pp. 24-31, Mar. 1995.
35. B. Solaiman, L. E. Pierce, and F. T. Ulaby, "Multisensor data fusion using fuzzy concepts: Application to land-cover classification using ERS-l/JERS-1 SAR composites," IEEE Trans. Geosci. Remote Sensing, vol. 37, pp. 1316-1326, May 1999.
36. A. Chiuderi, F. Stafano, and V. Cappellini, "An application of data fusion to landcover classification of remote sensed imagery: A neural network approach," in Proc. IEEE Int. Conf. Multisensor Fusion Integration Intell. Syst., 1994, pp. 756-762.
37. D. G. Goodenough, P. Bhogal, D. Charlebois, S. Matwin, and O. Niemann, "Intelligent data fusion for environmental monitoring," in Proc. Geosci. Remote Sensing Symp., vol. 3, 1995, pp. 2157-2160.
38. Partington, M.-R. Keller, P. Seymour, and C. Bertoia, "Data fusion for use of passive microwave data in operational sea-ice monitoring," in Geosci. Remote Sensing Symp., vol. 3, 1999, pp. 1579-1581.
39. O. Rud and M. Gade, "Monitoring algae blooms in the Baltic Sea: A multi sensor approach," in Proc. OCEANS '99 MTS/IEEE, vol. 3, 1999, pp. 1234-1238.
40. T. I. Liu and K. S. Anantharaman, "On-line sensing of drill wear using neural network approach," in IEEE Int. Conf. Neural Network, vol. 2, 1993, pp. 690-694.
41. K.-N. Lou and C.-J. Lin, "An intelligent sensor fusion system for tool monitoring on a machining center," in Proc. IEEE/SICE/RSJ Int. Conf. Multisensor Fusion Integration Intell. Syst., 1996, pp. 208-214.
42. G. Littlefair, M. A. Javed, and G. T. Smith, "Fusion of integrated multisensor data for tool wear monitoring," in Proc. IEEE Int. Conf. Neural Networks, vol. 2, 1995, pp. 734-737.
43. S. Kakade, L. Vijayaraghavan, and R. Krishnamurthy, "Monitoring of tool status using intelligent acoustic emission sensing and decision based neural network," in Proc. IEEE/IAS Int. Conf. Ind. Automat. Control, 1995, pp. 25-29.
44. N. Levy, M. C. Zhou, and Y. Quan, "Real-time tool wear identification using sensor integration with neural network," in Proc. 33rd IEEE Conf. Decision Control, vol. 2, 1994, pp. 1050-1051.
45. R. J. Hansen, D. L. Hall, and S. K. Kurtz, "A new approach to the challenge of machinery prognostics," Trans. ASME, J. Eng. Gas Turbines Power, pp. 320-325, Apr. 1995.
46. F. A. Mora, G. Passariello, G. Carrault, and J.-P. Le Pichon, "Intelligent patient monitoring and management systems: A review," IEEE Eng. Med. Biol. Mag., vol. 12, pp. 23-33, Dec. 1993.
47. A. I. Hernandez, G. Carrault, F. Mora, L. Thoraval, G. Passariello, and J. M. Schleich, "Multisensor fusion for atrial and ventricular activity detection in coronary care monitoring," IEEE Trans. Biomed. Eng., vol. 46, pp. 1186-1190, Oct. 1999.
48. F. Azuaje, W. Dubitzky, N. Black, and K. Adamson, "Improving clinical decision support through case-based data fusion," IEEE Trans. Biomed. Eng., vol. 46, pp. 1181-1185, Oct. 1999.
49. B. Solaiman, R. Debon, F. Pipelier, J.-M. Cauvin, and C. Roux, "Information fusion, application to data and model fusion for ultrasound image segmentation," IEEE Trans. Biomed. Eng., vol. 46, pp. 1171-1175, Oct. 1999.
50. A. Mirabadi, N. Mort, and F. Schmid, "Application of sensor fusion to railway systems," in Proc. IEEE/SICE/RSJ Int. Conf. Multisensor Fusion Integration Intell. Syst., 1996, pp. 185-192.
51. _, "Fault detection and isolation in multisensor train navigation systems," in Proc. UKACC Int. Conf. Control, vol. 2, 1998, pp. 969-974.
52. K. Kobayashi, F. Munekata, and K. Watanabe, "Accurate navigation via differential GPS and vehicle local sensors," in Proc. IEEE Int. Conf. Multisensor Fusion Integration Intell. Syst., 1994, pp. 9-16.
53. C. E. Smith, S. A. Brandt, and N. P. Papanikolopoulos, "Vision sensing for intelligent vehicle and highway systems," in Proc. IEEE Int. Conf. Multisensor Fusion Integration Intell. Syst., 1994, pp. 784-791.
54. Z. Korona and M. M. Kokar, "Multisensor integration in the tracking of landing aircraft," in Proc. IEEE Int. Conf. Multisensor Fusion Integration Intell. Syst., 1994, pp. 771-778.
55. J. Sato, K. Shigeta, and Y. Nagasaka, "Automatic operation of a combined harvester in a rice field," in Proc. of IEEE/SICE/RSJ Int. Conf. Multisensor Fusion Integration Intell. Syst., 1996, pp. 86-92.
56. C.-Y. Chong and M. Liggins, "Fusion technologies for drug interdiction," in Proc. IEEE Int. Conf. Multisensor Fusion Integration Intell. Syst., 1994, pp. 435-441.
57. T. M. Chen and R. C. Luo, "Multilevel multiagent based team decision fusion for autonomous tracking system," Mach. Intell. Robot. Control, vol. 1,no. 2, pp. 63-69, 1999.
58. _, "A generalized look-ahead method for adaptive multiple sequential data fusion and decision making," in MFI99, August 1999, pp. 199-204.
59. R. C. Luo and M. G. Kay, "Data fusion and sensor integration: State-of-the-art 1990s," in Data Fusion in Robotics and Machine Intelligence, M. A. Gonzalez, Ed. San Diego, CA: Academic, 1992.
60. M. Fernandez and H. F. Durrant-Whyte, "A failure detection and isolation algorithm for a decentralized multisensor system," in MFI 94, Las Vegas, NV, Oct. 2-5, 1994, pp. 27-33.
61. A. Aitouche, D. Maguin, and F. Busson, "Multiple sensor fault detection in heat exchanger system," in Int. Conf. Control Applicat. Trieste, Italy, Sept. 1-4, 1998, pp. 741-745.
62. P. Balle, D. Fussel, and O. Hecker, "Detection and isolation of sensor faults on nonlinear processes based on local linear models," in Proc. Amer. Control Conf., Albuquerque, NM, June 1997, pp. 468-472.
63. A. Mirabadi, N. Mort, and F. Schmia, "Fault detection and isolation in multisensor train navigation system," in UKACC Int. Conf. Control '98, Sept. 1-4, 1998, pp. 909-974.
64. T. W. Long, L. Hanzevack, and W. L. Bynum, "Sensor fusion and failure detection using virtual sensor," in Proc. Amer. Control Conf., San Diego, CA, June 1999, pp. 2417-2420.
65. C. M. Hajiyev and F. Caliskan, "Fault detection in fight control systems via innovation sequence of Kalman filter," in UKACC Int. Conf. Control '98, Sep. 1-4, 1998, pp. 1528-1533.
66. S. I. Roumeliots, G. S. Sukhatme, and G. A. Bekey, "Sensor fault detection and identification in a mobile robot," in IROS, Oct. 1998, pp. 1383-1388.
67. P. G. O'Reilly, "Local sensor fault detection using Bayesian decision theory," in UKACC Int. Conf. Control '98, Sept. 1-4, 1998, pp. 247-251.
68. J. Stoustrup and M. J. Grimble, "Integrated control and fault diagnosis design: A polynomial approach," in Modeling and Signal Processing for Fault Diagnosis, 1996, pp. 10/1-10/7.
69. R. C. Luo, M. Kay, and W. G. Lee, "Future trends in multisensor integration and fusion," in Proc. IEEE Int. Symp. Ind. Electron., 1994, pp. 7-12.
70. F. Yalcinnkaya, D. P Atherton, H. Calis, and E. T. Powner, "Intelligent sensors: The way forward to decentralised intelligence and control," in Proc. Int. Conf. Control '98 UKACC, vol. 1, 1998, pp. 358-363.
71. R. A. Breckenbridge and C. Husson, "Smart sensor in spacecraft: The impact and trends," in Proc. AIAA/NASA Conf. Smart Sens., Hamptom, VA, 1978, pp. 1-5.
72. L. Hong, "Adaptive Data Fusion," Syst., Man, Cybern., pp. 767-772, 1991.
73. P. R. Belanger, "Estimation of noise covariance matrices for a linear time-varying stochastic process," Automatica, vol. 10, pp. 267-275, 1974.
74. B. Carew and P. R. Belanger, "Identification of optimum filter steadystate gain for systems with unknown noise covariance," IEEE Trans. Automat. Control, vol. AC-18, pp. 582-587, June 1973.
75. R. K. Mehra, "On the identification of variances and adaptive Kalman filtering," IEEE Trans. Automat. Control, vol. AC-15, pp. 175-184, Feb. 1970.
76. R. G. Reynolds, "Robust estimation of covariance matrices," IEEE Trans. Automat. Control, vol. 35, no. 9, pp. 1047-1051, Sept., 1990.