Survey: State of the art in NDE data fusion techniques

IEEE Transactions on Instrumentation and Measurement

Volumn 56, Issue 6, 2007, Pages 2435-2451

  Liu, Zheng ^a   Forsyth, David S ^b   Komorowski, Jerzy P ^a   Hanasaki, Koichi ^c,d   Kirubarajan, Thia ^e  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b Texas Research International Inc   (United States)

^c KYOTO UNIVERSITY   (Japan)

^d UNIVERSITY OF FUKUI   (Japan)

^e MCMASTER UNIVERSITY   (Canada)

Author keywords

Data fusion; Diagnostic and prognostic health monitoring (DPHM); Heath care; Monitoring; Nondestructive testing (NDT) and inspection; Quantitative evaluation; Testing

Indexed keywords

ALGORITHMS; HEURISTIC METHODS; MULTIRESOLUTION ANALYSIS; NONDESTRUCTIVE EXAMINATION; OPTIMIZATION; UNCERTAINTY ANALYSIS;

DIAGNOSTIC AND PROGNOSTIC HEALTH MONITORING (DPHM); QUANTITATIVE EVALUATION;

DATA FUSION;

EID: 37249045883     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2007.908139     Document Type: Article

References (96)

1. J. Yim, "Image fusion using multiresolution decomposition and LMMSE filter," Ph.D. dissertation, Iowa State Univ., Ames, IA, 1995.
2. X. E. Gros, "A review of NDT data fusion processes and applications," Insight, Vol. 39, no. 9, pp. 652-657, Sep. 1997.
3. X. E. Gros, Applications of NDT Data Fusion. Norwell, MA: Kluwer, 2000.
4. M. Brassard, A. Chehbaz, A. Pelletier, and D. S. Forsyth, "Combined NDT inspection techniques for corrosion detection of aircraft structures," in Proc. 15th World Conf. Nondestructive Testing, Rome, Italy, Oct. 2000.
5. O. Dupuis, V. Kaftandjian, A. Hansen, and J. Casagrande, "Ffreshex: A combined system for ultrasonic and X-ray inspection of welds," in Proc. 15th World Conf. Nondestructive Testing, Rome, Italy, Oct. 2000.
6. N. Francois, "A new advanced multitechnique data fusion algorithm for NDT," in Proc. 15th Word Conf. NDT, Rome, Italy, Oct. 2000.
7. B. J. Matuszewski, L. K. Shark, and M. R. Varley, "Region-based wavelet fusion of ultrasonic, radiographic and shearographic nondestructive testing images," in Proc. 15th World Conf. Nondestructive Testing Rome, Italy, Oct. 2000.
8. W. Deng, B. J. Matuszewski, L. K. Shark, J. P. Smith, and G. Cavaccini, "Multi-modality NDT image fusion and its mapping on curved 3D CAD surface," in Proc. 16th World Conf. NDT, Montreal, QC, Canada, Aug. 2004.
9. X. E. Gros, NDT Data Fusion. London, UK.: Arnold, 1997.
10. C. Pohl and J. L. V. Genderen, "Multisensor image fusion in remote sensing: Concepts, methods, and applications," Int. J. Remote Sens. Vol. 19, no. 5, pp. 823-854, 1998.
11. X. E. Gros, P. Strachan, and D. W. Lowden, "Theory and implementation of NDT data fusion," Res. Nondestruct. Eval., Vol. 6, no. 4, pp. 227-236, Dec. 1995.
12. X. E. Gros, P. Strachan, D. W. Lowden, and I. Edwards, "NDT data fusion," in Proc. 6th Eur. Conf. Nondestructive Testing, 1994, pp. 355-359.
13. G. T. McKeein Multi-Sensor Fusion for Computer Vision. New York: Springer-Verlag, 1993, ch. What can be fused?
14. M. Mina, J. Yim, S. S. Udpa, and L. Udpa, "Two dimensional multifrequency eddy current data fusion," in Review of Progress in QNDE, Vol. 15. New York: Plenum, 1996, pp. 2125-2132.
15. K. A. Bartels and J. L. Fisher, "Optimal multidimensional multifrequency eddy current mixing techniques," in Review of Progress in QNDE, Vol. 15, D. O. Thompson and D. E. Chimenti, Eds. New York: Plenum, 1996, pp. 393-400.
16. J. Yim, S. S. Udpa, M. Mina, and L. Udpa, "Optimum filter based techniques for data fusion," in Review of Progress in QNDE, Vol. 15, D. O. Thompson and D. E. Chimenti, Eds. New York: Plenum, 1996, pp. 773-780.
17. J. Yim, S. S. Udpa, L. Udpa, and W. Lord, "Neural network approaches to data fusion," in Review of Progress in QNDE, Vol. 14, D. O. Thompson and D. E. Chimenti, Eds. New York: Plenum, 1995, pp. 819-826.
18. Z. Liu, K. Tsukada, and K. Hanasaki, "One-dimensional eddy current multifrequency data fusion: A multiresolution analysis approach," Insight, Vol. 40, no. 4, pp. 286-289, Apr. 1998.
19. Z. Liu, K. Tsukada, K. Hanasaki, and M. Kurisu, "Two-dimensional eddy current signal enhancement via multifrequency data fusion," Res. Nondestruct. Eval., Vol. 11, no. 3, pp. 165-177, Nov. 1999.
20. Z. Liu, X. E. Gros, K. Tsukada, and K. Hanasaki, "D visualization of ultrasonic inspection data by using AVS," in Proc. 5th Far-East Conf. Nondestructive Testing, Kenting, Taiwan, R.O.C., Nov. 1999, pp. 549-554.
21. Y. W. Song and S. S. Udpa, "A new morphological algorithm for fusing ultrasonic and eddy current images," in Proc. IEEE Ultrason. Symp. 1996, pp. 649-652.
22. K. Sun, S. S. Udpa, L. Udpa, T. Xue, and W. Lord, "Registration issues in the fusion of eddy current and ultrasonic NDE data using Q-transforms," in Review of Progress in QNDE, Vol. 15, D. O. Thompson and D. E. Clumenti, Eds. New York: Plenum, 1996, pp. 813-820.
23. G. Simone and F. C. Morabito, "NDT image fusion using eddy current and ultrasonic data," Int. J. Comput. Math. Elect. Electron. Eng., Vol. 20, no. 3, pp. 857-868, 2001.
24. X. E. Gros, J. Bousigue, and K. Takahashi, "NDT data fusion at pixel level," NDT E Int., Vol. 32, no. 5, pp. 283-292, Jul. 1999.
25. X. E. Gros, Z. Liu, K. Tsukada, and K. Hanasaki, "Experimenting with pixel level NDT data fusion techniques," IEEE Trans. Instrum. Meas. Vol. 49, no. 5, pp. 1083-1090, Oct. 2000.
26. O. Dupuis, V. Kaftandjian, D. Babot, and Y. Zhu, "Automatic detection and characterization of weld defects: Determination of confidence levels for data fusion of radioscopic and ultrasonic images," Insight, Vol. 41, no. 3, pp. 170-172, Mar. 1999.
27. A. K. Jain, M. P. Dubuisson, and M. S. Madhukar, "Multi-sensor fusion for nondestructive inspection of fiber reinforced composite materials," in Proc. 6th Tech. Conf. Amer. Soc. Composites, 1991, pp. 941-950.
28. V. Kaftandjian and N. Francois, "Use of data fusion methods to improve reliability of inspection: Synthesis of the work done in the frame of a European thematic network," in Proc. 8th ECNDT, Barcelona, Spain, Jun. 2002, Vol. 8. NDT. net, no. 2.
29. B. J. Matuszewski, L. K. Shark, and M. R. Varley, "Automatic mosaicing with error equalization of nondestructive testing images for aerospace industry inspection," in Proc. 15th World Conf. Nondestructive Testing, Rome, Italy, Oct. 2000.
30. A. M. Djafari, "Fusion of X-ray and geometrical data in computed tomography for nondestructive testing applications," in Proc. Int. Conf. Inf. Fusion, Annapolis, MD, Jul. 2002, pp. 309-316.
31. D. S. Forsyth and J. P. Komorowski, "The role of data fusion in NDE for aging aircraft," Proc. SPIE, Vol. 3394, pp. 47-58, 2000.
32. M. Mina, S. S. Udpa, L. Udpa, and J. Yim, "A new approach for practical two dimensional data fusion utilizing a single eddy current probe," in Review of Progress in QNDE, Vol. 16, D. O. Thompson and D. E. Clumenti, Eds. New York: Plenum, 1997, pp. 749-755.
33. Z. Liu, K. Tsukada, and K. Hanasak, "Multiresolution image fusion and its NDT application," in Proc. 26th Rev. Progress QNDE, D. O. Thomposon and D. E. Chimenti, Eds., Montreal, QC, Canada, Jul. 1999, Vol. 19.
34. T. Ogi, T. Nandai, and Y. Yabe, "Visualization of defects in virtual environment for quantitative evaluation," in Proc. Ist US-Jpn. Symp. Advances NDT, Oahu, HI, Jun. 1996, pp. 177-182.
35. J. Kim, S. Mandayam, S. S. Udpa, W. Lord, and L. Udpa, "Virtual reality for nondestructive evaluation applications," in Review of Progress in Quantitative NDE, Vol. 15, D. O. Thompson and D. E. Chimenti, Eds. New York: Plenum, 1996, pp. 897-902.
36. Z. Liu, X. E. Gros, K. Tsukada, K. Hanasaki, and K. Takahashi, "The use of wavelets for pixel level NDT data fusion," in Proc. 2nd Jpn.-US Symp. Advances NDT, Kahrku, HL 1999, pp. 474-477.
37. Z. Yin and A. A. Malsolm, "Thermal and visual image processing and fusion," Singapore Inst. Manuf. Technol., Singapore, Tech. Rep. AT/00/016/MVS.
38. A. Fahr, D. S. Forsyth, and C. E. Chapman, Survey of Nondestructive Evaluation (NDE) Techniques for Corrosion in Aging Aircraft. Ottawa, ON, Canada: Inst. Aerosp. Res., Oct. 1999.
39. Photon Dynamics, "Intelligent integrated AOI and X-ray system detects real world defects at low cost." [Online]. Available: http://www.photondynantics.com/pdf/intelligent.pdf
40. G. Y. Tian, A. Sophian, D. Taylor, and J. Rudlin, "Multiple sensors on pulsed eddy-current detection for 3-D subsurface crack assessment," IEEE Sensors J., vol. 5, no. 1, pp. 90-96, Feb. 2005.
41. T. Chady, R. Sikora, G. Psuj, M. Enokizono, and T. Todaka, "Fusion of electromagnetic inspection methods for evaluation of stress-loaded steel samples," IEEE Trans. Magn., vol. 41, no. 10, pp. 3721-3723, Oct. 2005.
42. M. Eiswirth, C. Heske, H. Hotzl, T. Schneider, and L. S. Burn, "Pipe defect characterization by multi-sensor systems," in Proc. 18th Int. Conf. No-Dig, Perth, Australia, Oct. 2000.
43. M. Eiswirth, C. Frey, J. Herbst, A. Jacubasch, I. Held, C. Heske, H. Hotzl, H. B. Kuntze, J. Kramp, R. Munser, and L. Wolf, "Sewer assessment by multi-sensor systems," in Proc. World Water Congr., Berlin, Germany, Oct. 2001.
44. A. J. Volponi, T. Brotherton, R. Luppold, and D. L. Simon, Development of an Information Fusion System for Engine Diagnostics and Health Management. Cleveland, OH: NASA, Feb. 2004.
45. V. Kaftandjian, Y. M. Zhu, O. Dupuis, and D. Babot, "The combined use of the evidence theory and fuzzy logic for improving multimodal non-destructive testing system," IEEE Trans. Instrum. Meas., vol. 54, no. 5, pp. 1968-1977, Oct. 2005.
46. W. Hardin, Sensor Fusion: Good for Humans, Hard on Systems, Dec. 2005. Feature Article. [Online]. Available: http:// www.machinevisiononline.org
47. Z. Liu and D. S. Forsyth, "Registration of multi-modal NDI images for aging aircraft," Res. Nondestruct. Eval., vol. 15, no. 1, pp. 1-17, Jan.-Mar. 2004.
48. Z. Liu, "Studies on data fusion of nondestructive testing," Ph.D. dissertation, Kyoto Univ., Kyoto, Japan, Mar. 2000.
49. Y. Tian, A. Tamburrion, S. S. Udpa, and L. Udpa, "Time-of-flight measurements from eddy current tests," in Review of Progress in QNDE vol. 22, D. O. Thompson and D. E. Chimenti, Eds. New York: Plenum, 2002, pp. 593-600.
50. R. P. Wei, D. G. Harlow, and D. Muench, "Corrosion, corrosion fatigue and material prognosis," in Proc. 23rd ICAF Symp., Hamburg, Germany, Jun. 2005.
51. D. J. Heeger and J. R. Bergen, "Pyrantid-based texture analysis/ synthesis," in Proc. ACM Comput. Graph., 1995, pp. 229-236.
52. P. J. Burt and R. J. Kolczynski, "Enhanced image capture through fusion," in Proc. 4th Int. Conf. Image Process., 1993, pp. 248-251.
53. E. H. Adelson, C. H. Anderson, J. R. Bergen, P. J. Burt, and J. M. Ogden, "Pyramid methods in image processing," RCA Eng., vol. 29, no. 6, pp.33-41,1984.
54. R. K. Sharma, "Probabilistic model-based multisensor image fusion," Ph.D. dissertation, Oregon Graduate Inst., Beaverton, OR, 1999.
55. A. Toet, "Image fusion by a ration of low-pass pyramid," Pattern Recognit. Lett., vol. 9, no. 4, pp. 245-253, May 1989.
56. H. Li, B. S. Manjunath, and S. K. Mitra, "Multisensor image fusion using the wavelet transform," Graph. Models Image Process., vol. 57, no. 3, pp. 235-245, May 1995.
57. O. Rockinger, "Image sequence fusion using a shift-invariant wavelet transform," in Proc. Int. Conf. Image Process., 1997, vol. 13, pp. 288-291.
58. T. Pu and G. Q. Ni, "Contrast-based image fusion using discrete wavelet transform," Opt. Eng., vol. 39, no. 8, pp. 2075-2082, Aug. 2000.
59. Z. Zhang, "Investigations of image fusion," Ph.D. dissertation, Lehigh Univ., Bethlehem, PA, 1999.
60. I. Koren, A. Laine, and F. Taylor, "Image fusion using steerable dyadic wavelet transform," in Proc. Int. Conf. Image Process., 1995, pp. 232-235.
61. Z. Liu, K. Tsukada, K. Hanasaki, Y. K. Ho, and Y. P. Dai, "Image fusion by using steerable pyramid," Pattern Recognit. Lett., vol. 22, no. 9, pp. 929-939, Jul. 2001.
62. C. Xydeas and V. Petrovic, "Objective pixel-level image fusion performance measure," Proc. SPIE. vol. 4051, pp. 89-98, 2000.
63. Q. Wang, Y. Shen, Y. Zhang, and J. Q. Zhang, "Fast quantitative correlation analysis and information deviation analysis for evaluating the performances of image fusion techniques," IEEE Trans. Instrum. Meas., vol. 53, no. 5, pp. 1441-1447, Oct. 2004.
64. L. Udpa, "Neural networks for NDE," in Proc. IV Int. Workshop: Advances Signal Process. Nondestructive Eval. Mater., Quebec City, QC, Canada, Aug. 2001.
65. M. T. Shyamsunder, C. Rajagopalan, K. K. Ray, and B. Raj, "A comparative study of conventional and artificial neural network classifiers for eddy current signal classification," Insight: Condition Monitoring Nondestructive Testing, vol. 37, no. 1, pp. 26-30, Jan. 1995.
66. P. Ramuhalli, "Neural network based iterative algorithms for solving electromagnetic NDE inverse problems," Ph.D. dissertation, Iowa State Univ., Ames, IA, 2002.
67. P. Ramuhalli and Z. Liu, "Wavelet neural network based data fusion for improved thickness characterization," in Review of Progress in Quantitative NDE, vol. 23, D. O.Thompson and D.E. Chimenti, Eds. NewYork: Plenum, 2003.
68. R. Polikar, L. Udpa, S. S. Udpa, and V. Honavar, "Learn++: An incremental learning algorithm for supervised neural networks," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 31, no. 4, pp. 497-508, Nov. 2001.
69. R. Polikar, L. Udpa, S. Udpa, and V. Honavar, "An incremental learning algorithm with confidence estimation for automated identification of NDE signals," IEEE Trans. Ultrason., Ferroelectr., Freq. Control, vol. 51, no. 8, pp. 990-1001, Aug. 2004.
70. D. L. Hall, Mathematical Techniques in Multisensor Data Fusion. Norwood, MA: Artech House, 1992.
71. A. Dromigny and Y. M. Zhu, "Improving the dynamic range of real-time X-ray imaging systems via Bayesian fusion," J. Nondestr. Eval., vol. 16, no.3, pp. 147-160, Sep. 1997.
72. D. Horn and W. R. Mayo, "NDE reliability gains from combining eddy-current and ultrasonic testing," NDT E Int., vol. 33, no. 6, pp. 351-362, Sep. 2000.
73. S. L. Hegarat-Mascle, I. Bloch, and D. Vidal-Madjar, "Application of Dempster-Shafer evidence theory to unsupervised classification in multi-source remote sensing," IEEE Trans. Geosci. Remote Sens., vol. 35, no. 4, pp. 1018-1031, Jul. 1997.
74. R. Hamid, "An experimental data fusion model for multisensor systems," Ph.D. dissertation, New Mexico State Univ., Las Cruces, NM, 1989.
75. Z. Liu, A. Fahr, and N. Mrad, "Application of Dempster-Shafer theory for fusion of lap joints inspection data," Proc. SPIE, vol. 6176, pp. 337-345, Mar. 2006.
76. I. Bloch and H. Maitre, Aggregation and Fusion of Imperfect Information, ser. Series Studies in Fuzziness. Heidelberg, Germany: Physica-Verlag, 1998, ch. Fusion of Image Information under Imprecision, pp. 189-213.
77. I. Bloch, "Information combination operators for data fusion: A comparative review with classification," IEEE Trans. Syst., Man, Cybern., Syst., Humans, vol. 26, no. 1, pp. 52-67, Jan. 1996.
78. H. D. Cheng and J. R. Chen, "Automatically determine the membership function based on the maximum entropy principle," Inf. Sci., vol. 96, no. 3/4, pp. 163-182, Feb. 1997.
79. Z. L. Zhang, Q. Wang, and S. H. Sun, "A new fuzzy neural network architecture for multi-sensor data fusion in nondestructive testing," in Proc. IEEE Int. Fuzzy Syst. Conf., Seoul, Korea, Aug. 1999, pp. 1661-1665.
80. F. Russo and G. Ramponi, "Fuzzy methods for multisensor data fusion," IEEE Trans. Instrum. Meas., vol. 43, no. 2, pp. 288-294, Apr. 1994.
81. R. E. Gibson, D. L. Hall, and J. A. Stover, "An autonomous fuzzy logic architecture for multisensor data fusion," in Proc. IEEE Int. Conf. Multisensor Fusion Integration Intell. Syst., Las Vegas, NV, Oct. 1994, pp. 143-150.
82. H. Tabani and J. M. Keller, "Information fusion in computer vision using the fuzzy integral," IEEE Trans. Syst., Man, Cybern., vol. 20, no. 3, pp. 733-741, May/Jun. 1990.
83. J. Cao, M. Schridhar, and M. Ahmadi, "Fusion of classifiers with fuzzy integrals," in Proc. 3rd Int. Conf. Document Anal. Recog., Montreal, QC, Canada, 1995, pp. 108-111.
84. L. F. Che, X. J. Zhou, and Y. D. Cheng, "Defect classification based on networks integration with fuzzy integral," Mech. Sci. Technol., vol. 19, no.1, pp. 111-112, 2000.
85. W. Deng, L. K. Shark, B. J. Matuszewski, J. P. Smith, and G. Cavaccini, "CAD model-based inspection and visualization for 3D nondestructive testing of complex aerostructures," Insight: Condition Monitoring Non-destructive Testing, vol. 46, no. 3, pp. 157-161, 2004.
86. C. Kohl, M. Krause, C. Maierhofer, K. Mayer, J. Wostmann, and H. Wiggernhauser, "3D-visualization of NDT data using a data fusion technique," Insight: Condition Monitoring Nondestructive Testing, vol. 45, no. 12, pp. 800-804, Dec. 2003.
87. C. Nockemann, L. Stenzel, C. Bellon, S. Nickisch, A. Schumm, B. Nouailhas, and M. Majos, "Coupling CAD to NDE data for a reliable reconstruction of ultrasonic and radiographic data," in Proc. ASNT Spring Conf., 1996.
88. A.V.S. Inc., Using AVS/Express, 1998. release 4.0.
89. R. Bossi and J. Nelson, "Data fusion for process monitoring and NDE," Proc. SPIE, vol. 2948, pp. 62-71, 1996.
90. S. Nikolov, M. Jones, L. Gilchrist, D. Bull, and N. Canagarajah, Multi-Sensor Image Fusion and Its Applications. New York: Taylor & Francis, 2005, ch. Gaze-Contingent Multimodality Displays for Visual Information Fusion: Systems and Applications, pp. 431-471.
91. X. E. Gros, P. Strachan, and D. W. Lowden, "Fusion of multiprobe NDT data for ROV inspection," in Proc. Conf. OCEANS MTS/IEEE, 1995, pp. 2046-2050.
92. P. J. McKerrow and S. J. Volk, "A systems approach to data fusion," in Proc. ADFS IEEE, 1996, pp. 217-222.
93. C. H. Chen, "Artificial intelligence in NDE," in Proc. 4th Workshop Advances Signal Process. Nondestructive Eval. Mater., X. Maldague, Ed., Quebec City, QC, Canada, Aug. 2001.
94. B. V. Dasarathy, "Sensor fusion 1998: A case for intelligent fusion," Opt. Eng., vol. 37, no. 2, pp. 352-353, Feb. 1998.
95. T. Brugger, "Creating the software to meet tomorrow's NDT needs," Mater. Eval., vol. 63, no. 8, pp. 801-803, Aug. 2005.
96. B. B. Djordjecvic, "Structural NDE for prognostic diagnostic," in Proc. Ageing Aircraft Conf., 2005.