Automated X-ray image analysis for cargo security: Critical review and future promise

Journal of X-Ray Science and Technology

Volumn 25, Issue 1, 2017, Pages 33-56

  Rogers, Thomas W ^a   Jaccard, Nicolas ^a   Morton, Edward J ^b   Griffin, Lewis D ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b Rapiscan Systems Ltd   (United Kingdom)

Author keywords

automated threat detection; computer vision; image analysis; segmentation; X ray

Indexed keywords

AUTOMATION; COMPUTER VISION; COMPUTERIZED TOMOGRAPHY; IMAGE PROCESSING; IMAGE SEGMENTATION; IMAGE UNDERSTANDING; X RAYS;

AUTOMATED ANALYSIS; AUTOMATED IMAGE ANALYSIS; IMAGE MANIPULATION; IMAGE PREPROCESSING; MATERIAL DISCRIMINATION; QUALITY IMPROVEMENT; THREAT DETECTION; THREAT IMAGE PROJECTION;

IMAGE ANALYSIS;

IMAGE ANALYSIS; TOTAL QUALITY MANAGEMENT; VISION; X RAY; IMAGE PROCESSING; ORGANIZATION AND MANAGEMENT; PREVENTION AND CONTROL; PROCEDURES; STANDARDS; TERRORISM; TRAFFIC AND TRANSPORT;

IMAGE PROCESSING, COMPUTER-ASSISTED; SECURITY MEASURES; TERRORISM; TRANSPORTATION; X-RAYS;

EID: 85011617327     PISSN: 08953996     EISSN: None     Source Type: Journal    
DOI: 10.3233/XST-160606     Document Type: Article

References (84)

1. S. Açkay, M.E. Kundegorski, M. Devereux, and T.P. Breckon. Transfer Learning using Convolutional Neural Networks for object classification within X-ray baggage security imagery. In: Proceedings IEEE International Conference on Image Processing (2016), 1057-1061
2. R.E. Alvarez, and A. Macovski. Energy-selective reconstructions in X-ray computerised tomography, Physics in Medicine, and Biology 21(5) (1976), 733-744
3. J.T.A. Andrews, E.J. Morton, and L.D. Griffin. Detecting anomalous data using auto-encoders. International Journal of Machine Learning, and Computing 6(1) (2016), 21-26
4. M. Baştan. Multi-view object detection in dual-energy X-ray images. Machine Vision, and Applications 26(7-8) (2015), 1045-1060
5. M. Baştan, W. Byeon, and T. Breuel. Object recognition in multi-view dual energy X-ray images. In: Proceedings British Machine Vision Conference (2013), 1-11
6. M. Baştan, M.R. Yousefi, and T.M. Breuel. Visual words on baggage X-ray images. In: Proceedings International Conference on Computer Analysis of Images, and Patterns (2011), 360-368
7. M.J. Berger, J.H. Hubbell, S.M. Seltzer, J. Change, J.S. Coursey, D.S. Zucker, and K. Olsen. XCOM: Photon Cross Sections Database. Source: http://www.nist.gov/pml/data/xcom/, 1998. Accessed: 15-06-2016
8. N. Calvert, E.J. Morton, and R.D. Speller. Preliminary monte carlo simulations of linear accelerators in time-of-flight compton scatter imaging for cargo security, Crime Science 2(1) (2013), 1-12
9. A. Chalmers. Automatic high throughput empty ISO container verification. In: Proceedings SPIE 6540 (2007), 1-4
10. A. Chalmers. Cargo identification algorithms facilitating unmanned/unattended inspection at high throughput terminals. In: Proceedings SPIE, 6736 (2007), 1-6
11. G. Chen. Understanding X-ray cargo imaging. Nuclear Instruments, and Methods in Physics Research Section B: Beam Interactions with Materials, and Atoms 241(1) (2005), 810-815
12. G. Chen, G. Bennett, and D. Perticone. Dual-energy X-ray radiography for automatic high-Z material detection. Nuclear Instruments, and Methods in Physics Research Section B: Beam Interactions with Materials, and Atoms 261(1) (2007), 356-359
13. W. Chen, H. Wang, Y. Li, H. Su, C. Tu, D. Lischinsk, D. Cohen-Or, and B. Chen. Synthesizing training images for boosting human 3D pose estimation. CoRR. abs/1604.0, 2016
14. European Commission. Concealment methods. In: Good Practice Guide for Sea Container Control. Ch. 6 (2002
15. European Commission. Container specifications. In: Good Practice Guide for Sea Container Control. Ch. 3 (2002
16. European Commission. General approach to container control. In: Good Practice Guide for Sea Container Control. Ch. 1 (2002
17. European Commission. Types of fraud, and trends. In: Good Practice Guide for Sea Container Control. Ch. 4 (2002
18. J.G. Fantidis, D.V. Bandekas, P. Kogias, and N. Vordos. The evaluation on dual. triple, and quadruple energy X-Ray systems for the material characterisation of a suspicious bulky object. In: Recent Advances in Energy, Environment, Biology, and Ecology, 143-148
19. G. Flitton, T. Breckon, and N. Megherbi. Object recognition using 3D SIFT in complex CT volumes. In: Proceedings British Machine Vision Conference, (2010), 1-12
20. G. Flitton, T.P. Breckon, and N. Megherbi, A comparison of 3D interest point descriptors with application to airport baggage object detection in complex CT imagery. Pattern Recognition 46(9) (2013), 2420-2436
21. G. Flitton, A. Mouton, and T.P. Breckon. Object classification in 3D baggage security computed tomography imagery using visual codebooks. Pattern Recognition 48(8) (2015), 1-11
22. T. Franzel, U. Schmidt, and S. Roth. Object detection in multi-view X-ray images. In: Proceedings Joint DAGM, and OAGM Symposium (2012), 144-154
23. K. Fu, C. Guest, and P. Das. Segmentation of suspicious objects in an X-ray image using automated region filling approach. In: Proceedings SPIE, 7445 (2009), 1-12
24. K. Fu, D. Ranta, P. Das, and C. Guest. Layer separation for material discrimination cargo imaging system. In: Proceedings SPIE, 7538 (2010), 1-12
25. K. Fu, D. Ranta, C. Guest, and P. Das. The application of wavelet denoising in material discrimination system. In: Proceedings SPIE, 7538 (2010), 1-12
26. Y. Gil, Y. Oh, M. Cho, and W. Namkung. Radiography simulation on single shot dual-spectrum X-ray for cargo inspection system. Applied Radiation, and Isotopes 69(2) (2011), 389-393
27. H.J. Godwin, T. Menneer, K.R. Cave, and N. Donnelly. Dual-target search for high, and low prevalence X-ray threat targets. Visual Cognition 18(10) (2010), 1439-1463
28. Q. Gong, D. Coccarelli, R.-I. Stoian, J. Greenberg, E. Vera, and M. Gehm. Rapid GPU-based simulation of X-ray transmission. scatter, and phase measurements for threat detection systems. In: Proceedings SPIE, 9847 (2016), 1-8
29. L. Grady. Fast. quality, segmentation of large volumes -isoperimetric distance trees. In: Proceedings European Conference on Computer Vision (2006), 449-462
30. L. Grady, and C.V. Alvino. The piecewise smooth Mumford-Shah functional on an arbitrary graph. IEEE Transactions on Image Processing 18(11) (2009), 2547-2561
31. L. Grady, V. Singh, T. Kohlberger, C. Alvino, and C. Bahlmann. Automatic segmentation of unknown objects. with application to baggage security. In: Proceedings European Conference on Computer Vision, 7573 (2012), 430-444
32. A. Gupta, A. Vedaldi, and A. Zisserman. Synthetic data for text localisation in natural images. CoRR. abs/1604.0, 2016
33. G. Heitz, and G. Chechik. Object separation in X-ray image sets. In: Proceedings IEEE International Conference on Computer Vision, and Pattern Recognition, (2010), 2093-2100
34. A.G. Howard. Some improvements on deep Convolutional Neural Network based image classification. CoRR, abs/1312.5402, 2013
35. N. Jaccard, T.W. Rogers, and L.D. Griffin. Automated detection of cars in transmission X-ray images of freight containers. In: Proceedings IEEE Advanced Video, and Signal Based Surveillance, (2014), 387-392
36. N. Jaccard, T.W. Rogers, E.J. Morton, and L.D. Griffin. Using deep learning on X-ray images to detect threats. In: Proceedings Cranfield Defence, and Security Doctoral Symposium, (2015), 1-12
37. N. Jaccard, T.W. Rogers, E.J. Morton, and L.D. Griffin. Detection of concealed cars in complex cargo X-ray imagery using deep learning. CoRR. abs/1606.08078, 2016
38. N. Jaccard, T.W. Rogers, E.J. Morton, and L.D. Griffin. Tackling the X-ray cargo inspection challenge using machine learning. In: Proceedings SPIE, 9847 (2016), 1-13
39. B. Klock. Test, and evaluation report for X-ray detection of threats using different X-ray functions. In: Proceedings IEEE International Carnahan Conference on Security Technology, (2005), 182-184
40. A. Krizhevsky, I. Sutskever, and G.E. Hinton. ImageNet classification with deep Convolutional Neural Networks. In: Proceedings Advances in Neural Information Processing Systems, (2012), 1097-1105
41. L. Li, R. Li, S. Zhang, T. Zhao, and Z. Chen, A dynamic material discrimination algorithm for dual MV energy X-ray digital radiography. Applied Radiation, and Isotopes 114 (2016), 188-195
42. Y. Liu, B.D. Sowerby, and J.R. Tickner. Comparison of neutron, and high energy X-ray dual-beam radiography for air cargo inspection. Applied Radiation, and Isotopes 66(4) (2008), 463-473
43. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In: Proceedings IEEE Conference on Computer Vision, and Pattern Recognition, (2015), 3431-3440
44. N. Megherbi, T.P. Breckon, G.T. Flitton, and A. Mouton. Fully automatic 3D Threat Image Projection: Application to densely cluttered 3D computed tomography baggage images. In: Proceedings International Conference on Image Processing Theory, Tools, and Applications, (2012), 153-159
45. N. Megherbi, T.P. Breckon, G.T. Flitton, and A. Mouton. Radon transform based automatic metal artefacts generation for 3D Threat Image Projection. In: Proceedings SPIE, 8901 (2013), 1-9
46. D. Mery, G. Mondragon, V. Riffo, and I. Zuccar. Detection of regular objects in baggage using multiple X-ray views, Insight Non-Destructive Testing, and Condition Monitoring 55(1) (2013), 16-20
47. D. Mery, and V. Riffo. Automated object recognition in baggage screening using multiple X-ray views. In: Proceedings British Institute of Non-Destructive Testing Conference, (2013
48. D. Mery, V. Riffo, U. Zscherpel, G. Mondragón, I. Lillo, I. Zuccar, H. Lobel, and M. Carrasco. GDXray: The database of X-ray images for nondestructive testing, Journal of Nondestructive Evaluation 34(4) (2015), 1-12
49. D. Mery, V. Riffo, I. Zuccar, and C. Pieringer. Automated X-ray object recognition using an efficient search algorithm in multiple views. In: Proceedings IEEE Conference on Computer Vision, and Pattern Recognition Workshop, (2013), 368-374
50. S. Michel, M. Mendes, J.C. de Ruiter, G.C.M. Koomen, and A. Schwaninger. Increasing X-ray image interpretation competency of cargo security screeners, International Journal of Industrial Ergonomics 44(4) (2014), 551-560
51. M. Mitckes. Threat Image Projection: An overview. Source: ftp://95.31.11.186/pub/Other/Manuals/Airport%20XRay/TIP.pdf, 2003. Accessed: 15-06-2016
52. A. Mouton, and T.P. Breckon, A review of automated image understanding within 3D baggage computed tomography security screening. Journal of X-ray Science, and Technology 23(5) (2015), 531-555
53. A. Mouton, and T.P. Breckon. Materials-based 3D segmentation of unknown objects from dual-energy computed tomography imagery in baggage security screening, Pattern Recognition 48(6) (2015), 1961-1978
54. A. Mouton, T.P. Breckon, G.T. Flitton, and N. Megherbi, 3D object classification in baggage computed tomography imagery using randomised clustering forests. In: Proceedings IEEE International Conference on Image Processing, (2014), 5202-5206
55. A. Mouton, G.T. Flitton, S. Bizot, N. Megherbi, and T.P. Breckon. An evaluation of image denoising techniques applied to CT baggage screening imagery. In: Proceedings IEEE International Conference on Industrial Technology, (2013), 1063-1068
56. V.L. Novikov, S.A. Ogorodnikov, and V.I. Petrunin. Dual energy method of material recognition in high energy introscopy systems, Questions of Atomic Science, and Technology [translated from Russian] 4(2) (1999), 93-95
57. S. Ogorodnikov, M. Arlychev, I. Shevelev, R. Apevalov, A. Rodionov, and I. Polevchenko. Material discrimination technology for cargo inspection with pulse-to-pulse linear electron accelerator. In: Proceedings International Particle Accelerator Conference, (2013), 3699-3701
58. S. Ogorodnikov, and V. Petrunin. Processing of interlaced images in 4-10 MeV dual energy customs system for material recognition, Physical Review Special Topics -Accelerator, and Beams 5(10) (2002), 67-77
59. S. Ogorodnikov, V. Petrunin, and M. Vorogushin. Radioscopic discrimination of materials in 1-10 MeV range for customs applications. In: Proceedings European Particle Accelerators Conference, (2002), 2807-2809
60. V.J. Orphan, E. Muenchau, J. Gormley, and R. Richardson. Advanced γ ray technology for scanning cargo containers, Applied Radiation, and Isotopes 63(5-6) (2005), 723-732
61. Rapiscan Systems. Rapiscan Eagle®R60. Source: http://www.rapiscansystems.com/en/products/cvi/rapiscan eagle r60. Accessed: 14-06-2016
62. V. Riffo, and D. Mery. Automated detection of threat objects using adapted implicit shape model, IEEE Transactions on Systems, Man, and Cybernetics: Systems 46(4) (2015), 472-482
63. T.W. Rogers, N. Jaccard, E.J. Morton, and L.D. Griffin. Detection of cargo container loads from X-ray images. In: Proceedings IET International Conference on Intelligent Signal Processing, 6.-6.(1), (2015
64. T.W. Rogers, N. Jaccard, E.D. Protonotarios, J. Ollier, E.J. Morton, and L.D. Griffin. Threat Image Projection (TIP) into X-ray images of cargo containers for training humans, and machines. In: Proceedings IEEE International Carnahan Conference on Security Technology, to appear, (2016
65. T.W. Rogers, J. Ollier, E.J. Morton, and L.D. Griffin. Reduction of wobble artefacts in images from mobile transmission X-ray vehicle scanners. In: Proceedings IEEE Imaging Systems, and Techniques, (2014), 356-360
66. J. Romero. Prevention of maritime terrorism: The Container Security Initiative, Chicago Journal of Inertnational Law 4 (2003), 597-605
67. L. Schmidt-hackenberg, M.R. Yousefi, and T.M. Breuel. Visual cortex inspired features for object detection in X-ray images. In: Proceedings International Conference on Pattern Recognition, (2012), 2573-2576
68. A. Schwaninger, D. Hardmeier, and F. Hofer. Measuring visual abilities, and visual knowledge of aviation security screeners. In: Proceedings IEEE International Carnahan Conference on Security Technology, (2004), 258-264
69. A. Schwaninger, S. Michel, and A. Bolfing. Towards a model for estimating image difficulty in X-ray screening. In: Proceedings IEEE International Carnahan Conference on Security Technology, (2005), 185-188
70. A. Schwaninger, S. Michel, and A. Bolfing, A statistical approach for image difficulty estimation in X-ray screening using image measurements. In: Proceedings Symposium on Applied Perception in Graphics, and Visualization, (2007), 123-130
71. K. Simonyan, and A. Zisserman. Very Deep Convolutional Networks for large-scale image recognition. CoRR, abs/1409.1, (2014
72. S.M. Steiner-Koller, A. Bolfing, and A. Schwaninger. Assessment of X-ray image interpretation competency of aviation security screeners. In: Proceedings IEEE International Carnahan Conference on Security Technology, (2009), 20-27
73. H. Su, S. Maji, E. Kalogerakis, and E. Learned-Miller. Multi-View Convolutional Neural Networks for 3D shape recognition. In: Proceedings IEEE International Conference on Computer Vision, (2015), 945-953
74. The World Bank. Container port traffic (TEU: 20 foot equivalent units). Source: http://data.worldbank.org/indicator/IS.SHP.GOOD.TU/countries. Accessed: 14-06-2016
75. J. Tuszynski, J.T. Briggs, and J. Kaufhold, A method for automatic manifest verification of container cargo using radiography images. Journal of Transportation Security 6(4) (2013), 339-356
76. U.S. Customs, and Border Protection. Container Security Initiative In Summary. Source: https://www.cbp.gov/sites/default/files/documents/csi brochure 2011 3.pdf. Accessed: 14-06-2016
77. H. Vogel. Vehicles, containers, railway wagons, European Journal of Radiology 63(2) (2007), 254-262
78. S.-Y. Wan, and W.E. Higgins. Symmetric region growing. IEEE Transactions on Image processing 12(9) (2003), 1007-1015
79. T.A. White, O.P. Bredt, J.E. Schweppe, and R.C. Runkle. Development of a detector model for generation of synthetic radiographs of cargo containers, Nuclear Instruments, and Methods in Physics Research Section B: Beam Interactions with Materials, and Atoms 266(9) (2008), 2079-2089
80. D.F. Wiley, D. Ghosh, and C. Woodhouse. Automatic segmentation of CT scans of checked baggage. In: Proceedings International Meeting on Image Formation in X-ray CT, (2012), 310-313
81. Y.O. Yildiz, D.Q. Abraham, S. Agaian, and K. Panetta, 3D Threat Image Projection. In: Proceedings SPIE, 6805 (2008), 1-8
82. G. Zhang, L. Zhang, and Z. Chen. An H-L curve method for material discrimination of dual energy X-ray inspection systems. In: IEEE Proceedings Nuclear Science Symposium 1 (2005), 326-328
83. J. Zhang, L. Zhang, Z. Zhao, Y. Liu, J. Gu, Q. Li, and D. Zhang. Joint shape, and texture based X-ray cargo image classification. In: Proceedings IEEE Conference on Computer Vision, and Pattern Recognition Workshop, (2014), 266-273
84. Y. Zheng, and A. Elmaghraby. Avehicle threat detection system using correlation analysis, and synthesized X-ray images. In: Proceedings SPIE, 8709 (2013), 1-10