Vision of the unseen: Current trends and challenges in digital image and video forensics

ACM Computing Surveys

Volumn 43, Issue 4, 2011, Pages

  Rocha, Anderson ^a   Scheirer, Walter ^b   Boult, Terrance ^b   Goldenstein, Siome ^a  

^a UNIVERSITY OF CAMPINAS   (Brazil)

^b UNIVERSITY OF COLORADO   (United States)

Author keywords

Forgery and fraud detection; Hidden messages detection; Image and video forensics; Image and video source identification; Legal aspects

Indexed keywords

FRAUD DETECTION; HIDDEN MESSAGES; IMAGE AND VIDEO FORENSICS; LEGAL ASPECTS; VIDEO SOURCES;

CAMERAS; COMPUTER CRIME; COMPUTER GRAPHICS; CRIME; IMAGING SYSTEMS; STEGANOGRAPHY; TELECOMMUNICATION EQUIPMENT;

IMAGE PROCESSING;

EID: 80155180685     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/1978802.1978805     Document Type: Article

References (114)

1. ANDERSON, R. AND PETITCOLAS, F. 1998. On the limits of steganography. J. Sel. Areas Comm. 16, 4, 474-481. (Pubitemid 128564967)
2. AVCIBAS, I., KHARRAZI, M., MEMON, N., AND SANKUR, B. 2005. Image steganalysis with binary similarity measures. J. Appl. Sig. Proc. 2749-2757. (Pubitemid 44178258)
3. AVCIBAS, I., MEMON, N., AND SANKUR, B. 2003. Steganalysis using image quality metrics. IEEE Trans. Image Proc. 12, 221-229.
4. BAYRAM, S., AVCIBAS, I., SANKUR, B., AND MEMON, N. 2006a. Image manipulation detection. J. Elect. Imag. 15, 4, 1-17.
5. BAYRAM, S., SENCAR, H., AND MEMON, N. 2005. Source camera identification based on CFA interpolation. In Proceedings of the International Conference on Image Processing. IEEE.
6. BAYRAM, S., SENCAR, H., AND MEMON, N. 2006b. Improvements on source camera-model identiciation based on CFA interpolation. In Proceedings of the International Conference on Digital Forensics. IFIP.
7. BOHME, R. 2008. Weighted stego-image steganalysis for JPEG covers. In Proceedings of the International Workshop in Information Hiding. Springer.
8. BROAD, W. J. The New York Times, May 4th, 2009. A battle to preserve a visionary? bold failure. http://www.nytimes.com/2009/05/05/science/05tesla.html.
9. CASS, S. 2003. Listening in. IEEE Spectrum 40, 4, 32-37.
10. CASTRO, E. D. AND MORANDI, C. 1987. Registration of translated and rotated images using finite fourier transforms. IEEE Trans. Patt. Anal. Mach. Intell. 9, 700-703.
11. CELIKTUTAN, O., AVCIBAS, I., SANKUR, B., AND MEMON, N. 2005. Source cell-phone identification. In Proceedings of the International Conference on Advanced Computing and Communication. Computer Society of India, Tamil Nadu, India.
12. CHANDRAMOULI, R. AND SUBBALAKSHMI, K. P. 2004. Current trends in steganalysis: A critical survey. In Proceedings of the International Conference on Control, Automation, Robotics and Vision. IEEE. 964-967. (Pubitemid 40893686)
13. CHEN, M., FRIDRICH, J., GOLJAN, M., AND LUKAS, J. 2007a. Source digital camcorder identification using sensor photo-response non-uniformity. In Proceedings of the SPIE Photonics West. SPIE, 1G-1H.
14. CHEN, M., FRIDRICH, J., LUKAS, J., AND GOLJAN, M. 2007b. Imaging sensor noise as digital x-ray for revealing forgeries. In Proceedings of the International Workshop in Information Hiding. Springer.
15. CHEN, X., WANG, Y., TAN, T., AND GUO, L. 2006. Blind image steganalysis based on statistical analysis of empirical matrix. In Proceedings of the International Conference on Pattern Recognition. IAPR, 1107-1110. (Pubitemid 46553314)
16. CHOI, K. S., LAM, E., AND WONG, K. 2006. Automatic source camera identification using the intrinsic lens radial distortion. Optics Express 14, 24, 11551-11565. (Pubitemid 44826839)
17. COE, B. 1990. The Birth of Photography: The Story of the Formative Years, 1800-1900 1st Ed. Book Sales.
18. COLUMBIA DVMM RESEARCH LAB. 2004. Columbia image splicing detection evaluation data set. http://www.ee.columbia.edu/ln/dvmm/downloads/ AuthSplicedDataSet/AuthSplicedDataSet.htm.
19. COX, I. J., MILLER, M. L., BLOOM, J. A., FRIDRICH, J., AND KALKER, T. 2008. Digital Watermarking and Steganography 2nd Ed. Morgan-Kauffman.
20. DEBEVEC, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and imge-based graphics with global illumination and high dynamic range photograph. In Proceedings of ACM SIGGRAPH. ACM, 189-198.
21. DEHNIE, S., SENCAR, T., AND MEMON, N. 2006. Identification of computer generated and digital camera images for digital image forensics. In Proceedings of the International Conference on Image Processing. IEEE.
22. DIRIK, A., SENCAR, H., AND MEMON, N. 2008. Digital single lens reflex camera identification from traces of sensor dust. IEEE Trans. Inf. Foren. and Security 3, 3, 539-552.
23. DIRIK, E., BAYRAM, S., SENCAR, T., AND MEMON, N. 2007. New features to identify computer generated images. In Proceedings of the International Conference on Image Processing. IEEE.
24. DUMITRESCU, S., WU, X., AND MEMON, N. 2002. On steganalysis of random LSB embedding in continuoustone images. In Proceedings of the International Conference on Image Processing. Vol. 3. IEEE, 641-644.
25. FARID, H. 2006a. Digital doctoring: How to tell the real from the fake. Significance 3, 4, 162-166. (Pubitemid 44826145)
26. FARID, H. 2006b. Exposing digital forgeries in scientific images. In Proceedings of the Multimedia and Security Workshop. ACM.
27. FARID, H. 2009. Image forgery detection. IEEE Signal Process. Mag. 26, 2, 16-25.
28. Folha de São Paulo. April 5th, 2009. http://www1.folha.uol.com.br/ fsp/brasil/fc0504200906.htm (In Portuguese).
29. FOLHA DE SÃO PAULO. March 10th, 2008. Para agência dos EUA, Abadía traficou no Brasil. http://www1. folha.uol.com.br/fsp/cotidian/ ff1003200801.htm (In Portuguese).
30. FRIDRICH, J. 2004. Feature-based steganalysis for JPEG images and its implications for future design of steganographic schemes. In Proceedings of the International Workshop in Information Hiding. Springer, 67-81. (Pubitemid 39745168)
31. FRIDRICH, J., GOLJAN, M., AND DU, R. 2001. Detecting LSB steganography in color and grayscale images. IEEE Multimed. 8, 22-28. (Pubitemid 33018249)
32. FRIDRICH, J., HOGEA, D., AND GOLJAN, M. 2002. Steganalysis of jpeg images: Breaking the f5 algorithm. In Proceedings of the International Workshop in Information Hiding. Springer, 310-323.
33. FRIDRICH, J., SOUKAL, D., AND LUKAS, J. 2003. Detection of copy-move forgery in digital images. In Proceedings of the Digital Forensic Research Workshop. DFRWS.
34. FU, D., SHI, Y., ZOU, D., AND XUAN, G. 2006. JPEG steganalysis using empirical transition matrix in block DCT domain. In Proceedings of the International Workshop on Multimedia and Signal Processing. IEEE, 310-313.
35. GALLAGHER, A. AND CHEN, T. 2008. Image authentication by detecting traces of demosaicing. In Proceedings of the International CVPR Workshop on Vision of the Unseen. IEEE.
36. GERADTS, Z., BIJHOLD, J., KIEFT, M., KURUSAWA, K., KUROKI, K., AND SAITOH, N. 2001. Methods for identification of images acquired with digital cameras. In Enabling Technologies for Law Enforcement and Security. Vol. 4232. SPIE.
37. GLOE, T., KIRCHNER, M., WINKLER, A., AND BOHME, R. 2007. Can we trust digital image forensics? In Proceedings of the ACM Conference on Multimedia. ACM, 78-86.
38. GOLDENSTEIN, S. AND ROCHA, A. 2009. High-profile forensic analysis of images. In Proceedings of the International Conference on Imaging for Crime Detection and Prevention. IET, 1-6.
39. GOLJAN, M. AND FRIDRICH, J. 2008. Camera identification from scaled and cropped images. In Proceedings of the SPIE Electronic Imaging, Forensics, Security, Steganography, and Watermarking of Multimedia Contents. SPIE, OE-1-OE-13.
40. GOLJAN, M., FRIDRICH, J., AND LUKAS, J. 2008. Camera identification from printed images. In Proceedings of the SPIE Electronic Imaging, Forensics, Security, Steganography, and Watermarking of Multimedia Contents. SPIE, OI-1-OI-12.
41. GONZALEZ, R. AND WOODS, R. 2007. Digital Image Processing 3rd Ed. Prentice-Hall, Upper Saddle River, NJ.
42. HART, S. V. 2004. Forensic examination of digital evidence: a guide for law enforcement. Tech. rep. NCJ 199408, National Institute of Justice NIJ-US, Washington DC.
43. HE, J., LIN, Z., WANG, L., AND TANG, X. 2006. Detecting doctored JPEG images via DCT coefficient analysis. In Proceedings of the European Conference on Computer Vision. Springer, 423-435. (Pubitemid 44029695)
44. HERALD SUN. March 11th, 2008. Hello Kitty was drug lord's messenger. http://www.news.com.au/heraldsun/story/0, 21985, 23354813-5005961, 00.html.
45. HWANG, W.-S. ET AL. 2005. Patient-specific embryonic stem cells derived from human SCNT blastocysts. Science 308, 1777-1783.
46. JOHNSON, M. K. AND FARID, H. 2005. Exposing digital forgeries by detecting inconsistencies in lighting. In Proceedings of the ACM Multimedia and Security Workshop. ACM, New York.
47. JOHNSON, M. K. AND FARID, H. 2007a. Exposing digital forgeries in complex lighting environments. IEEE Trans. Inf. Foren. Sec. 2, 3, 450-461. (Pubitemid 47290579)
48. JOHNSON, M. K. AND FARID, H. 2007b. Exposing digital forgeries through specular highlights on the eye. In Proceedings of the International Workshop in Information Hiding. Springer.
49. JOHNSON, N. F. AND JAJODIA, S. 1998. Steganalysis of images created using current steganography software. In Proceedings of the International Workshop in Information Hiding. Springer.
50. KAVANGH, E. 2006. Editorial expression of concern. Science 311, 36-37.
51. KER, A. 2007a. The ultimate stegoanalysis benchmark? In Proceedings of the International Conference on Multimedia & Security. ACM, New York, 141-148.
52. KER, A. D. 2007b. Optimally weighted least-squares steanalysis. In Proceedings of the Symposium on Steganography and Watermaking of Multimedia Contents. SPIE.
53. KHARRAZI, M., SENCAR, H., AND MEMON, N. 2004. Blind source camera identification. In Proceedings of the International Conference on Image Processing. IEEE.
54. KUMAGAI, J. 2003. Mission impossible? IEEE Spectrum 40, 4, 26-31.
55. KUROSAWA, K., KUROKI, K., AND SAITOH, N. 1999. CCD fingerprint method. In Proceedings of the International Conference on Image Processing. IEEE.
56. LIN, S., GU, J., YAMAZAKI, S., AND SHUM, H.-Y. 2004. Radimetric calibration from a single image. In Proceedings of the International Conference on Computer Vision and Pattern Recognition. IEEE, 938-945.
57. LIN, Z., WANG, R., TANG, X., AND SHUM, H.-Y. 2005. Detecting doctored images using camera response normality and consistency. Proceedings of the International Conference on Computer Vision and Pattern Recognition. IEEE.
58. LONG, Y. AND HUANG, Y. 2006. Image based source camera identification using demosaicing. In Proceedings of the International Workshop on Multimedia Signal Processing. IEEE.
59. LUKAS, J., FRIDRICH, J., AND GOLJAN, M. 2006. Digital camera identification from sensor pattern noise. IEEE Trans. Inf. Foren. Sec. 1, 2, 205-214. (Pubitemid 43824631)
60. LYU, S. AND FARID, H. 2002a. Detecting hidden messages using higher-order statistics and support vector machines. In Proceedings of the 5th International Workshop on Information Hiding. Springer, 340-354.
61. LYU, S. AND FARID, H. 2002b. Detecting hidden messages using higher-order statistics and support vector machines. In Proceedings of the International Workshop in Information Hiding. Springer, 340-354.
62. LYU, S. AND FARID, H. 2004. Steganalysis using color wavelet statistics and one-class support vector machines. In Proceedings of the Symposium on Electronic Imaging. SPIE.
63. LYU, S. AND FARID, H. 2005. How realistic is photorealistic? IEEE Trans. Sig. Proc. 53, 2, 845-850. (Pubitemid 40181778)
64. LYU, S. AND FARID, H. 2006. Steganalysis using higher-order image statistics. IEEE Trans. Inf. Foren. Sec. 1, 111-119.
65. MARIEN, M. W. 2006. Photography: A Cultural History 2nd Ed. Prentice Hall,-.
66. MORRIS, E. The New York Times, July 11th, 2008. Photography as a weapon. http://morris.blogs.nytimes.com/2008/08/11/photography-as-a-weapon/index.html.
67. MORRIS, S. 2004. The future of netcrime now: Part 1-Threats and challenges. Tech. rep. 62/04, Home Office Crime and Policing Group, Washington DC.
68. NEMER, E., GOUBRAN, R., AND MAHMOUD, S. 2001. Robust voice activity detection using higher-order statistics in the LPC residual domain. IEEE Trans. Speech Audio Process. 9, 3, 217-231. (Pubitemid 32300847)
69. NG, T.-T. AND CHANG, S.-F. 2004. Blind detection of photomontage using higher order statistics. In Proceedings of the International Symposium on Circuits and Systems. IEEE, 688-691.
70. NG, T.-T. AND CHANG, S.-F. 2009. Identifying and prefiltering images. IEEE Signal Process. Mag. 26, 2, 49-58.
71. NG, T.-T., CHANG, S.-F., LIN, C.-Y., AND SUN, Q. 2006. Multimedia Security Technologies for Digital Rights Management. Academic Press, 1-30.
72. NG, T.-T., CHANG, S.-F., AND TSUI, M.-P. 2005. Physics-motivated features for distinguishing photographic images and computer graphics. In Proceedings of ACM Multimedia Conference. ACM, 239-248.
73. NHTCU. 2008. National high tech crime unit. www.nhtcu.org.
74. NILLIUS, P. AND EKLUNDH, J.-O. 2001. Automatic estimation of the projected light source direction. In Proceedings of the International Conference on Computer Vision and Pattern Recognition. IEEE, 1076-1082.
75. NIZZA, M. AND WITTY, P. The New York Times, July 10th, 2008. In an Iranian image, a missile too many. http://thelede.blogs.nytimes.com/2008/07/10/ in-an-iranian-image-a-missile-too-many.
76. PEARSON, H. 2005. Image manipulation: CSI: Cell biology. Nature 434, 952-953.
77. PETITCOLAS, F. A. P., ANDERSON, R. J., AND KUHN, M. G. 1998. Attacks on copyright marking systems. In Proceedings of the International Workshop in Information Hiding. Springer, 219-239.
78. PEVNY, T. AND FRIDRICH, J. 2005. Toward multi-class blind steganalyzer for JPEG images. In Proceedings of the International Workshop on Digital Watermarking. Springer, 39-53.
79. POPESCU, A. C. 2004. Statistical tools for digital image forensics. Ph. D. dissertation, Department of Computer Science - Dartmouth College. Hanover, NH.
80. POPESCU, A. C. AND FARID, H. 2004a. Exposing digital forgeries by detecting duplicated image regions. Tech. rep. TR 2004-515, Department of Computer Science, Dartmouth College. Hanover, NH.
81. POPESCU, A. C. AND FARID, H. 2004b. Statistical tools for digital forensics. In Proceedings of the International Workshop in Information Hiding. Springer.
82. POPESCU, A. C. AND FARID, H. 2005a. Exposing digital forgeries by detecting traces of re-sampling. IEEE Trans. Sig. Process. 53, 2, 758-767. (Pubitemid 40181769)
83. POPESCU, A. C. AND FARID, H. 2005b. Exposing digital forgeries in color filter array interpolated images. IEEE Trans. Sig. Process. 53, 10, 3948-3959. (Pubitemid 41638246)
84. PROVOS, N. 2001. Defending against statistical steganalysis. In Proceedings of the USENIX Security Symposium. Vol. 10. USENIX, 24-36.
85. PROVOS, N. AND HONEYMAN, P. 2001. Detecting steganographic content on the internet. Department of Computer Science - University of Michigan, Ann Arbor, CITI 01-11.
86. ROCHA, A. AND GOLDENSTEIN, S. 2006. Progressive randomization for steganalysis. In Proceedings of the International Workshop on Multimedia and Signal Processing. IEEE, 314-319. (Pubitemid 46948560)
87. ROCHA, A. AND GOLDENSTEIN, S. 2007. PR: More than meets the eye. In Proceedings of the International Conference on Computer Vision. IEEE, 1-8.
88. ROCHA, A. AND GOLDENSTEIN, S. 2008. Steganography and steganalysis in digital multimedia: Hype or hallelujah? J. Theoret. Appl. Comput. 15, 1, 83-110.
89. ROCHA, A. AND GOLDENSTEIN, S. 2010. Progressive randomization: seeing the unseen. Comput. Vis. Image Understand. 114, 3, 349-362.
90. ROCHA, A., SCHEIRER, W., GOLDENSTEIN, S., AND BOULT, T. E. 2008. The unseen challenge data sets. In Proceedings of the International CVPR Workshop on Vision of the Unseen. IEEE, 1-8.
91. RODRIGUEZ, B., PETERSON, G., AND AGAIAN, S. 2007. Steganography anomaly detection using simple one-class classification. In Mobile Multimedia/Image Processing for Military and Security Applications. SPIE, 65790E.1-65790E.9.
92. SACCHI, D. L. M., AGNOLI, F., AND LOFTUS, E. F. 2007. Changing history: Doctored photographs affect memory for past public events. Appl. Cogn. Psych. 21, 8, 249-273.
93. SENCAR, T. AND MEMON, N. 2008. Statistical Science and Interdisciplinary Research. World Scientific Press, Mountain View, CA, (Chapter Overview of State-of-the-art in Digital Image Forensics).
94. SHI, J. AND MALIK, J. 2000. Normalized cuts and image segmentation. IEEE Trans. Patt. Anal. Mach. Intell. 22, 8(Aug.), 888-905.
95. SHI, L., FEN, S. A., AND XIAN, Y. Y. 2003. A LSB steganography detection algorithm. In Personal, Indoor and Mobile Radio Communications. Vol. 3. IEEE, 2780-2783.
96. SHI, Y. Q., CHEN, C., AND CHEN, W. 2007. A natural image model approach to splicing detection. In Proceedings of the ACM Multimedia and Security Workshop. ACM, 51-62. (Pubitemid 351203804)
97. SHI, Y. Q., XUAN, G., ZOU, D., GAO, J., YANG, C., ZHANG, Z., CHAI, P., CHEN, W., AND CHEN, C. 2005. Image steganalysis based on moments of characteristic functions and wavelet decomposition, prediction, errorimage, and neural network. In Proceedings of the International Conference on Multimedia and Expo. IEEE, 268-272.
98. SUN, J., YUAN, L., JIA, J., AND SHUM, H.-Y. 2005. Image completion with structure propagation. ACM Trans. Graph. 24, 3, 861-868.
99. SUTCU, Y., BAYARAM, S., SENCAR, H., AND MEMON, N. 2007. Improvements on sensor noise based source camera identification. In Proceedings of the International Conference on Multimedia and Expo. IEEE.
100. SWAMINATHAN, A., WU, M., AND LIU, K. R. 2006. Non-instrusive forensics analysis of visual sensors using output images. In Proceedings of the International Conference on Image Processing. IEEE.
101. SWAMINATHAN, A., WU, M., AND LIU, K. R. 2009. Component forensics. IEEE Sig. Process. Mag. 26, 2, 38-48.
102. TSAI, M. AND WU, G. 2006. Using image features to identify camera sources. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. IEEE.
103. USPS. 2003. USPS - US Postal Inspection Service. www.usps.com/ postalinspectors/ar01intr.pdf.
104. VAIDYANATHAN, P. P. 1987. Quadrature mirror filter banks, m-band extensions and perfect reconstruction techniques. IEEE Sig. Process. Mag. 4, 3, 4-20. (Pubitemid 17650867)
105. WALLICH, P. 2003. Getting the message. IEEE Spectrum 40, 4, 38-40.
106. WANG, W. 2009. Digital video forensics. Ph. D. dissertation. Department of Computer Science, Dartmouth College, Hanover, NH.
107. WANG, W. AND FARID, H. 2007a. Exposing digital forgeries in interlaced and deinterlaced video. IEEE Trans. Inf. Foren. Sec. 2, 438-449. (Pubitemid 47290578)
108. WANG, W. AND FARID, H. 2007b. Exposing digital forgeries in video by detecting duplication. In Proceedings of the ACM Multimedia and Security Workshop. ACM.
109. WANG, Y. AND MOULIN, P. 2006. On discrimination between photorealistic and photographic images. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. IEEE.
110. WESTFELD, A. 2001. F5-A steganographic algorithm high capacity despite better steganalysis. In Proceedings of the International Workshop in Information Hiding. Vol. 2137. Springer, 289-302. (Pubitemid 33367674)
111. WESTFELD, A. AND PFITZMANN, A. 1999. Attacks on steganographic systems. In Proceedings of the International Workshop in Information Hiding. Springer, 61-76.
112. XUAN, G., GAO, J., SHI, Y., AND ZOU, D. 2005. Image steganalysis based on statistical moments of wavelet subband histograms in DFT domain. In Proceedings of the International Workshop on Multimedia Signal Processing. IEEE, 1-4.
113. XUAN, G., SHI, Y., HUANG, C., FU, D., ZHU, X., CHAI, P., AND GAO, J. 2006. Steganalysis using high-dimensional features derived from co-occurrence matrix and class-wise non-principal components analysis (CNPCA). In Proceedings of the International Workshop on Digital Watermarking. IEEE, 49-60. (Pubitemid 44891625)
114. YU, H., NG, T.-T., AND SUN, Q. 2008. Recaptured photo detection using specularity distribution. In Proceedings of the International Conference on Image Processing. IEEE.