Exposing Face-Swap Images Based on Deep Learning and ELA Detection
Open Access
- 17 November 2019
- conference paper
- conference paper
- Published by MDPI AG in Proceedings
- Vol. 46 (1), 29
- https://doi.org/10.3390/ecea-5-06684
Abstract
New developments in artificial intelligence (AI) have significantly improved the quality and efficiency in generating fake face images; for example, the face manipulations by DeepFake are so realistic that it is difficult to distinguish their authenticity—either automatically or by humans. In order to enhance the efficiency of distinguishing facial images generated by AI from real facial images, a novel model has been developed based on deep learning and error level analysis (ELA) detection, which is related to entropy and information theory, such as cross-entropy loss function in the final Softmax layer, normalized mutual information in image preprocessing, and some applications of an encoder based on information theory. Due to the limitations of computing resources and production time, the DeepFake algorithm can only generate limited resolutions, resulting in two different image compression ratios between the fake face area as the foreground and the original area as the background, which leaves distinctive artifacts. By using the error level analysis detection method, we can detect the presence or absence of different image compression ratios and then use Convolution neural network (CNN) to detect whether the image is fake. Experiments show that the training efficiency of the CNN model can be significantly improved by using the ELA method. And the detection accuracy rate can reach more than 97% based on CNN architecture of this method. Compared to the state-of-the-art models, the proposed model has the advantages such as fewer layers, shorter training time, and higher efficiency.Keywords
This publication has 5 references indexed in Scilit:
- State of the Art on Monocular 3D Face Reconstruction, Tracking, and ApplicationsComputer Graphics Forum, 2018
- Image forgery detection by semi-automatic wavelet soft-Thresholding with error level analysisExpert Systems with Applications, 2017
- Exposing Digital Image Forgeries by Illumination Color ClassificationIEEE Transactions on Information Forensics and Security, 2013
- Image Forgery Localization via Fine-Grained Analysis of CFA ArtifactsIEEE Transactions on Information Forensics and Security, 2012
- Role of facial expressions in social interactionsPhilosophical Transactions B, 2009