Fighting Deepfakes by Detecting GAN DCT Anomalies.

Generative Adversarial Networks deepfake detection image forensics multimedia forensics

Journal

Journal of imaging
ISSN: 2313-433X
Titre abrégé: J Imaging
Pays: Switzerland
ID NLM: 101698819

Informations de publication

Date de publication:
30 Jul 2021
Historique:
received: 28 05 2021
revised: 23 07 2021
accepted: 26 07 2021
entrez: 30 8 2021
pubmed: 31 8 2021
medline: 31 8 2021
Statut: epublish

Résumé

To properly contrast the Deepfake phenomenon the need to design new Deepfake detection algorithms arises; the misuse of this formidable A.I. technology brings serious consequences in the private life of every involved person. State-of-the-art proliferates with solutions using deep neural networks to detect a fake multimedia content but unfortunately these algorithms appear to be neither generalizable nor explainable. However, traces left by Generative Adversarial Network (GAN) engines during the creation of the Deepfakes can be detected by analyzing ad-hoc frequencies. For this reason, in this paper we propose a new pipeline able to detect the so-called GAN Specific Frequencies (GSF) representing a unique fingerprint of the different generative architectures. By employing Discrete Cosine Transform (DCT), anomalous frequencies were detected. The β statistics inferred by the AC coefficients distribution have been the key to recognize GAN-engine generated data. Robustness tests were also carried out in order to demonstrate the effectiveness of the technique using different attacks on images such as JPEG Compression, mirroring, rotation, scaling, addition of random sized rectangles. Experiments demonstrated that the method is innovative, exceeds the state of the art and also give many insights in terms of explainability.

Identifiants

pubmed: 34460764
pii: jimaging7080128
doi: 10.3390/jimaging7080128
pmc: PMC8404913
pii:
doi:

Types de publication

Journal Article

Langues

eng

Références

IEEE Trans Syst Man Cybern B Cybern. 2004 Dec;34(6):2405-15
pubmed: 15619939
IEEE Trans Image Process. 2000;9(10):1661-6
pubmed: 18262905
IEEE Trans Image Process. 2019 Nov;28(11):5464-5478
pubmed: 31107649

Auteurs

Oliver Giudice (O)

Department of Mathematics and Computer Science, University of Catania, 95125 Catania, Italy.

Luca Guarnera (L)

Department of Mathematics and Computer Science, University of Catania, 95125 Catania, Italy.
iCTLab s.r.l., Spinoff of University of Catania, 95125 Catania, Italy.

Sebastiano Battiato (S)

Department of Mathematics and Computer Science, University of Catania, 95125 Catania, Italy.
iCTLab s.r.l., Spinoff of University of Catania, 95125 Catania, Italy.

Classifications MeSH