Title: Fake face detection in video using shallow deep learning architectures

Authors: Hai Thanh Nguyen; Tinh Cong Dao; Thao Minh Nguyen Phan; Tai Tan Phan

Addresses: College of Information and Communication Technology, Can Tho University, Can Tho, Vietnam ' College of Information and Communication Technology, Can Tho University, Can Tho, Vietnam ' College of Information and Communication Technology, Can Tho University, Can Tho, Vietnam ' College of Information and Communication Technology, Can Tho University, Can Tho, Vietnam

Abstract: Deep learning techniques have been used in various disciplines, ranging from simple data processing to complicated image classification tasks. Deepfakes is a deep learning approach with benefits and drawbacks impacting the world. However, deepfakes are now cutting-edge technology being exploited for nefarious purposes such as the breach of human privacy and identity. Because deep learning is advancing rapidly daily, people use AI to produce deepfakes videos and images. Hence newer AI technology to detect deepfakes is critical. Therefore, the study has proposed detecting video and image deepfakes based on convolutional neural network (CNN) combined with the long short-term memory (LSTM) model, which constructs a deep learning model classifying images and video deepfakes. The proposed model investigated a novel approach to research more powerful models which can be applied to any large dataset. The experimental results demonstrated that the proposed method had achieved promising performance on modified datasets from Celeb-DF with high AUC performance up to 0.7584 and MCC reaching 0.558. Besides, this paper presents brief research on creating and detecting the image and video deepfakes technologies and points out the challenges of using deepfakes in many different contexts.

Keywords: deepfakes; deep learning; convolutional neural network; CNN; long short-term memory; LSTM; deepfake detection.

DOI: 10.1504/IJISTA.2022.128528

International Journal of Intelligent Systems Technologies and Applications, 2022 Vol.20 No.6, pp.469 - 486

Received: 31 Jan 2022
Accepted: 19 Aug 2022
Published online: 25 Jan 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article