Inproceedings,

Deepfake video detection using spatiotemporal convolutional network and photo response non uniformity

, , and .
2022 IEEE International Conference of Computer Science and Information Technology (ICOSNIKOM), 1, IEEE, (2022)
DOI: https://doi.org/10.1109/ICOSNIKOM56551.2022.10034890

Abstract

It is important to improve the detection of deepfake videos to differentiate between real and fake videos that cause disinformation in the digital age so that a high level of accuracy is required. The purpose of deepfake video detection is to aid digital content consumers to surmount disinformation and sever real videos from fake ones. Limited by the number and quality of datasets, the time required for detection, and consistent performance evaluation i.e., the detection model cannot detect videos detected with video editing tools. This study provides a solution to this problem by using the Spatiotemporal Convolutional Network (SCN) method and Photo-Response Non-Uniformity (PRNU) analysis. The dataset used will go through pre-processing stages, extract per-frame video, detect face parts, and face cropping. Then the data is spread and modeled using RestNext50 and LSTM. This study produced 10 models using the FaceForensic, CelebDF, and DFDC datasets, and a mixture of these datasets which can then be used to analyze deepfake videos. The test results show that the deepfake detection process is faster and more accurate with an accuracy rate of up to 97.89%.

Tags

Users

  • @siopipin

Comments and Reviews