TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection

Authors:Jian-Yu Jiang-Lin, Kang-Yang Huang, Ling Zou, Ling Lo, Sheng-Ping Yang, Yu-Wen Tseng, Kun-Hsiang Lin, Chia-Ling Chen, Yu-Ting Ta, Yan-Tsung Wang, Po-Ching Chen, Hongxia Xie, Hong-Han Shuai, Wen-Huang Cheng

View PDF HTML (experimental)

Abstract:Advances in generative modeling have made it increasingly easy to fabricate realistic portrayals of individuals, creating serious risks for security, communication, and public trust. Detecting such person-driven manipulations requires systems that not only distinguish altered content from authentic media but also provide clear and reliable reasoning. In this paper, we introduce TriDF, a comprehensive benchmark for interpretable DeepFake detection. TriDF contains high-quality forgeries from advanced synthesis models, covering 16 DeepFake types across image, video, and audio modalities. The benchmark evaluates three key aspects: Perception, which measures the ability of a model to identify fine-grained manipulation artifacts using human-annotated evidence; Detection, which assesses classification performance across diverse forgery families and generators; and Hallucination, which quantifies the reliability of model-generated explanations. Experiments on state-of-the-art multimodal large language models show that accurate perception is essential for reliable detection, but hallucination can severely disrupt decision-making, revealing the interdependence of these three aspects. TriDF provides a unified framework for understanding the interaction between detection accuracy, evidence identification, and explanation reliability, offering a foundation for building trustworthy systems that address real-world synthetic media threats.

Comments: CVPR 2026

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

Cite as: arXiv:2512.10652 [cs.CV]

(or arXiv:2512.10652v3 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2512.10652

arXiv-issued DOI via DataCite

Submission history

From: Jian-Yu Jiang-Lin [view email] [v1] Thu, 11 Dec 2025 14:01:01 UTC (12,547 KB) [v2] Tue, 23 Dec 2025 12:14:27 UTC (47,302 KB) [v3] Sat, 28 Mar 2026 19:49:25 UTC (46,897 KB)