Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Models

About

Face Anti-Spoofing (FAS) is essential for ensuring the security and reliability of facial recognition systems. Most existing FAS methods are formulated as binary classification tasks, providing confidence scores without interpretation. They exhibit limited generalization in out-of-domain scenarios, such as new environments or unseen spoofing types. In this work, we introduce a multimodal large language model (MLLM) framework for FAS, termed Interpretable Face Anti-Spoofing (I-FAS), which transforms the FAS task into an interpretable visual question answering (VQA) paradigm. Specifically, we propose a Spoof-aware Captioning and Filtering (SCF) strategy to generate high-quality captions for FAS images, enriching the model's supervision with natural language interpretations. To mitigate the impact of noisy captions during training, we develop a Lopsided Language Model (L-LM) loss function that separates loss calculations for judgment and interpretation, prioritizing the optimization of the former. Furthermore, to enhance the model's perception of global visual features, we design a Globally Aware Connector (GAC) to align multi-level visual representations with the language model. Extensive experiments on standard and newly devised One to Eleven cross-domain benchmarks, comprising 12 public datasets, demonstrate that our method significantly outperforms state-of-the-art methods.

Guosheng Zhang, Keyao Wang, Haixiao Yue, Ajian Liu, Gang Zhang, Kun Yao, Errui Ding, Jingdong Wang• 2025

Related benchmarks

TaskDatasetResultRank
Face Anti-SpoofingMSU-MFSD M (test)
HTER0.32
33
Face Anti-SpoofingReplay-Attack I (test)
HTER3.22
33
Face Anti-SpoofingCASIA-MFSD C (test)
HTER0.04
18
Face Anti-SpoofingOULU-NPU O (test)
HTER0.0174
14
Face Anti-SpoofingOULU-NPU CASIA-MFSD Idiap MSU-MFSD Average (test)
HTER1.33
14
Face Anti-SpoofingMSU-MFSD
HTER (%)5.63
8
Face Anti-SpoofingHiFiMask
HTER (%)28.23
8
Face Anti-SpoofingCASIA-SURF-3DMask
HTER6.18
8
Face Anti-SpoofingOULU-NPU
HTER14.86
8
Face Anti-SpoofingSIW
HTER4.02
8
Showing 10 of 15 rows

Other info

Follow for update