Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks

About

Artefacts that differentiate spoofed from bona-fide utterances can reside in spectral or temporal domains. Their reliable detection usually depends upon computationally demanding ensemble systems where each subsystem is tuned to some specific artefacts. We seek to develop an efficient, single system that can detect a broad range of different spoofing attacks without score-level ensembles. We propose a novel heterogeneous stacking graph attention layer which models artefacts spanning heterogeneous temporal and spectral domains with a heterogeneous attention mechanism and a stack node. With a new max graph operation that involves a competitive mechanism and an extended readout scheme, our approach, named AASIST, outperforms the current state-of-the-art by 20% relative. Even a lightweight variant, AASIST-L, with only 85K parameters, outperforms all competing systems.

Jee-weon Jung, Hee-Soo Heo, Hemlata Tak, Hye-jin Shim, Joon Son Chung, Bong-Jin Lee, Ha-Jin Yu, Nicholas Evans• 2021

Related benchmarks

TaskDatasetResultRank
Spoof Speech DetectionASVspoof LA 2021 (eval)
min-tDCF0.3398
36
Audio Deepfake DetectionASVspoof DF 2021
EER2.77
35
Audio Spoofing DetectionASVspoof Logical Access 2019 (Evaluation)
EER0.83
30
Audio Deepfake DetectionASVspoof LA 2021
EER0.82
23
Audio Deepfake DetectionADD-C 1.0s duration (test)
C0 Score8.55
12
Audio Deepfake DetectionADD-C 2.0s duration (test)
Class 0 Score2.7
12
Audio Deepfake DetectionADD-C 0.5s duration (test)
C0 Score9.6
12
Audio Deepfake DetectionADD-C 1.5s duration (test)
C0 Score2.55
12
Spoofing Method IdentificationMixed In-Domain
Accuracy96.44
11
Authenticity ClassificationMixed In-Domain
Accuracy94.29
11
Showing 10 of 26 rows

Other info

Code

Follow for update