Audio Captioning

Benchmarks

Dataset Name	SOTA Method	Metric
AudioCaps (test)	LAMB	CIDEr91.1	222	1mo ago
Clotho		CIDEr50.9	82	1mo ago
Clotho 2.1 (test)	LoRA-MCL (annealed)	SPICE0.199	75	1mo ago
AudioCaps	EnCLAP-large	CIDEr80.3	66	2mo ago
Clotho (test)		METEOR19.7	43	1mo ago
Clotho v2 (test)	resource-efficient AAC framework	BLEU-10.602	12	1mo ago
Clotho V2	AF-Next-Instruct	CIDEr52	11	3mo ago
AudioCaps AudioSet (test)	HTSAT-BART	SPIDEr48.5	10	4mo ago
ASFx (eval)	Whisper-Cards	SPIDEr19.36	9	4mo ago
Clotho (eval)	Audio Flamingo 3	SPIDEr31.88	9	4mo ago
Clotho (evaluation)	SLAM–AAC	CIDEr-D39	8	18d ago
ParaSpeechCaps (PSC)	Multi-Task (Ours)	Captioning Score46.01	8	3mo ago
MusicCaps	PAR (Ours-UTS)	Captioning Score23.33	8	3mo ago
Clotho V1	VAST	B@418.5	8	4mo ago
AudioCaps 5 hypotheses (test)	LoRA-MCL (annealed)	Div2 Score0.735	6	1mo ago
DCASE Task 6 2020 (dev test)	Ensemble	BLEU-153.7	6	4mo ago
Auto-ACD (test)	MQ-Cap	CIDEr70.4	6	4mo ago
AudioSet	SoundAtlas	LA-CLAP0.447	4	4mo ago
Song Describer (SD)		SBERT Similarity0.469	4	4mo ago
MusicCaps (MC) non-vocal		SBERT Similarity0.478	4	4mo ago
Clotho Caption	Wavcaps	CIDEr48.8	4	4mo ago
AudioCaps (val)	Ours	CIDEr64	4	4mo ago
Clotho Caps (test)	X-InstructBLIP	Score29.4	4	4mo ago
AutoACD	MiDashengLM	FENSE Score66.52	3	4mo ago
MECAT	MiDashengLM	FENSE Content Long Score60.11	3	4mo ago

Showing 25 of 34 rows