Audio Captioning

Benchmarks

Dataset Name	SOTA Method	Metric
AudioCaps (test)	LAMB	CIDEr91.1	157	5d ago
Clotho		CIDEr50.9	82	8d ago
AudioCaps	EnCLAP-large	CIDEr80.3	66	8d ago
Clotho (test)		METEOR19.7	43	5d ago
Clotho 2.1 (test)	MQ-Cap	CIDEr0.496	31	3mo ago
Clotho V2	AF-Next-Instruct	CIDEr52	11	1mo ago
AudioCaps AudioSet (test)	HTSAT-BART	SPIDEr48.5	10	3mo ago
ASFx (eval)	Whisper-Cards	SPIDEr19.36	9	3mo ago
Clotho (eval)	Audio Flamingo 3	SPIDEr31.88	9	3mo ago
ParaSpeechCaps (PSC)	Multi-Task (Ours)	Captioning Score46.01	8	2mo ago
MusicCaps	PAR (Ours-UTS)	Captioning Score23.33	8	2mo ago
Clotho V1	VAST	B@418.5	8	3mo ago
DCASE Task 6 2020 (dev test)	Ensemble	BLEU-153.7	6	3mo ago
Auto-ACD (test)	MQ-Cap	CIDEr70.4	6	3mo ago
AudioSet	SoundAtlas	LA-CLAP0.447	4	3mo ago
Song Describer (SD)		SBERT Similarity0.469	4	2mo ago
MusicCaps (MC) non-vocal		SBERT Similarity0.478	4	3mo ago
Clotho Caption	Wavcaps	CIDEr48.8	4	3mo ago
AudioCaps (val)	Ours	CIDEr64	4	3mo ago
Clotho Caps (test)	X-InstructBLIP	Score29.4	4	3mo ago
AutoACD	MiDashengLM	FENSE Score66.52	3	2mo ago
MECAT	MiDashengLM	FENSE Content Long Score60.11	3	2mo ago
MUGEN-GAME (unseen)	MMGPT	BLEU-46.7	3	3mo ago
AudioCaps	SoundAtlas	MWR-S (MLLM)0.75	3	3mo ago
VGGSound	SoundAtlas	LA-CLAP0.461	3	3mo ago

Showing 25 of 27 rows