Share your thoughts, 1 month free Claude Pro on usSee more

Response Generation on SIMMC 2.1 (test)

33.77BLEU-1

SiPeR

Updated 1mo ago

Evaluation Results

Method	Links
SiPeR 2026.04		33.77	21.67	32.61	25.52	8.92
w/o BI-INF 2026.04		31.32	19.88	29.31	23.14	8.62
w/o STE 2026.04		30.28	19.45	28.21	22.99	8.45
GPT-4o 2026.04		30.24	14.52	20.85	18.62	7.24
Qwen2.5-VL 2026.04		29.77	19.31	24.87	21.91	8.05
GPT-4o 2026.04		27.7	13.92	21.69	20.52	7.56
LLaVA-NeXT 2026.04		27.13	18.88	22.89	20.25	7.82
ReGeS 2026.04		23.64	19.78	22.61	19.61	7.52
Qwen2.5-VL 2026.04		22.28	11.3	19.3	16.86	6.15
LLaVA-NeXT 2026.04		21.89	10.15	18.67	15.55	5.92
ALBEF 2026.04		21.65	10.18	17.02	15.41	6.75
Qwen2.5-VL 2026.04		19.85	10.64	15.88	12.72	5.85
LLaVA-NeXT 2026.04		18.42	8.51	15.62	12.58	5.64