Simultaneous Machine Translation

Benchmarks

Dataset Name	SOTA Method	Metric
IWSLT En-Vi 15 (test)		Average Latency (AL)0.61	22	1mo ago
IWSLT De-En 14	Offline	BLEU33	22	1mo ago
ACL60/60 En-De (eval)		BLEU100	20	1mo ago
IWSLT En-De 2014 (test)		Average Latency-2	18	1mo ago
IWSLT Vi-En 2015	BS-SiMT	BLEU26.68	18	1mo ago
MuST-C en-es v1.0 (test)	Simul-LLM	BLEU35.14	13	1mo ago
MuST-C en-de v1.0 (test)	NMT LLM Chunk SBS	BLEU27.32	13	1mo ago
ACL60/60 En-Ja (eval)		BLEU100	10	1mo ago
ACL60/60 En-Zh (eval)		BLEU100	10	1mo ago
ACL60/60 English-Japanese (En-Ja) (val)		BLEU100	10	1mo ago
NIST 2003-2006 (test)	SeqPO-SiMT	COMET Score83.37	8	1mo ago
NEWSTEST En -> Zh 2021	SeqPO-SiMT	BLEURT64.62	6	1mo ago
MUSTC En -> Zh	SeqPO-SiMT	BLEURT Score0.6746	6	1mo ago
REALSI En -> Zh	SeqPO-SiMT	BLEURT Score66.41	6	1mo ago
NEWSTEST Zh → En High Latency 2021	SeqPO-SiMT	BLEURT67.94	3	1mo ago
NEWSTEST Zh → En Low Latency 2021	SeqPO-SiMT	BLEURT66.67	3	1mo ago
COVOST Zh → En High Latency	SeqPO-SiMT	BLEURT63.28	3	1mo ago
COVOST Zh → En Low Latency	SeqPO-SiMT	BLEURT63.01	3	1mo ago
REALSI Zh → En High Latency	SeqPO-SiMT	BLEURT66.24	3	1mo ago
REALSI Zh → En Low Latency	SeqPO-SiMT	BLEURT65.93	3	1mo ago

Showing 20 of 20 rows