Our new X account is live! Follow @wizwand_team for updates

Machine Translation on WMT En-Fr 2014 (test)

67.88BLEU

N-shot

Updated 4d ago

Evaluation Results

Method
N-shot 2024.01	67.88	-	-	-	-	-	-
Batch-ICL 2024.01	67.63	-	-	-	-	-	-
N-shot 2024.01	66.38	-	-	-	-	-	-
Batch-ICL 2024.01	65.91	-	-	-	-	-	-
mRASP 2021.05	45.4	-	-	-	-	-	-
mRASP 2021.05	44.3	-	-	-	-	-	-
BranchNorm 2023.05	44.3	-	-	-	-	-	-
BranchNorm 2023.05	44.27	-	-	-	-	-	-
BranchNorm 2023.05	44.2	-	-	-	-	-	-
RealFormer 2020.12	43.97	-	-	-	-	-	-
DeepNorm 2023.05	43.93	-	-	-	-	-	-
MixNorm 2023.05	43.91	-	-	-	-	-	-
Mesh-TensorFlow Transformer 2018.11	43.9	-	-	-	-	-	-
BranchNorm 2023.05	43.89	-	-	-	-	-	-
DeepNorm 2023.05	43.87	-	-	-	-	-	-
MixNorm 2023.05	43.81	-	-	-	-	-	-
Mesh-TensorFlow Transformer 2018.11	43.8	-	-	-	-	-	-
ADMIN 2020.12	43.8	-	-	-	-	-	-
DeepNorm 2023.05	43.79	-	-	-	-	-	-
BERT-fused model 2020.02	43.78	-	-	-	-	-	-
MixNorm 2023.05	43.73	-	-	-	-	-	-
ADMIN (re-run) 2020.12	43.72	-	-	-	-	-	-
DeepNorm 2023.05	43.67	-	-	-	-	-	-
BranchNorm 2023.05	43.53	-	-	-	-	-	-
Mesh-TensorFlow Transformer 2018.11	43.5	-	-	-	-	-	-
mRASP2 2021.05	43.5	-	-	-	-	-	-
Sub-LN 2023.05	43.42	-	-	-	-	-	-
MixNorm 2023.05	43.41	-	-	-	-	-	-
MixNorm 2023.05	43.34	-	-	-	-	-	-
Sub-LN 2023.05	43.31	-	-	-	-	-	-
Mesh-TensorFlow Transformer 2018.11	43.3	-	-	-	-	-	-
Local Joint Self-attention 2019.05	43.3	-	-	-	-	-	-
Sub-LN 2023.05	43.28	-	-	-	-	-	-
Depth Growing 2019.07	43.27	-	-	-	-	-	-
Vanilla Post-LN 2023.05	43.27	-	-	-	-	-	-
Vanilla Pre-LN 2023.05	43.25	-	-	-	-	-	-
Sub-LN 2023.05	43.21	-	-	-	-	-	-
Ott et al. (2018) 2019.05	43.2	-	-	-	-	-	-
Wu et al. (2019) 2019.05	43.2	-	-	-	-	-	-
Joint Self-attention 2019.05	43.2	-	-	-	-	-	-
Ott et al. (2018) 2018.09	43.2	-	-	-	-	-	-
DynamicConv 2020.02	43.2	-	-	-	-	-	-
Transformer-6 2021.05	43.2	-	-	-	-	-	-
Vanilla Pre-LN 2023.05	43.18	-	-	-	-	-	-
Vanilla Pre-LN 2023.05	43.12	-	-	-	-	-	-
mRASP 2021.05	43.1	-	-	-	-	-	-
Pre-LN 2020.12	43.1	-	-	-	-	-	-
DLCL 2023.05	43.05	-	-	-	-	-	-
Transformer 2020.02	43	-	-	-	-	-	-
Transformer-big 2023.05	42.98	-	-	69.58	-	-	-
Transformer 2020.02	42.96	-	-	-	-	-	-
DeepNorm 2023.05	42.92	-	-	-	-	-	-
DLCL 2023.05	42.81	-	-	-	-	-	-
Transformer 2019.07	42.73	-	-	-	-	-	-
FLOATER 2020.03	42.7	-	-	-	-	-	-
Vanilla Pre-LN 2023.05	42.7	-	-	-	-	-	-
Transformer 2019.07	42.69	-	-	-	-	-	-
Sub-LN 2023.05	42.68	-	-	-	-	-	-
Transformer 2019.07	42.63	-	-	-	-	-	-
Mesh-TensorFlow Transformer 2018.11	42.5	-	-	-	-	-	-
Vanilla Pre-LN 2023.05	42.48	-	-	-	-	-	-
FLOATER 2020.03	42.4	-	-	-	-	-	-
Fixed-length Position Embedding 2020.03	42.4	-	-	-	-	-	-
Pretrained Transformer Large 2021.03	42.2	-	-	-	-	-	-
Transformer-MoS 2018.09	42.1	-	-	-	-	-	-
T2R 2021.03	42.1	-	-	-	-	-	-
Pre-defined Sinusoidal Position Encoder 2020.03	42	-	-	-	-	-	-
Fixed-length Position Embedding 2020.03	42	-	-	-	-	-	-
m-Transformer 2021.05	42	-	-	-	-	-	-
HS-NAS 2023.10	42	0.1878	-	-	3.7	79.5	3.88
MixNorm 2023.05	41.96	-	-	-	-	-	-
RealFormer 2020.12	41.92	-	-	-	-	-	-
Mesh-TensorFlow Transformer 2018.11	41.8	-	-	-	-	-	-
Transformer 2018.11	41.8	-	-	-	-	-	-
Vaswani et al. (2017) 2018.09	41.8	-	-	-	-	-	-
Transformer 2019.07	41.8	-	-	-	-	-	-
Pre-defined Sinusoidal Position Encoder 2020.03	41.8	-	-	-	-	-	-
HAT 2020.05	41.8	-	-	-	-	-	-
ELU 2021.03	41.8	-	-	-	-	-	-
RFA 2021.03	41.8	-	-	-	-	-	-
Transformer (Vaswani et al.) 2021.03	41.8	-	-	-	-	-	-
Transformer 2018.09	41.7	-	-	-	-	-	-
NMT + MSO 2021.05	41.7	-	-	-	-	-	-
RFA 2021.03	41.7	-	-	-	-	-	-
Cascaded Encoder 2018.04	41.67	-	-	-	-	-	-
BranchNorm 2023.05	41.67	-	-	-	-	-	-
Multi-Column Encoder 2018.04	41.66	-	-	-	-	-	-
ADMIN (re-run) 2020.12	41.65	-	-	-	-	-	-
Gehring et al. (2017) 2018.09	41.62	-	-	-	-	-	-
FLOATER 2020.03	41.6	-	-	-	-	-	-
Neuron-wise MoS 2023.10	41.6	0.1841	-	-	4.53	99.4	8.77
TIE-KD 2023.05	41.57	-	-	65.06	-	-	-
NMT + MTO 2021.05	41.56	-	-	-	-	-	-
CBBGCA 2023.05	41.54	-	-	-	-	-	-
Shaw et al. (2018) 2019.05	41.5	-	-	-	-	-	-
Shaw, Uszkoreit, and Vaswani (2018) 2018.09	41.5	-	-	-	-	-	-
HAT 2023.10	41.5	0.1875	-	-	3.7	79.5	7.8
Vanilla Post-LN 2023.05	41.48	-	-	-	-	-	-
DeepNorm 2023.05	41.47	-	-	-	-	-	-
ADMIN 2020.12	41.47	-	-	-	-	-	-

Showing 100 of 237 rows