Share your thoughts, 1 month free Claude Pro on usSee more

Natural Language Understanding on GLUE (test) (CoLA, SST-2, MRPC, QQP, MNLI, QNLI, RTE)

0.5203CoLA Score

Individual

Updated 1mo ago

Evaluation Results

Method	Links
Individual 2026.04		0.5203	0.9197	0.777	0.8864	0.821	0.8794	0.6751	0.7827
Traditional MTL 2026.04		0.5168	0.9106	0.7721	0.8699	0.7833	0.8627	0.6679	0.769
Auto-FlexSwitch+MSE 2026.04		0.5119	0.9128	0.7745	0.8783	0.788	0.8699	0.6534	0.7698
Twin-merging 2026.04		0.5084	0.9174	0.7743	0.8759	0.7829	0.8706	0.6531	0.7689
Auto-FlexSwitch+CKA 2026.04		0.5075	0.9163	0.7768	0.8848	0.8011	0.8742	0.6534	0.7734
Auto-FlexSwitch+KL 2026.04		0.5068	0.9151	0.7892	0.8812	0.79	0.873	0.6498	0.7722
Auto-Switch 2026.04		0.495	0.9186	0.7549	0.8786	0.7845	0.8424	0.6531	0.761
EMR-merging 2026.04		0.4891	0.9117	0.7525	0.8383	0.8053	0.8495	0.657	0.7576
AdaMerging++ 2026.04		0.2917	0.7546	0.6814	0.5426	0.5505	0.6442	0.6143	0.5828
Ties-Merging 2026.04		0.2015	0.7489	0.674	0.6175	0.5534	0.6674	0.6534	0.588
RegMean 2026.04		0.1947	0.8876	0.6887	0.8066	0.5008	0.6877	0.6245	0.6272
AdaMerging 2026.04		0.1566	0.6823	0.6446	0.5221	0.5983	0.6189	0.617	0.5485
Task-Arithmetic 2026.04		0.1516	0.7477	0.6446	0.6165	0.5662	0.6661	0.6426	0.5765
DF-Merge 2026.04		0.1423	0.8165	0.6936	0.4668	0.5954	0.5394	0.6137	0.5525
DARE 2026.04		0.1384	0.8177	0.6005	0.5375	0.6376	0.6438	0.6318	0.5725
Fisher Merging 2026.04		0.098	0.7695	0.6446	0.6787	0.434	0.5843	0.6029	0.5446
Weight-Averaging 2026.04		0.0352	0.7351	0.6299	0.6523	0.4077	0.5713	0.5993	0.5187
Pre-trained 2026.04		-0.0454	0.492	0.625	0.622	0.3211	0.4939	0.5451	0.4362