Share your thoughts, 1 month free Claude Pro on usSee more

Natural Language Understanding on GLUE base (test)

61.21CoLA (MCC)

Auto-FlexSwitch+CKA

Updated 1mo ago

Evaluation Results

Method	Links
Auto-FlexSwitch+CKA 2026.04		61.21	92.78	88.73	91	86.79	92.15	75.45	84.02
Individual 2026.04		60.18	94.04	89.22	91.41	87.17	92.71	79.06	84.83
Auto-FlexSwitch+MSE 2026.04		58.3	92.78	88.24	90.92	86.44	92.04	74.45	83.31
Auto-FlexSwitch+KL 2026.04		58.06	93.8	88.56	91.05	86.74	91.85	75.81	83.7
Traditional MTL 2026.04		57.06	94.04	88.48	88.19	84.35	91.36	79.06	83.22
Twin-merging 2026.04		56.51	93.92	88.48	88.2	85.81	92.4	74.37	82.81
Auto-Switch 2026.04		53.39	94.26	89.21	91.29	85.47	92.49	75.09	83.03
DF-Merge 2026.04		43.23	59.29	76.47	80.19	66.15	66.58	57.04	64.14
EMR-merging 2026.04		39.34	93.58	87.01	89.87	85.78	89.53	74.73	79.98
Ties-Merging 2026.04		36.73	87.27	78.92	82.96	63.68	80.69	72.2	71.78
RegMean 2026.04		33.88	90.71	76.47	83.81	70.34	82.39	58.12	70.82
AdaMerging++ 2026.04		29.81	89.33	78.43	82.46	64.65	79.66	72.92	71.04
DARE 2026.04		29.46	84.98	79.41	82.54	57.89	75.69	67.85	68.26
Task-Arithmetic 2026.04		29.09	84.63	78.43	82.61	57.41	75.84	64.62	67.52
Weight-Averaging 2026.04		18.08	81.88	77.94	79.6	44.92	71.06	61.73	62.17
AdaMerging 2026.04		17.11	87.84	79.17	83.65	69.28	72.38	63.18	67.52
Fisher Merging 2026.04		13.16	83.83	77.45	80.26	48.75	73.66	62.45	62.79
Pre-trained 2026.04		0	49.08	31.62	36.82	31.82	50.89	47.29	35.36