Share your thoughts, 1 month free Claude Pro on usSee more

Multi-task Language Understanding on MMLU (PRR)

62.5PRR

TAD

Updated 1mo ago

Evaluation Results

Method	Links
TAD 2024.08		62.5
SATRMD 2024.08		61.5
MIND 2024.08		60.2
MSP 2024.08		59.9
Mean Token Entropy 2024.08		58.6
Perplexity 2024.08		57.8
Simple Focus 2024.08		57
LookBackLens 2024.08		56.7
Focus 2024.08		56.3
CCP 2024.08		55
SAR 2024.08		49.3
Sheeps 2024.08		49.1
LUQ 2024.08		44
Semantic Entropy 2024.08		42.7
SAPLMA 2024.08		42.2
Lexical Similarity Rouge-L 2024.08		41.8
DegMat NLI Score entail. 2024.08		40.1
Ecc. NLI Score entail. 2024.08		39.9
EVL NLI Score entail. 2024.08		39.8
EigenScore 2024.08		37.1
Factoscope 2024.08		36
Semantic Density 2024.08		29.5