Share your thoughts, 1 month free Claude Pro on usSee more

Reading Comprehension Accuracy on RACE

89.95Accuracy

Qwen-1.5 14B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-1.5 14B 2024.07		89.95
Qwen-1.5 14B 2024.07		89.95
Qwen-1.5 7B 2024.07		85.78
Qwen-1.5 7B 2024.07		85.78
DDK 2024.07		82.53
DDK 2024.07		82.53
PoE 2025.12		81.39
ALBM 2025.12		80.69
DIR 2025.12		80.32
LP 2025.12		80.3
Qwen-1.5 4B 2024.07		80.17
Qwen-1.5 4B 2024.07		80.17
KD 2024.07		80.13
KD 2024.07		80.13
CPT 2024.07		79.56
CPT 2024.07		79.56
MiniLLM 2024.07		79.22
MiniLLM 2024.07		79.22
Base 2025.12		79.21
LP 2025.12		78.9
SK 2025.12		78.82
InfoRM 2025.12		78.72
DDK 2024.07		71.5
DDK 2024.07		71.4
DDK 2024.07		71.27
DDK 2024.07		70.98
DDK 2024.07		70.84
KD 2024.07		69.86
Qwen-1.5 1.8B 2024.07		69.57
Qwen-1.5 1.8B 2024.07		69.57
DDK 2024.07		69.4
MiniLLM 2024.07		69.1
CPT 2024.07		69
Base 2025.12		66.5
InfoRM 2025.12		65.2
DIR 2025.12		62.02
PoE 2025.12		60.03
Mixtral 2024.07		59.2
Llama 3 2024.07		59
ALBM 2025.12		59
Llama 3 2024.07		58.1
Llama 3 2024.07		54.3
SK 2025.12		53.89
Mistral 2024.07		53
SD-MoE 2026.02		51.48
Qwen 2026.02		50.65
SD-MoE 2026.02		50.61
DeepSeek 2026.02		50.51
SD-MoE 2026.02		50.06
Gemma 2024.07		48.8
Qwen 2026.02		48.54
Nemotron-4 15B + MaskLLM 2024.09		45.45
LLaMA-2 7B (Dense) 2024.09		44.11
LLaMA-2 13B + MaskLLM 2024.09		41.24
LLaMA-2 7B + MaskLLM 2024.09		40.77
Llama3 8B 2025.09		40.3
Llama3 8B 2026.02		40.3
COMPOT 2026.02		40.1
Llama 3.2 3B 2025.08		40
Matrix PCA 2025.08		40
SVD-LLM 2025.08		39.6
Matrix PCA 2025.08		39.3
Llama 3.1 8B 2025.08		39.3
Llama2 7B 2025.09		39.2
CoSpaDi (per-layer) 2025.09		39
SVD-LLM 2025.08		38.6
COMPOT 2026.02		38.4
CoSpaDi (grouped) 2025.09		38.3
CoSpaDi 2025.09		38.2
DLM 2026.01		37.8
Llama 3.2 1B 2025.08		37.8
DLM + extra token 2026.01		37.61
DLM + GA 2026.01		37.42
SVD-LLM 2025.08		37.3
CoSpaDi (per-layer) 2025.09		36.8
SVD-LLM 2025.09		36.6
COMPOT 2026.02		36.6
SVD-LLM 2025.08		36.5
CoSpaDi 2025.09		36.2
CoSpaDi (grouped) 2025.09		35.9
Matrix PCA 2025.08		35.6
ReplaceMe 2025.09		35.4
ReplaceMe 2026.02		35.4
LLM-Pruner 2025.09		35.1
LLM-Pruner 2026.02		35.1
Basis Sharing 2025.09		34.9
SVD-LLM 2025.09		34.7
Matrix PCA 2025.08		34.2
DLM + GA 2026.01		34.07
ReplaceMe 2025.09		34
ReplaceMe 2026.02		34
GPT3 2B + MaskLLM 2024.09		33.88
DLM + extra token 2026.01		33.79
Qwen3-0.6B 2026.02		33.7
DLM + GA 2026.01		33.68
CoSpaDi (per-layer) 2025.09		33.4
CoSpaDi (grouped) 2025.09		33.2
COMPOT† 2026.02		33
DLM + extra token 2026.01		32.73
COMPOT 2026.02		32.7

Showing 100 of 151 rows