Share your thoughts, 1 month free Claude Pro on usSee more

Reading Comprehension on RACE-h (test)

89.95Accuracy

Qwen-1.5 14B (Teacher)

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-1.5 14B (Teacher) 2024.07		89.95
Gopher 2021.12		71.6
Qwen-1.5 1.8B + DDK 2024.07		71.56
Qwen-1.5 1.8B + CPT & DoReMi 2024.07		70.12
Qwen-1.5 1.8B + KD 2024.07		70.12
Qwen-1.5 1.8B + TED 2024.07		69.95
Qwen-1.5 1.8B (Student) 2024.07		69.57
Qwen-1.5 1.8B + CPT 2024.07		69
Qwen-1.5 1.8B + MiniLLM 2024.07		68.92
LLaMA2-13B 2024.07		62.85
GLaM 2021.12		49.3
GLaM 2021.12		48.7
Megatron-NLG 2021.12		47.9
GLaM 2021.12		46.9
GPT-3 2021.12		46.8
GPT-3 2021.12		45.9
GPT-3 2021.12		45.5
TinyLLaMA-1.1B + DDK 2024.07		27.76
TinyLLaMA-1.1B + MiniLLM 2024.07		24.32
TinyLLaMA-1.1B + CPT 2024.07		24.24
TinyLLaMA-1.1B + TED 2024.07		24.18
TinyLLaMA-1.1B + CPT & DoReMi 2024.07		24.04
TinyLLaMA-1.1B + KD 2024.07		23.84
TinyLLaMA-1.1B 2024.07		22.92