Share your thoughts, 1 month free Claude Pro on usSee more

Reading Comprehension on C3 (test)

77.38Accuracy

Qwen-1.5 14B (Teacher)

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-1.5 14B (Teacher) 2024.07		77.38
Qwen-1.5 1.8B + DDK 2024.07		65.53
Qwen-1.5 1.8B + KD 2024.07		63.92
Qwen-1.5 1.8B + MiniLLM 2024.07		63.37
Qwen-1.5 1.8B + TED 2024.07		63.18
Qwen-1.5 1.8B + CPT & DoReMi 2024.07		60.85
Qwen-1.5 1.8B + CPT 2024.07		60.3
Qwen-1.5 1.8B (Student) 2024.07		58.27
LLaMA2-13B 2024.07		46.03
TinyLLaMA-1.1B + DDK 2024.07		42.41
TinyLLaMA-1.1B + CPT & DoReMi 2024.07		39.02
TinyLLaMA-1.1B + CPT 2024.07		38.91
TinyLLaMA-1.1B + TED 2024.07		37.61
TinyLLaMA-1.1B + KD 2024.07		37.43
TinyLLaMA-1.1B + MiniLLM 2024.07		37.18
TinyLLaMA-1.1B 2024.07		35.24