Share your thoughts, 1 month free Claude Pro on usSee more

Commonsense Reasoning on CommonsenseQA (val)

82.06Accuracy

Qwen-1.5 14B (Teacher)

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-1.5 14B (Teacher) 2024.07		82.06
TAIA 2024.05		80.1
TAIA 2024.05		78.84
Qwen1.5-7B 2024.05		78.3
TAIA 2024.05		77.56
TAIA 2024.05		77.48
LoRA 2024.05		77.31
TAIA 2024.05		77.31
MOLORA 2024.05		77.15
MOLORA 2024.05		76.9
TAIA 2024.05		75.92
LoRA 2024.05		75.68
MOLORA 2024.05		75.59
LLaMA3-8B 2024.05		73.71
TAIA 2024.05		73.22
LoRA 2024.05		72.65
MOLORA 2024.05		71.74
TAIA 2024.05		71.25
LoRA 2024.05		67.98
TAIA 2024.05		67.73
TAIA 2024.05		67.32
Qwen-1.5 1.8B + DDK 2024.07		66.75
Qwen-1.5 1.8B + KD 2024.07		66.26
Qwen-1.5 1.8B + TED 2024.07		65.27
Qwen-1.5 1.8B + CPT & DoReMi 2024.07		65.11
MOLORA 2024.05		64.95
Qwen-1.5 1.8B + CPT 2024.07		64.78
Qwen-1.5 1.8B (Student) 2024.07		64.7
Qwen-1.5 1.8B + MiniLLM 2024.07		64.46
TAIA 2024.05		64.29
LoRA 2024.05		63.96
TAIA 2024.05		63.8
TAIA 2024.05		63.49
TAIA 2024.05		63.47
TAIA 2024.05		63.06
MOLORA 2024.05		61.55
TAIA 2024.05		60.77
MOLORA 2024.05		60.69
LoRA 2024.05		60.44
MOLORA 2024.05		58.8
Qwen1.5-1.8B 2024.05		58.39
LoRA 2024.05		58.07
LoRA 2024.05		56.43
LLaMA2-13B 2024.07		52.17
LLaMA2-7B 2024.05		48.4
TinyLLaMA-1.1B + DDK 2024.07		25.39
TinyLLaMA-1.1B + TED 2024.07		22.93
TinyLLaMA-1.1B + MiniLLM 2024.07		22.93
TinyLLaMA-1.1B + KD 2024.07		22.52
TinyLLaMA-1.1B + CPT & DoReMi 2024.07		20.88
TinyLLaMA-1.1B + CPT 2024.07		20.39
TinyLLaMA-1.1B 2024.07		19.08