Share your thoughts, 1 month free Claude Pro on usSee more

Relation Extraction on Zero-Shot RE WikiData (test)

91.43Hits@1

KG-Reasoner with Qwen-2.5-7B

Updated 3d ago

Evaluation Results

Method	Links
KG-Reasoner with Qwen-2.5-7B 2026.04		91.43
ToG-2.0 (ICL)(GPT-3.5-turbo) 2026.04		91
ToG with GPT 4 2026.04		88.3
ToG with GPT 3.5-Turbo 2026.04		88
LLaMA-3.3-70B + KG 2026.03		80.42
LLaMA-3.3-70B + KG 2026.04		80.42
KG-Hopper w/Qwen-2.5-7B 2026.03		78.64
DeepSeek-R1-Distill-Llama-70B + KG 2026.03		78.04
DeepSeek-R1-Distill-Llama-70B + KG 2026.04		78.04
GPT-4o-mini + KG 2026.03		75.12
GPT-4o-mini + KG 2026.04		75.12
Qwen-2.5-7B (SFT) + KG 2026.03		71.46
Qwen-2.5-7B (SFT) + KG 2026.04		71.46
Qwen-2.5-7B + KG 2026.03		70.32
Qwen-2.5-7B + KG 2026.04		70.32
LLaMA-3.1-8B + KG 2026.03		68.66
LLaMA-3.1-8B + KG 2026.04		68.66
LLaMA-3.1-8B (SFT) + KG 2026.03		64.08
LLaMA-3.1-8B (SFT) + KG 2026.04		64.08
GPT-4o 2026.03		48.2
GPT-4o 2026.04		48.2
DeepSeek-R1-Distill-Llama-70B 2026.03		22.27
DeepSeek-R1-Distill-Llama-70B 2026.04		22.27
GPT-4o-mini 2026.03		18.85
GPT-4o-mini 2026.04		18.85
LLaMA-3.3-70B 2026.03		18.55
LLaMA-3.3-70B 2026.04		18.55
LLaMA-3.1-8B 2026.03		12.54
LLaMA-3.1-8B 2026.04		12.54
Qwen-2.5-7B 2026.03		7.84
Qwen-2.5-7B 2026.04		7.84