Share your thoughts, 1 month free Claude Pro on usSee more

Vignette Completeness on CIRL-Vig

45.8Vignette Completeness

OpenThinker3-7B

Updated 1mo ago

Evaluation Results

Method	Links
OpenThinker3-7B 2026.04		45.8
Gemma-3-12B 2026.04		45.4
Gemma-3-12B 2026.04		43.6
Phi-4 2026.04		43
Qwen3.5-9B 2026.04		41.6
Qwen3.5-2B 2026.04		41.6
Qwen3.5-4B 2026.04		41.6
Qwen3.5-2B 2026.04		40.8
Qwen3.5-9B 2026.04		38.7
OpenThinker3-7B 2026.04		34.1
Phi-4 2026.04		27.8
ContextReasoner-7B 2026.04		13
Qwen3.5-9B 2026.04		0
GPT-OSS-20B 2026.04		0
GPT-OSS-20B 2026.04		0