Share your thoughts, 1 month free Claude Pro on usSee more

Next-state prediction on StableToolBench (STB)

49.25EM Accuracy

Llama3.1-8B

Updated 1mo ago

Evaluation Results

Method	Links
Llama3.1-8B 2025.12		49.25	78.97
Qwen2.5-7B 2025.12		48.9	79.15
GPT-4o-mini 2025.12		0	13.94
GPT-4o 2025.12		0	11.88
GPT-4-turbo 2025.12		0	12.64
GPT-4.1 2025.12		0	12.83
GPT-5 2025.12		0	8.02
Gemini-2.5-flash 2025.12		0	8.74
Claude-sonnet-4.5 2025.12		0	11.36
GPT-4o-mini 2025.12		0	13.44
GPT-4o 2025.12		0	11.08
GPT-4-turbo 2025.12		0	10.72
GPT-4.1 2025.12		0	10.33
GPT-5 2025.12		0	6.28
Gemini-2.5-flash 2025.12		0	8.47
Claude-sonnet-4.5 2025.12		0	13.11