Share your thoughts, 1 month free Claude Pro on usSee more

Failure Detection on RoboFail

67Accuracy

Gemini 2.0 Flash

Updated 1mo ago

Evaluation Results

Method	Links
Gemini 2.0 Flash 2026.03		67
PRIMO R1 2026.03		67
Cosmos-Reason1-56B 2026.03		66.2
Nemotron-H-56B 2026.03		64
GPT-4o 2026.03		63
PRIMO (RL) 2026.03		63
OpenAI o1 2026.03		61
Cosmos-Reason1-7B 2026.03		60
Claude-haiku-4.5 2026.03		59
Qwen2.5-VL-7B 2026.03		57.6
PRIMO (SFT) 2026.03		51