Share your thoughts, 1 month free Claude Pro on usSee more

General AI Assistant Tasks on GAIA Out-of-Distribution

47Accuracy

Claude Sonnet 4

Updated 1mo ago

Evaluation Results

Method	Links
Claude Sonnet 4 2025.07		47	74	26
GPT-4.1 2025.07		37	46	54
Deliberative Searcher-72B 2025.07		35	78	6
GPT-4o 2025.07		26	77	23
Deliberative Searcher-DeepSeek-70B 2025.07		24	78	11
R1-Searcher-7B 2025.07		20	35	65
DeepSeek-R1-Distill-70B 2025.07		18	16	84
ReSearch-7B 2025.07		16	22	78
Deliberative Searcher-7B 2025.07		16	90	1
Deliberative Searcher-7B 2025.07		15	89	1
Qwen2.5-VL-72B 2025.07		14	39	61
Qwen2.5-VL-7B 2025.07		13	43	57
InternVL3-78B 2025.07		12	48	52
Search-R1-7B 2025.07		10	44	56