Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on MuSiQue (In-Distribution)

44Accuracy

Claude Sonnet 4

Updated 1mo ago

Evaluation Results

Method	Links
Claude Sonnet 4 2025.07		44	57	42
GPT-4.1 2025.07		43	45	55
Deliberative Searcher-72B 2025.07		37	71	14
Deliberative Searcher-DeepSeek-70B 2025.07		34	72	11
GPT-4o 2025.07		33	52	47
Deliberative Searcher-7B 2025.07		29	74	2
Deliberative Searcher-7B 2025.07		27	71	2
R1-Searcher-7B 2025.07		26	35	65
Qwen2.5-VL-72B 2025.07		25	50	49
InternVL3-78B 2025.07		24	41	58
DeepSeek-R1-Distill-70B 2025.07		23	32	68
ReSearch-7B 2025.07		18	22	78
Search-R1-7B 2025.07		16	45	53
Qwen2.5-VL-7B 2025.07		12	48	52