Multi-step Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
ScienceQA	SceneAlign	Accuracy92.72	35	2mo ago
TriviaQA	LAR	Task Performance80.09	14	15d ago
StrategyQA (test)	Qwen3-4B + SFT + WeMask(TF)	Accuracy64.63	11	22d ago
StrategyQA	Qwen3-8B + SFT + WeMask(TF)	Accuracy66.99	10	22d ago
Bamboogle auto-eval (test)	Self-improvement, 2nd gen	Mean Accuracy76.1	10	3mo ago
GSM8K (test)	SLR	Pass@132.2	9	3mo ago
CLEVR-Puzzle (test)	NeSyCoCo	Accuracy95	7	3mo ago
SVAMP	eMoT	Accuracy94	5	1d ago
GSM Hard	eMoT	Accuracy71.5	5	1d ago
GAIA (test)	Skill-R1 (GRPO, Qwen3-4b)	Level 1 Accuracy31	4	22d ago
MuSR	n=64 (RL)	Murder Mystery Score57.36	4	22d ago
Musique 16k ~ 20k	Absorber LLM	Macro Accuracy29.5	4	1mo ago
Musique 12k ~ 16k	Absorber LLM	Accuracy (macro)31.6	4	1mo ago
Musique 8k ~ 12k	TTT	Macro Accuracy34.3	4	1mo ago
BamTwoogle (test)	ReST meets ReAct	Accuracy74	4	3mo ago
Bamboogle (test)	ReST meets ReAct	Accuracy74.4	4	3mo ago
Checkmate	eMoT	Accuracy90	3	1d ago
WordSort	BoT	Accuracy100	3	1d ago
Game24	eMoT	Accuracy100	3	1d ago
MUSR Teams	Static Workflow	Accuracy61	3	1d ago
MUSR Objects	Static Workflow	Accuracy58	3	1d ago
MUSR Murder	Static Workflow	Accuracy68	3	1d ago
multi-step reasoning tasks	EmbodiedAct	Average Score61.6	3	3mo ago

Showing 23 of 23 rows