Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on HumanEval (Accuracy, Exit Position)

98.27Accuracy

SASFT

Updated 1mo ago

Evaluation Results

Method
SASFT 2026.05	98.27	-
SFT+GRPO 2026.05	96.44	-
SFT 2026.05	95.87	-
SIGMA 2026.06	95.83	-
SFT+Penalty 2026.05	94.71	-
CARD 2026.06	93.98	-
AgentRevive 2026.05	93.52	-
ARG-Designer 2026.06	93.47	-
G-Designer 2026.06	92.88	-
GPTSwarm 2026.06	92.3	-
AgentDropout 2026.05	91.74	-
LAR 2026.05	91.46	-
LLM-Debate 2026.06	91.43	-
ARG-Designer 2026.05	91.18	-
AgentPrune 2026.05	90.91	-
CoT 2026.06	90.87	-
SC (CoT) 2026.05	90.61	-
SFT+GRPO 2026.05	90.48	-
SFT 2026.05	90.29	-
G-Designer 2026.05	90.2	-
Vanilla 2026.06	90.04	-
ReAct 2026.05	89.63	-
CoT 2026.05	89.26	-
AutoGen 2026.05	89.26	-
MASround=T 2026.05	89.26	-
MASround=1 2026.05	89.17	-
SFT+Penalty 2026.05	89.13	-
SASFT 2026.05	89.04	-
AgentVerse 2026.05	88.94	-
SIGMA 2026.06	88.71	-
Vanilla 2026.05	88.43	-
CARD 2026.06	87.28	-
SIGMA 2026.06	86.29	-
RLSTA 2026.05	86	-
ARG-Designer 2026.06	85.47	-
MAIGO 2026.05	85.2	-
CARD 2026.06	85.11	-
GRPO 2026.05	85.1	-
Base 2026.05	84.8	-
G-Designer 2026.06	84.73	-
ARG-Designer 2026.06	84.54	-
GPTSwarm 2026.06	84.14	-
RLSTA 2026.05	84	-
LLM-Debate 2026.06	83.85	-
GRPO 2026.05	83.5	-
CoT 2026.06	82.85	-
G-Designer 2026.06	82.67	-
MAIGO 2026.05	82.5	-
Vanilla 2026.06	82.23	-
GPTSwarm 2026.06	81.39	-
Base 2026.05	80.6	-
SFT 2026.05	80.5	-
LLM-Debate 2026.06	79.48	-
CoT 2026.06	78.64	-
SFT 2026.05	77.7	-
Vanilla 2026.06	77.29	-
MAIGO 2026.05	76.1	-
RLSTA 2026.05	73.5	-
GRPO 2026.05	73.3	-
DreamReasoner-8B 2026.06	69.5	-
Base 2026.05	69.4	-
Qwen3-8B 2026.06	68.9	-
SFT 2026.05	67.8	-
Phi4-mini 2026.04	63.4	-
River-LLM 2026.04	63.1	7.72
River-LLM 2026.04	62.8	2.55
VoidExpansion 2026.06	60.98	-
LAR 2026.05	60.37	-
MAIGO 2026.05	59.6	-
Base 2026.05	59	-
RLDF 2026.05	58.5	-
AgentRevive 2026.05	58.15	-
RLDF 2026.05	57.9	-
RLDF 2026.05	57.9	-
Dream-v0-7B 2026.06	57.9	-
Backbone 2026.04	57.3	-
River-LLM 2026.04	57.3	2.16
ReAct 2026.05	56.71	-
Qwen2.5-7B 2026.06	56.7	-
Coupled-GRPO 2026.05	56.1	-
AgentDropout 2026.05	55.84	-
River-LLM 2026.04	55.5	2.16
ESPO 2026.05	55.5	-
SC (CoT) 2026.05	55.46	-
RLSTA 2026.05	55	-
CoT 2026.05	54.17	-
d1 2026.05	53.7	-
TraceRL 2026.05	53.7	-
ARG-Designer 2026.05	53.62	-
SFT 2026.05	53.5	-
Vanilla 2026.05	53.33	-
ESPO 2026.05	53	-
Coupled-GRPO 2026.05	53	-
Coupled-GRPO 2026.05	53	-
G-Designer 2026.05	52.53	-
ESPO 2026.05	52.4	-
TraceRL 2026.05	52.4	-
d1 2026.05	51.8	-
d1 2026.05	51.8	-
MiMo-7B 2026.06	51.8	-

Showing 100 of 212 rows