Share your thoughts, 1 month free Claude Pro on usSee more

Long-context Reasoning on LongBench v2

68.2Average Score

Gemini 3 Pro

Updated 2d ago

Evaluation Results

Method
Gemini 3 Pro 2026.02	68.2	-	-	-	-	-	-	-	-	-
GLM-5 2026.02	64.5	-	-	-	-	-	-	-	-	-
Claude Opus 4.5 2026.02	64.4	-	-	-	-	-	-	-	-	-
Kimi K2.5 2026.02	61	-	-	-	-	-	-	-	-	-
DeepSeek-V3.2 2026.02	59.8	-	-	-	-	-	-	-	-	-
GPT-5.2 (xhigh) 2026.02	59.8	-	-	-	-	-	-	-	-	-
GLM-4.7 2026.02	59.1	-	-	-	-	-	-	-	-	-
LoongRL 2026.05	52.3	-	-	-	-	-	-	-	-	-
LONGTRACERL-GRPO 2026.05	51.8	-	-	-	-	-	-	-	-	-
DocQA 2026.05	51.6	-	-	-	-	-	-	-	-	-
LONGTRACERL 2026.05	51.3	-	-	-	-	-	-	-	-	-
LongRLVR 2026.05	50.3	-	-	-	-	-	-	-	-	-
Base 2026.05	49.9	-	-	-	-	-	-	-	-	-
DocQA 2026.05	44.6	-	-	-	-	-	-	-	-	-
LONGTRACERL 2026.05	44.1	-	-	-	-	-	-	-	-	-
LongRLVR 2026.05	43.8	-	-	-	-	-	-	-	-	-
LoongRL 2026.05	41.8	-	-	-	-	-	-	-	-	-
Base 2026.05	41.7	-	-	-	-	-	-	-	-	-
LONGTRACERL-GRPO 2026.05	40.7	-	-	-	-	-	-	-	-	-
OPSDL 2026.04	36.5	39.1	34.9	35	36.1	36.6	-	-	-	-
Qwen2.5-14B-Instruct-1M 2026.04	36.4	45.6	32.1	29.6	38.8	34.9	-	-	-	-
Qwen3-8B-SFT w/ LongR 2026.02	36.23	38.75	32.67	39.12	41.15	33.2	-	-	-	-
Qwen3-4B-SFT w/ LongR 2026.02	35.44	38.75	37.21	26.39	35.16	35.61	-	-	-	-
Long-SFT 2026.04	34.2	40.3	30.6	31.3	34.8	33.9	-	-	-	-
OPSDL 2026.04	33.7	41.5	27.1	33.6	34.4	33.2	-	-	-	-
Elastic Attention 2026.01	33.41	-	-	-	37.33	31.2	0.66	-	-	-
Qwen3-8B* 2026.02	33.38	35.65	28.76	34.65	40.62	28.93	-	-	-	-
Qwen2.5-32B-Instruct 2026.04	32.9	39.9	28.4	30.4	36.2	30.9	-	-	-	-
Qwen3-8B-SFT w/ DAPO 2026.02	32.84	37.93	28.57	32.21	39.9	28.49	-	-	-	-
Llama3.1-8B-Writing-RL 2025.06	32.8	42.2	29.3	24.1	31.2	33.8	-	-	-	-
Llama-3.1-8B-Instruct 2026.01	32.69	-	-	-	32	33.08	-	-	-	-
OPSDL 2026.04	32.6	36.1	32.7	26.9	34.4	31.6	-	-	-	-
Long-SFT 2026.04	32.5	40.6	28.5	26.9	34	31.5	-	-	-	-
DRIFT 2026.02	32.41	36.67	28.37	33.33	-	-	-	-	-	-
Qwen3-8B 2026.01	31.97	-	-	-	39.33	27.82	-	-	-	-
Qwen2.5-7B-Writing-RL 2025.06	31.8	42.1	25.7	26.5	35.8	29.3	-	-	-	-
PruLong 2026.01	31.73	-	-	-	38.67	27.82	0.7	-	-	-
Qwen2.5-14B-Instruct 2026.04	31.6	37.9	28.4	27.6	35	29.5	-	-	-	-
Qwen3-4B* 2026.02	31.46	35.16	28.1	31.46	34.7	29.46	-	-	-	-
DBTrimKV 2026.05	31.44	37.08	19.77	-	36.67	28.74	-	-	-	9.2
Qwen2.5-Instruct-7B 2026.02	31.01	41.11	26.05	24.07	-	-	-	-	-	-
DuoAttention 2026.01	31.01	-	-	-	40.67	25.56	0.7	-	-	-
Elastic Attention 2026.01	30.77	-	-	-	30.67	30.83	0.75	-	-	-
Elastic Attention 2026.01	30.74	-	-	-	30.68	30.77	0.78	-	-	-
Qwen2.5-7B-Instruct-1M 2026.04	30.6	39.3	25.6	26.1	36	27.3	-	-	-	-
Qwen3-4B-SFT w/ DAPO 2026.02	30.41	33.33	31.36	23.87	28.32	31.63	-	-	-	-
Llama3.1-8B-Instruct 2025.06	30.2	35.6	27.4	26.9	32.3	28.9	-	-	-	-
Qwen2.5-7B-Instruct 2025.06	29.6	38.9	26	21.3	31.8	28.3	-	-	-	-
DRIFT 2026.02	29.22	32.22	28.84	25	-	-	-	-	-	-
InfLLM-V2 2026.01	29.09	-	-	-	29.32	28.67	-	-	-	-
InfLLM-V2 2026.01	29.09	-	-	-	29.32	28.67	-	-	-	-
Elastic Attention 2026.01	29.09	-	-	-	28	29.7	0.68	-	-	-
Full KV 2026.05	28.79	33.71	18.6	-	34.44	25.86	-	-	-	0
PruLong 2026.01	28.61	-	-	-	28	28.92	0.7	-	-	-
LocRet 2026.05	28.41	30.34	24.42	-	30	27.59	-	-	-	-1.32
Llama3.1-8B-WritingBench-SFT 2025.06	28.4	36.7	23.7	24.1	29.7	27.7	-	-	-	-
Elastic Attention 2026.01	28.12	-	-	-	32	25.94	0.72	-	-	-
Elastic Attention 2026.01	27.88	-	-	-	34	24.44	0.7	-	-	-
DuoAttention 2026.01	27.88	-	-	-	28.67	27.44	0.7	-	-	-
Qwen2.5-7B-WritingBench-SFT 2025.06	27.6	35	25.1	20.4	27.6	27.7	-	-	-	-
LongPO 2026.04	27.5	38.4	23.9	16.7	29.2	26.5	-	-	-	-
LONGTRACERL 2026.05	27.5	-	-	-	-	-	-	-	-	-
xRAG 2026.02	27.43	31.11	25.58	25	-	-	-	-	-	-
COCOM 2026.02	27.24	27.78	23.26	34.26	-	-	-	-	-	-
COCOM 2026.02	27.04	27.22	23.26	34.26	-	-	-	-	-	-
COCOM 2026.02	27.04	29.44	21.4	34.26	-	-	-	-	-	-
LongRLVR 2026.05	26.8	-	-	-	-	-	-	-	-	-
Qwen3-8B-SFT 2026.02	26.64	32.02	24.45	23.35	28.25	25.65	-	-	-	-
DRIFT 2026.02	26.44	26.67	29.77	19.44	-	-	-	-	-	-
DRIFT 2026.02	26.24	32.22	24.65	19.44	-	-	-	-	-	-
Qwen2.5-7B-Instruct 2026.04	26.2	33.3	23.3	20.4	29.2	24.4	-	-	-	-
TRIM-KV 2026.05	26.13	29.21	19.77	-	31.11	23.56	-	-	-	-9.24
Long-SFT 2026.04	26.1	32.6	22.7	22.2	28.2	24.9	-	-	-	-
Qwen3-4B 2026.01	25.96	-	-	-	32.67	22.18	-	-	-	-
DuoAttention 2026.01	25.96	-	-	-	28.67	24.44	0.7	-	-	-
DocQA 2026.05	25.9	-	-	-	-	-	-	-	-	-
Qwen3-4B-SFT 2026.02	25.65	32.93	22.53	19.64	21.54	28.1	-	-	-	-
LONGTRACERL-GRPO 2026.05	25.6	-	-	-	-	-	-	-	-	-
LoongRL 2026.05	25.5	-	-	-	-	-	-	-	-	-
InfLLM-V2 2026.01	25.48	-	-	-	28	24.06	-	-	-	-
Base 2026.05	25.4	-	-	-	-	-	-	-	-	-
PruLong 2026.01	24.35	-	-	-	27.6	22.33	0.7	-	-	-
NaiveRAG 2026.02	22.86	17.78	26.05	25	-	-	-	-	-	-
Mistral-7B-v0.2 2026.02	20.87	25	16.28	23.15	-	-	-	-	-	-
LLMLingua-2 2026.02	20.68	26.11	13.95	25	-	-	-	-	-	-
Qwen3-8B-Base 2026.02	20.58	27.93	17.86	14.08	19.67	21.14	-	-	-	-
Qwen3-4B-Base 2026.02	17.13	20.71	13.69	17.78	19.59	15.62	-	-	-	-
ICAE 2026.02	13.12	13.89	14.88	10.56	-	-	-	-	-	-
Base model 2026.01	-	-	-	-	-	-	-	39.4	-	-
No-Thinking 2026.01	-	-	-	-	-	-	-	30	-	-
SFT 2026.01	-	-	-	-	-	-	-	40.2	-	-
Hard-Length 16k 2026.01	-	-	-	-	-	-	-	40.9	-	-
Hard-Length 8k 2026.01	-	-	-	-	-	-	-	40.7	-	-
Hard-Length 8k → 4k 2026.01	-	-	-	-	-	-	-	38.9	-	-
Soft-Length 2026.01	-	-	-	-	-	-	-	39.4	-	-
Normalized-Length 2026.01	-	-	-	-	-	-	-	36.6	-	-
TWYN 2026.01	-	-	-	-	-	-	-	38.8	-	-
Adaptive-Answer 2026.01	-	-	-	-	-	-	-	39.4	-	-
Format-Adaptive-Answer 2026.01	-	-	-	-	-	-	-	37.4	-	-
Gemini-3.0-pro 2026.03	-	-	-	-	-	-	-	-	69.38	-

Showing 100 of 120 rows