Share your thoughts, 1 month free Claude Pro on usSee more

Structure Comprehending on RealHitBench

82.71Exact Match (EM)

DeepSeek-R1

Updated 3d ago

Evaluation Results

Method
DeepSeek-R1 2025.06	82.71	84.62
DeepSeek-R1 2026.04	82.71	84.62
Qwen3-Coder-480B w/ SpreadsheetAgent 2026.04	76.26	82.71
QwQ-32B 2025.12	76.08	-
TreeThinker 2026.04	74.24	79.49
SpreadsheetAgent 2026.04	74.24	79.36
Llama3.3-70B-Instruct 2026.04	73.99	78.61
Qwen2.5-72B-Instruct 2026.04	73.48	80.54
Qwen3-14B 2025.12	73.02	-
Qwen3-Coder-480B 2026.04	72.98	80.01
TreeThinker 2026.04	72.73	79.45
Qwen3-32B 2025.12	71.76	-
DeepSeek-V3 2025.12	71.25	-
SpreadsheetAgent 2026.04	70.71	78.42
Qwen3-72B 2025.12	69.47	-
GPT4o(TreeThinker) 2025.06	66.31	77.42
GPT4o 2025.06	65.91	74.49
Doubao-1.5-pro-32k 2025.06	65.9	72.45
GPT4o(TreeThinker) 2025.06	64.4	75.67
Qwen3-8B 2025.12	64.12	-
TableGPT-R1-8B 2025.12	64.12	-
Qwen3-235B w/ SpreadsheetAgent 2026.04	63.89	69.43
Gemini1.5-pro 2025.06	63.64	69.71
Gemini1.5-pro 2026.04	63.64	69.71
GPT4o 2025.06	63.04	71.14
GPT4o 2026.04	63.04	71.14
Qwen-Plus 2025.12	62.85	-
GPT-OSS-120B w/ SpreadsheetAgent 2026.04	62.37	66.01
Qwen3-235B 2026.04	61.87	67.85
GPT-4o 2025.12	61.83	-
Llama3.2-90B-Vision-Instruct 2025.06	59.8	70.23
Qwen3-235B w/ TreeThinker 2026.04	59.09	63.28
Llama3.2-90B-Vision-Instruct 2025.06	58.52	69.57
Qwen3-Coder-480B w/ TreeThinker 2026.04	58.33	65.77
Gemini1.5-pro 2025.06	56.74	65.8
DTR 2026.03	56.57	77.95
Llama3.3-70B-Instruct 2025.06	55.81	68.93
Llama3.3-70B-Instruct 2026.04	55.81	68.93
Qwen2.5-72B-Instruct 2025.06	54.55	68.34
Qwen2.5-72B-Instruct 2026.04	54.55	68.34
GPT-OSS-120B 2026.04	54.04	57.19
TableLLM 2025.12	53.28	-
TableLLM-Llama3.1-8B 2025.06	53.28	58.72
GPT-OSS-120B w/ TreeThinker 2026.04	53.03	57.98
Code Loop 2026.03	49.24	53.08
GPT4o(TreeThinker) 2025.06	49.21	58.32
SpreadsheetAgent 2026.04	48.74	56.61
Qwen2-VL-7B-Instruct 2025.06	48.6	60.42
TableGPT2-7B 2025.06	48.23	56.68
TableGPT2-7B 2026.03	48.23	56.68
Qwen2.5-7B-Instruct 2026.04	45.96	55.45
Qwen2-VL-7B-Instruct 2025.06	45.29	55.99
TreeThinker 2026.04	44.95	53.63
Code Loop 2026.03	44.19	51.95
DeepSeek-v3 2026.03	43.31	74.63
GPT4o 2025.06	42.68	52.89
GPT4o 2026.03	42.68	52.89
Gemini1.5-pro 2025.06	41.52	50.23
mPLUG-Owl3-7B 2025.06	41.24	48.86
TableLLM-7B 2026.03	41.1	49.34
Qwen3-30B w/ SpreadsheetAgent 2026.04	40.15	47.28
GPT-OSS-20B w/ SpreadsheetAgent 2026.04	39.65	44.74
Qwen3-30B 2026.04	37.88	44.26
TableLlama 2025.06	36.31	42.91
TableLLM-Qwen2-7B 2025.06	36.09	44.75
Llama-3.1-8B 2025.12	35.9	-
Llama3.1-8B-Instruct 2025.06	35.9	50.8
Llama3.1-8B-Instruct 2026.04	35.9	50.8
TableGPT2-7B 2025.12	34.86	-
Qwen3-30B w/ TreeThinker 2026.04	34.09	41.65
GPT-OSS-20B 2026.04	33.84	40.46
GPT-OSS-20B w/ TreeThinker 2026.04	33.59	39.53
Llama3.2-90B-Vision-Instruct 2025.06	33.33	46.4
Code Loop 2026.03	32.85	30.3
DTR 2026.03	32.6	43.32
StructGPT 2026.03	30.25	38.6
Table-R1-Zero-7B 2025.12	28.5	-
Llama3.2-11B-Vision-Instruct 2025.06	27.99	43.85
Llama3.1-8B-Instruct 2026.04	25.51	39.51
SpreadsheetAgent 2026.04	25.25	40.33
Qwen2.5-7B-Instruct 2025.06	23.48	44.81
Qwen2.5-7B-Instruct 2026.04	23.48	44.81
Llama3.2-11B-Vision-Instruct 2025.06	23.39	43.22
TreeThinker 2026.04	21.72	38.78
Mistral-7B-Instruct-v0.3 2025.06	21.21	49.62
Llama3.2-11B-Vision-Instruct 2025.06	20.87	32.57
DeepSeek-R1-Distill-Qwen-7B 2025.06	19.08	28.1
DTR 2026.03	17.17	27.88
DeepSeek-R1-Distill-Llama-8B 2025.06	14.76	26.66
LLaVa-v1.5-7B 2025.06	13.23	30.51
QwQ-32B 2025.06	12.99	37.96
DeepSeek-R1-Distill-Qwen-1.5B 2025.06	9.92	19.93
mPLUG-Owl2-7B 2025.06	9.14	14.21
Table-LLava-7B 2025.06	7.38	11.83