Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
User Simulation on UserLLM
Loading...
93
Primary Metric Score
DITTO
28.52
45.26
62
78.74
May 19, 2026
May 23, 2026
May 27, 2026
May 31, 2026
Jun 4, 2026
Jun 8, 2026
Jun 12, 2026
Primary Metric Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Primary Metric Score
DITTO
Backbone=Qwen3-VL-8B-I...
2026.05
93
OSIM 8B
Model=OSIM, Parameter...
2026.06
90.1
GRPO
Backbone=Qwen3-VL-8B-I...
2026.05
86.3
Qwen 3.6 Plus
2026.06
72.1
Gemini 3.1 Pro
2026.06
67.7
GPT 5.5
2026.06
65.3
Claude Opus 4.7
2026.06
57.6
GPT-5.4
2026.05
57.5
HER-32B
2026.05
53.7
OSIM 8B-Mid
Model=OSIM, Parameter...
2026.06
49.5
Qwen3-VL-8B-Instruct
Role=Base
2026.05
46.9
Qwen3 8B Inst
Model=Qwen3-8B-Instruc...
2026.06
46
Others *
2026.06
44.6
GPT-5-nano
2026.05
32.4
Base 8B
Model=Qwen3-8B-Base, P...
2026.06
31
Feedback
Search any
task
Search any
task