Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Social Skill Simulation on Sotopia Hard
Loading...
49.2
Primary Metric
OSIM 8B
20.288
27.794
35.3
42.806
Jun 12, 2026
Primary Metric
Updated 1mo ago
Evaluation Results
Method
Method
Links
Primary Metric
OSIM 8B
Model=OSIM, Parameter...
2026.06
49.2
OSIM 8B-Mid
Model=OSIM, Parameter...
2026.06
45.6
Claude Opus 4.7
2026.06
32.4
GPT 5.5
2026.06
31.9
Others *
2026.06
31.7
Qwen 3.6 Plus
2026.06
28.3
Gemini 3.1 Pro
2026.06
27.8
Qwen3 8B Inst
Model=Qwen3-8B-Instruc...
2026.06
27.7
Base 8B
Model=Qwen3-8B-Base, P...
2026.06
21.4
Feedback
Search any
task
Search any
task