Share your thoughts, 1 month free Claude Pro on usSee more

Social Interaction Evaluation on SOTOPIA (Self-Play)

9.08Goal Score

AMPO

Updated 1mo ago

Evaluation Results

Method	Links
AMPO 2025.05		9.08	3.95
AMPO 2025.05		8.95	3.87
ASL w/ BC+GRPO 2025.05		8.87	3.85
ASL w/ BC+GRPO 2025.05		8.86	3.84
ASL w/ BC 2025.05		8.43	3.76
Qwen2.5-7B-Instruct w/ DSI 2025.05		8.35	3.75
Claude-3.5-Sonnet 2025.05		8.29	3.71
ASL w/ BC 2025.05		8.22	3.67
GPT-4o 2025.05		8.19	3.76
DeepSeek-V3 2025.05		8.15	3.62
Qwen2.5-7B-Instruct w/ EPO 2025.05		8.09	3.51
Llama3.1-8B-Instruct w/ DSI 2025.05		8.08	3.64
DeepSeek-R1 2025.05		7.97	3.4
Qwen2.5-7B-Instruct w/ PPDPP 2025.05		7.97	3.65
Qwen2.5-7B-Instruct w/ DAT 2025.05		7.97	3.59
Llama3.1-8B-Instruct w/ EPO 2025.05		7.94	3.78
OpenAI-o1 2025.05		7.93	3.58
Qwen2.5-7B-Instruct 2025.05		7.91	3.55
Gemini-2.5-Pro 2025.05		7.85	3.43
QwQ-32B 2025.05		7.7	3.3
OpenAI-o3-mini 2025.05		7.38	3.3
Llama3.1-8B-Instruct w/ DAT 2025.05		7.34	3.44
Llama3.1-8B-Instruct w/ PPDPP 2025.05		7.2	3.4
Llama3.1-8B-Instruct 2025.05		6.99	3.23