Our new X account is live! Follow @wizwand_team for updates

Tool-based multi-turn dialogue on ToolWOZ (test)

0.922Avg Reward

gpt-4o-FC-JOSH-SFT

Updated 4d ago

Evaluation Results

Method	Links
gpt-4o-FC-JOSH-SFT 2024.09		0.922	84
gpt-4o-FC 2024.09		0.919	83.1
gpt-4o-ReACT-JOSH-SFT 2024.09		0.914	81.3
gpt-4o-ReACT 2024.09		0.9	79.1
gpt-4o-mini-FC-JOSH-SFT 2024.09		0.89	78
gpt-4o-mini-FC 2024.09		0.88	76
gpt-4o-mini-ReACT-JOSH-SFT-beam-16 2024.09		0.865	74
gpt-4o-mini-ReACT-JOSH-SFT-beam-4 2024.09		0.85	72
gpt-4o-mini-ReACT-JOSH-SFT-beam-8 2024.09		0.85	72
meta-llama-3-8B-JOSH-KTO 2024.09		0.79	59
gpt-3.5-FC 2024.09		0.76	58
meta-llama-3-8B-JOSH-SFT 2024.09		0.74	50
meta-llama-3-8B PPO 2024.09		0.69	45
gpt-4o-mini-ReACT 2024.09		0.67	48
gpt-3.5-ReACT 2024.09		0.66	44
meta-llama-3-8B 2024.09		0.63	34