Task-oriented Dialogue

Benchmarks

Dataset Name	SOTA Method	Metric
MultiWOZ 2.0 (test)	DarwinTOD	Inform Rate99.1	37	4mo ago
Stanford Multi-Domain Dialogue (SMD) (test)	COMET	BLEU17.3	29	4mo ago
FnCTOD	RPOTD+replay	Success Rate62.5	25	3mo ago
MultiWOZ 2.2 (test)	DarwinTOD	Inform Rate96.48	23	4mo ago
CamRest676 end-to-end modeling (test)	ARDM	Task Success Rate87.1	18	4mo ago
MultiWOZ 2.4 (test)	CoALM 70B	JGA43.8	15	4mo ago
FewShotSGD unseen schemata (test)	Full Data Baseline	BLEU28.76	13	4mo ago
FewShotSGD seen schemata (test)	Full Data Baseline	BLEU29.28	13	4mo ago
FewShotWeather unseen structures (test)	Full Data Baseline	BLEU62.44	13	4mo ago
FewShotWeather seen structures (test)	Full Data Baseline	BLEU74.43	13	4mo ago
MultiWOZ 2.0	LAVA	Inform Rate91.8	13	4mo ago
MultiWOZ 2.4	Qwen-3-32B	Inform99	12	26d ago
MultiWOZ 2.1 (test)	DarwinTOD	Inform Rate99.62	11	4mo ago
MultiWOZ 20% 2.0 (train)	MDTOD	Inform90.25	10	4mo ago
MultiWOZ 2.0 (10% train)	MDTOD	Inform Rate86.3	10	4mo ago
MultiWOZ 5% 2.0 (train)	MDTOD	Inform85.65	10	4mo ago
MultiWOZ Taxi domain 1.0	EWC+RL	Combined Score106.3	10	4mo ago
MultiWOZ 1.0 (train)	EWC+RL	Combined Score104.9	10	4mo ago
MultiWOZ Attraction domain 1.0	EWC+RL	Combined Score96	10	4mo ago
MultiWOZ Hotel domain 1.0	EWC+RL	Combined Score100.7	10	4mo ago
MultiWOZ Restaurant domain 1.0	Naive+RL	Combined Score97.6	10	4mo ago
StarV2 (test)	Genie + GPT-4o-mini	Bank Score82.5	10	4mo ago
MultiWOZ low-resource 2.1	VLK-RL	Average Precision (AP)29.52	9	2mo ago
Frames	VLK-RL	Success Rate (SR)50.57	9	2mo ago
MultiWOZ 2.1	VLK-RL	Success Rate (SR)51.24	9	2mo ago

Showing 25 of 45 rows