Task-oriented Dialogue

Benchmarks

Dataset Name	SOTA Method	Metric
MultiWOZ 2.0 (test)	DarwinTOD	Inform Rate99.1	37	3mo ago
Stanford Multi-Domain Dialogue (SMD) (test)	COMET	BLEU17.3	29	3mo ago
FnCTOD	RPOTD+replay	Success Rate62.5	25	1mo ago
MultiWOZ 2.2 (test)	DarwinTOD	Inform Rate96.48	23	3mo ago
CamRest676 end-to-end modeling (test)	ARDM	Task Success Rate87.1	18	3mo ago
MultiWOZ 2.4 (test)	CoALM 70B	JGA43.8	15	3mo ago
FewShotSGD unseen schemata (test)	Full Data Baseline	BLEU28.76	13	3mo ago
FewShotSGD seen schemata (test)	Full Data Baseline	BLEU29.28	13	3mo ago
FewShotWeather unseen structures (test)	Full Data Baseline	BLEU62.44	13	3mo ago
FewShotWeather seen structures (test)	Full Data Baseline	BLEU74.43	13	3mo ago
MultiWOZ 2.0	LAVA	Inform Rate91.8	13	3mo ago
MultiWOZ 2.1 (test)	DarwinTOD	Inform Rate99.62	11	3mo ago
MultiWOZ 20% 2.0 (train)	MDTOD	Inform90.25	10	3mo ago
MultiWOZ 2.0 (10% train)	MDTOD	Inform Rate86.3	10	3mo ago
MultiWOZ 5% 2.0 (train)	MDTOD	Inform85.65	10	3mo ago
MultiWOZ Taxi domain 1.0	EWC+RL	Combined Score106.3	10	3mo ago
MultiWOZ 1.0 (train)	EWC+RL	Combined Score104.9	10	3mo ago
MultiWOZ Attraction domain 1.0	EWC+RL	Combined Score96	10	3mo ago
MultiWOZ Hotel domain 1.0	EWC+RL	Combined Score100.7	10	3mo ago
MultiWOZ Restaurant domain 1.0	Naive+RL	Combined Score97.6	10	3mo ago
StarV2 (test)	Genie + GPT-4o-mini	Bank Score82.5	10	3mo ago
MultiWOZ low-resource 2.1	VLK-RL	Average Precision (AP)29.52	9	1mo ago
Frames	VLK-RL	Success Rate (SR)50.57	9	1mo ago
MultiWOZ 2.1	VLK-RL	Success Rate (SR)51.24	9	1mo ago
MultiWOZ 2.2	DARD	Success Rate88.3	9	1mo ago

Showing 25 of 44 rows