Dialogue State Tracking

Benchmarks

Dataset Name	SOTA Method	Metric
MultiWOZ 2.1 (test)	Trippy+SaCLog	Joint Goal Accuracy60.61	85	4d ago
MultiWOZ 2.2 (test)	LUAS_R+G	Joint Goal Accuracy66.25	80	4d ago
WOZ 2.0 (test)	AG-DST	Joint Goal Accuracy91.37	65	4d ago
MultiWOZ 2.4 (test)	LUAS_R+G	Joint Goal Acc78.2	45	4d ago
DSTC2 (test)	Seq2seq-DU	Joint Goal Accuracy85	39	4d ago
MultiWOZ 2.1	Dai et al. (2021)	Joint Goal Accuracy60.61	26	3d ago
MultiWOZ 2.0 (test)	MoNET	Joint Goal Accuracy55.48	13	4d ago
MultiWOZ 2.3 (test)	TripPy	JGA63	11	4d ago
MultiWOZ 2.1 (5%)	SVAG + EDZ-DA	Joint Goal Acc44.98	11	3d ago
ToDs benchmark GPT-2 backbone (test)		JGA50.03	11	4d ago
SGD (test)	paDST	JGA86.5	11	4d ago
MultiWOZ 2.1 (1%)	SVAG + EDZ-DA	Joint Goal Acc37.26	10	3d ago
SGD	Transfer-QA	JGA (Payment)24.7	8	4d ago
Sim-R (test)	DiCoS-DST	Joint Goal Accuracy91.5	7	4d ago
Sim-M (test)	DiCoS-DST	Joint Goal Accuracy84.7	7	4d ago
WOZ 2.0	Seq2Seq-DU-w/oSchema	Joint GA91.2	7	4d ago
MWOZ 2.1 (Full Data)	FutureTOD	Joint Accuracy50.4	6	3d ago
MWOZ 2.1 (25% Data)	FutureTOD	Joint Accuracy45.7	6	3d ago
MWOZ 2.1 (10% Data)	FutureTOD	Joint Accuracy40.7	6	3d ago
M2M Simulated Restaurant (test)	Rastogi et al. (2017)	Joint Goal Accuracy94.4	6	4d ago
M2M Simulated Movie (test)	Rastogi et al. (2017)	Joint Goal Accuracy96.8	6	4d ago
SGD-X v1-v5 variants (test)	D3ST (XXL)	Joint Goal Acc (Original)86.4	6	4d ago
MultiWoZ 2.1 (dev)	T5-3B	Joint Goal Accuracy58.46	6	4d ago
MultiWOZ 16th cross-dataset task 2.4	RoS	JGA (Attraction)42.84	5	4d ago
SGD to MultiWoz (test)	DST-EGQA	Average JGA51.2	5	4d ago

Showing 25 of 41 rows