Dialogue State Tracking on SGD 15 tasks CL

76.3Avg JGA

RoS Multi-task

Updated 4d ago

Evaluation Results

Method
RoS Multi-task 2024.08	76.3	-	-
DST-EGQA Multi-task 2024.08	74.2	-	-
RoS 2024.08	72.1	26.7	-2.6
DST-EGQA 2024.08	68.9	22.5	-5.9
Multi-task Prompt Tuning 2022.03	64	-	-
CPT Multi-task 2024.08	64	-	-
TaSL 2024.08	62.1	26.6	-9.1
Continual Prompt Tuning w/ memory & backward 2022.03	61.2	13.7	0.5
CPT 2024.08	61.2	13.7	0.5
Continual Prompt Tuning w/ memory 2022.03	60.7	13.7	0
Continual Prompt Tuning 2022.03	59.5	9.9	0
RoS 2024.08	59	25.5	-17.9
Replay 2022.03	58.6	10.9	-3.2
Replay 2024.08	58.6	10.9	-3.2
DST-EGQA 2024.08	55.5	23.6	-19.1
AdapterCL (20x) 2022.03	49.8	-	-
AdapterCL 2024.08	49.8	-	-
Prompt Tuning 2022.03	48.1	-	-
EWC 2024.08	47.9	8.4	-38.1
Fine-tuning 2024.08	44.1	8.3	-36.6
AdapterCL (1x) 2022.03	30.6	-	-
Fine-tuning 2022.03	14.3	8.3	-49.9
EWC 2022.03	13.9	8.4	-50.8