Share your thoughts, 1 month free Claude Pro on usSee more

Graph prediction on CrossTask (test)

0.795Change Tire Success

Ground-truth labels → Graph

Updated 5mo ago

Evaluation Results

Method	Links
Ground-truth labels → Graph 2023.02		0.795	0.896	0.68	0.688	0.727	0.757
ASR → GPT → Labels → Graph 2023.02		0.75	0.729	0.617	0.625	0.659	0.676
Unsupervised Task Graph Generation Pipeline 2023.02		0.727	0.771	0.617	0.625	0.682	0.684
ASR → Labels → Graph 2023.02		0.545	0.729	0.711	0.562	0.545	0.618
ASR → VPs → Labels → Graph 2023.02		0.545	0.729	0.711	0.562	0.591	0.628
Proscript 2023.02		0.523	0.896	0.57	0.625	0.614	0.646