Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

AMR

Benchmarks

Task NameDataset NameSOTA ResultTrend
AMR ParsingLDC2017T10 AMR 2.0 (test)
Smatch86.26
168
AMR parsingAMR 3.0 (test)
SMATCH86.5
45
AMR ParsingAMR 1.0 (test)
Smatch81.7
45
AMR ParsingAMR 1.0 LDC2014T12 (test)
SMATCH F175.4
23
AMR-to-textLDC2017T10 AMR17 (test)
chrF++74.79
17
Cross-lingual AMR ParsingAMR Italian (IT) human-translated 2.0 (test)
Smatch Score76.7
15
Cross-lingual AMR ParsingAMR Spanish (ES) human-translated 2.0 (test)
Smatch Score77.1
15
Cross-lingual AMR ParsingAMR German (DE) human-translated 2.0 (test)
Smatch0.746
15
AMR ParsingAMR 3.0 LDC2020T02 (test)
Smatch Labeled84.2
14
Cross-lingual AMR ParsingAMR Chinese (ZH) human-translated 2.0 (test)
Smatch64
13
AMR-to-text generationAMR 2.0 (test)
BLEU49.8
10
AMR-to-text generationAMR 3.0 (test)
BLEU49.2
5
Graph-to-text generationAMR (Human Evaluation)
Fluency6.7
5
Showing 13 of 13 rows