Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PMB

Benchmarks

Task NameDataset NameSOTA ResultTrend
Semantic ParsingPMB English 2.2.0 (test)
F1 Score88.3
10
Semantic ParsingPMB English 2.2.0 (dev)
F1 Score86.5
9
Semantic ParsingPMB English 3.0.0 (test)
F1 Score89.3
8
Semantic ParsingPMB English 3.0.0 (dev)
F1 Score88.4
8
Text-to-DRS parsingPMB NL 4.0.0 (test)
F1 Score92.6
7
Text-to-DRS parsingPMB IT 4.0.0 (test)
F1 Score93.1
7
Text-to-DRS parsingPMB DE 4.0.0 (test)
F1 Score92
7
Text-to-DRS parsingPMB EN 4.0.0 (test)
F1 Score94.7
7
Semantic ParsingPMB v.2.1.0 (test)
F182.7
6
Semantic ParsingPMB Dutch 2.2.0 (test)
Precision63.5
3
Semantic ParsingPMB German 2.2.0 (test)
Precision66.44
3
Semantic ParsingPMB Italian 2.2.0 (test)
Precision0.745
3
Showing 12 of 12 rows