Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Semantic Role Classification on FrameNet 1.7 (test)
Loading...
89.9
Accuracy
An et al. (2023)
49.236
59.793
70.35
80.907
Mar 20, 2026
Mar 25, 2026
Mar 31, 2026
Apr 5, 2026
Apr 11, 2026
Apr 16, 2026
Apr 22, 2026
Accuracy
micro-F1
macro-F1
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
micro-F1
macro-F1
An et al. (2023)
2026.04
89.9
-
-
RoBERTa SEP
Input style=SEP, Evalu...
2026.04
86.1
86.6
64.8
RoBERTa MASK
Input style=MASK, Eval...
2026.04
80.6
80.6
5.3
Claude Sonnet 4.0
Evaluation protocol=ze...
2026.04
73.6
73.6
60
analogical transfer
Frame id.=gold, Arg id...
2026.03
59.35
-
-
Swayamdipta et al.
Frame id.=gold, Arg id...
2026.03
58.46
-
-
Gemini 2.5
Evaluation protocol=ze...
2026.04
50.8
50.8
43
Devasier et al. (2024)
2026.04
-
88.7
-
Feedback
Search any
task
Search any
task