Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Ultra-Fine Entity Typing on Ultra-Fine (test)
Loading...
81.6
Macro Recall (General)
BERT
68.6
71.975
75.35
78.725
Sep 13, 2021
Macro Recall (General)
Macro Precision (Total)
Macro Recall (Total)
Macro F1 (Total)
Macro Precision (General)
Macro F1 (General)
Macro Precision (Fine)
Macro Recall (Fine)
Macro F1 (Fine)
Macro Precision (Ultra-Fine)
Macro Recall (Ultra-Fine)
Macro F1 (Ultra-Fine)
Updated 4d ago
Evaluation Results
Method
Method
Links
Macro Recall (General)
Macro Precision (Total)
Macro Recall (Total)
Macro F1 (Total)
Macro Precision (General)
Macro F1 (General)
Macro Precision (Fine)
Macro Recall (Fine)
Macro F1 (Fine)
Macro Precision (Ultra-Fine)
Macro Recall (Ultra-Fine)
Macro F1 (Ultra-Fine)
BERT
implementation=in-house
2021.09
81.6
55.9
33
41.5
69.7
75.2
43.7
56
49.1
53.5
15.5
24
LRN
inductive_reasoning=false
2021.09
76.7
61.2
33.5
43.3
78.3
77.5
61.6
44.1
51.4
47.8
19.9
28.1
LRN
inductive_reasoning=true
2021.09
76.7
54.5
38.9
45.4
77.4
77.1
58.4
50.4
54.1
43.5
26.4
32.8
HY XLarge
variant=XLarge
2021.09
69.1
-
-
-
-
-
-
39.7
-
-
-
26.1
Feedback
Search any
task
Search any
task