Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Ultra-Fine Entity Typing on Ultra-Fine (test)
Loading...
81.6
Macro Recall (General)
BERT
68.6
71.975
75.35
78.725
Sep 13, 2021
Macro Recall (General)
Macro Precision (Total)
Macro Recall (Total)
Macro F1 (Total)
Macro Precision (General)
Macro F1 (General)
Macro Precision (Fine)
Macro Recall (Fine)
Macro F1 (Fine)
Macro Precision (Ultra-Fine)
Macro Recall (Ultra-Fine)
Macro F1 (Ultra-Fine)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Macro Recall (General)
Macro Precision (Total)
Macro Recall (Total)
Macro F1 (Total)
Macro Precision (General)
Macro F1 (General)
Macro Precision (Fine)
Macro Recall (Fine)
Macro F1 (Fine)
Macro Precision (Ultra-Fine)
Macro Recall (Ultra-Fine)
Macro F1 (Ultra-Fine)
BERT
implementation=in-house
2021.09
81.6
55.9
33
41.5
69.7
75.2
43.7
56
49.1
53.5
15.5
24
LRN
inductive_reasoning=false
2021.09
76.7
61.2
33.5
43.3
78.3
77.5
61.6
44.1
51.4
47.8
19.9
28.1
LRN
inductive_reasoning=true
2021.09
76.7
54.5
38.9
45.4
77.4
77.1
58.4
50.4
54.1
43.5
26.4
32.8
HY XLarge
variant=XLarge
2021.09
69.1
-
-
-
-
-
-
39.7
-
-
-
26.1
Feedback
Search any
task
Search any
task
