Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Open-domain Visual Entity Recognition on OVEN Wiki (human evaluation set)
Loading...
76.1
Score (Seen Entities)
Human+Search
1.74
21.045
40.35
59.655
Feb 22, 2023
Score (Seen Entities)
Score (Unseen Entities)
Harmonic Mean Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Score (Seen Entities)
Score (Unseen Entities)
Harmonic Mean Score
Human+Search
Note=Human performance...
2023.02
76.1
79.3
77.7
PaLI-17B
# Params=17B, Training...
2023.02
40.3
26
31.6
PaLI-3B
# Params=3B, Training...
2023.02
30.5
15.8
20.8
CLIP Fusion ViT-L/14
# Params=0.88B, Traini...
2023.02
18
2.9
5
CLIP2CLIP ViT-L/14
# Params=0.86B, Traini...
2023.02
14
11.1
12.4
CLIP ViT-L/14
# Params=0.42B, Traini...
2023.02
4.6
6
5.2
Feedback
Search any
task
Search any
task