Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Retrieval on Clevr v1 (test)
Loading...
0
Avg Cost per Query
MIPS
-0.0152
0.0874
0.19
0.2926
Jun 23, 2024
Avg Cost per Query
F1 Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Avg Cost per Query
F1 Score
MIPS
Condition=obj_count < 4
2024.06
0
2.3
MIPS
Condition=# spheres > 3
2024.06
0
14.5
UDF
Condition=obj_count < 4
2024.06
0.08
-
UDF
Condition=# spheres > 3
2024.06
0.08
-
UQE
Condition=obj_count < 4
2024.06
0.08
-
UQE
Condition=# spheres > 3
2024.06
0.08
-
lc-claude-3-opus
Condition=obj_count < 4
2024.06
0.21
-
lc-claude-3-opus
Condition=# spheres > 3
2024.06
0.21
-
lc-gpt-4-turbo
Condition=obj_count < 4
2024.06
0.38
-
lc-gpt-4-turbo
Condition=# spheres > 3
2024.06
0.38
-
Feedback
Search any
task
Search any
task