Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Efficiency Evaluation on NQ (test)
Loading...
3.79
Inference Time (h)
closed-book
3.4504
5.7427
8.035
10.3273
Jun 5, 2025
Inference Time (h)
Compression Time
Total Time (h)
Throughput (ex/sec)
Updated 4d ago
Evaluation Results
Method
Method
Links
Inference Time (h)
Compression Time
Total Time (h)
Throughput (ex/sec)
closed-book
Reader LLM=Flan-UL2
2025.06
3.79
-
3.79
0.26
RECOMP
Reader LLM=Flan-UL2
2025.06
4.08
0.27
4.35
0.23
ECoRAG
Reader LLM=Flan-UL2
2025.06
4.23
0.73
4.96
0.2
CompAct
Reader LLM=Flan-UL2
2025.06
4.83
10.1
14.94
0.07
standard RAG
Reader LLM=Flan-UL2
2025.06
12.28
-
12.28
0.08
Feedback
Search any
task
Search any
task