Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Inference Efficiency on TQA
Loading...
0.05
Relative Execution Time Overhead
Perplexity
-0.23872
1.71014
3.659
5.60786
Mar 20, 2026
Relative Execution Time Overhead
Updated 26d ago
Evaluation Results
Method
Method
Links
Relative Execution Time Overhead
Perplexity
Model=Qwen2.5-14B
2026.03
0.05
Perplexity
Model=Llama-2-7B
2026.03
0.066
Perplexity
Model=Qwen2.5-7B
2026.03
0.094
Perplexity
Model=Qwen2.5-3B
2026.03
0.096
Perplexity
Model=Mistral-7B
2026.03
0.102
Perplexity
Model=Llama-3-8B
2026.03
0.13
STC
Model=Llama-2-7B
2026.03
2.329
STC
Model=Mistral-7B
2026.03
2.908
STC
Model=Qwen2.5-14B
2026.03
5.866
STC
Model=Llama-3-8B
2026.03
6.833
STC
Model=Qwen2.5-3B
2026.03
6.946
STC
Model=Qwen2.5-7B
2026.03
7.268
Feedback
Search any
task
Search any
task