Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Inference Efficiency on HAGRID
Loading...
4.75
#MAT
SAM-Decoding[E2]
1.3284
2.2167
3.105
3.9933
Nov 16, 2024
#MAT
Tokens/s
Speedup
Updated 3d ago
Evaluation Results
Method
Method
Links
#MAT
Tokens/s
Speedup
SAM-Decoding[E2]
Backbone=Vicuna-7B-v1....
2024.11
4.75
96.6
2.81
EAGLE-2
Backbone=Vicuna-7B-v1....
2024.11
4.15
82.61
2.41
SAM-Decoding[T]
Backbone=Vicuna-7B-v1....
2024.11
3.23
87.93
2.57
Token Recycling
Backbone=Vicuna-7B-v1....
2024.11
2.88
66.17
1.93
SAM-Decoding
Backbone=Vicuna-7B-v1....
2024.11
2.44
76.72
2.24
PIA
Backbone=Vicuna-7B-v1....
2024.11
2.43
66.65
1.95
PLD
Backbone=Vicuna-7B-v1....
2024.11
2.03
44.11
1.29
REST*
Backbone=Vicuna-7B-v1....
2024.11
1.53
24.91
1.39
Lookahead*
Backbone=Vicuna-7B-v1....
2024.11
1.46
23.58
1.32
Feedback
Search any
task
Search any
task