Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Context Compression on HotpotQA (val)
Loading...
1.6
TFLOPs (Read)
RECOMP-Abst
1.1424
4.2312
7.32
10.4088
Dec 17, 2024
TFLOPs (Read)
TFLOPs (Comp)
Latency (s)
Speedup
Updated 3mo ago
Evaluation Results
Method
Method
Links
TFLOPs (Read)
TFLOPs (Comp)
Latency (s)
Speedup
RECOMP-Abst
GPU=A100-80GB
2024.12
1.6
0.54
2.31
0.41
RECOMP-Extr
GPU=A100-80GB
2024.12
1.84
0.27
0.39
2.43
CompAct
GPU=A100-80GB
2024.12
2.05
18.35
12.86
0.07
Refiner
GPU=A100-80GB
2024.12
2.51
15.03
6.78
0.14
EXIT
GPU=A100-80GB
2024.12
2.96
35.44
0.88
1.08
LongLLMLingua
GPU=A100-80GB
2024.12
5.06
46.39
0.82
1.16
Original Docs
GPU=A100-80GB
2024.12
13.04
-
0.95
1
Feedback
Search any
task
Search any
task