Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Text Compression on SciTLDR (test)
Loading...
44.9
ROUGE-1 F1
CATT
-0.5376
11.2587
23.055
34.8513
Apr 2, 2026
ROUGE-1 F1
ROUGE-2 F1
ROUGE-L F1
BERTScore F1
SMOG Index
Compression Ratio
Updated 16d ago
Evaluation Results
Method
Method
Links
ROUGE-1 F1
ROUGE-2 F1
ROUGE-L F1
BERTScore F1
SMOG Index
Compression Ratio
CATT
2026.04
44.9
22.6
37.3
-
-
47.3
Full FT
Training Duration=5ep,...
2026.04
1.31
0.014
1.3
54.74
23.26
22.43
Llama 3.2 3B Instruct
Parameters=3B, Series=...
2026.04
1.21
0.011
1.21
54.55
24.45
20.72
Llama 3.1 8B Instruct
Parameters=8B, Series=...
2026.04
1.21
0.014
1.21
54.57
24.81
20.79
Feedback
Search any
task
Search any
task