SOTA Text Compression benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
Reddit conversational text n=200 (test)	Llama SFT	BERTScore F1 (r_keep=0.9)99.46	14	5d ago
Wikipedia Salesforce/wikitext (test)	Llama SFT	BERTScore F1 (r_keep=0.9)0.9862	13	5d ago
Wiki-40B 6160MB	R-L1	Description Length (MB)971	8	20d ago
Wiki-40B	R-L1	Compressed Size (MB)214	8	20d ago
Wiki-40B 300MB	DRR	Description Length (MB)61	8	20d ago
LMSYS-Chat (Cluster 9: Casual Q&A)	Correct LoRA	Compression Ratio0.1	6	1mo ago
LMSYS-Chat Cluster 8: Translation Language	Correct LoRA	Compression Ratio0.08	6	1mo ago
LMSYS-Chat Cluster 7: Science/Math		Compression Ratio0.39	6	1mo ago
LMSYS-Chat Cluster 6: Philosophy/Ethics	Correct LoRA	Compression Ratio0.09	6	1mo ago
LMSYS-Chat (Cluster 5: Business/Professional)	Correct LoRA	Compression Ratio0.09	6	1mo ago
LMSYS-Chat Cluster 4: Roleplay Fiction		Compression Ratio0.4	6	1mo ago
LMSYS-Chat Cluster 3: Academic/Education	Correct LoRA	Compression Ratio0.09	6	1mo ago
LMSYS-Chat Cluster 2: Code/Technical	Correct LoRA	Compression Ratio0.1	6	1mo ago
LMSYS-Chat Cluster 1: Creative Writing	Correct LoRA	Compression Ratio0.11	6	1mo ago
LMSYS-Chat Cluster 0: General Chat	Correct LoRA	Compression Ratio0.11	6	1mo ago
LMSYS-Chat Overall	Correct LoRA	Compression Ratio0.09	6	1mo ago
Estonian Corpus	Llama-3.2-1B	Compression Ratio4.46	6	3mo ago
SciTLDR (test)	CATT	ROUGE-1 F144.9	4	2mo ago
English Corpus	Llama-3.2-1B	Compression Ratio4.86	2	3mo ago

Showing 19 of 19 rows