SOTA Text Generation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
DomainBench	SYTTA-16	BLEU (Agriculture)71.37	144	23d ago
OpenWebText	SDTT	Perplexity3.18	86	1mo ago
LM1B (test)	UDLM	Entropy2.46	72	1mo ago
CNN/Daily Mail (test)	DEL	COH Score83	64	1mo ago
Medical Chatbot		ASR100	42	1mo ago
OWT	DFM (ESD)	GPT2 Perplexity5.33	41	4d ago
5 Generation tasks	POP	Accuracy57.96	36	1mo ago
Text Generation		PPL11.9	33	1mo ago
Text model inference M4 Max	vllm-mlx	Throughput (tok/s)525.5	31	1mo ago
MSCOCO	SARE	BLEU-157.2	26	1mo ago
LM1B	DFM (ESD)	Perplexity (PPL)68.11	24	4d ago
Wikitext-103	Refined by Gemma3 27B	Perplexity32.88	23	4d ago
Spec-Bench Overall	SpecBound	SD Score2.33	21	3d ago
NoveltyBench	STATe of Thoughts	Diversity5.39	21	1mo ago
AbGen	ROMA	Importance4.91	20	1mo ago
Open Web Text (OWT) (val)	Masked D-MMD	GPT-2 GM Score0.456	19	26d ago
Aggregate NLP Tasks (GEC, Smart Reply, Summarization, Tone Adjustment, QA) (test)		Average Score32.9	18	1mo ago
WebNLG seen categories (test)	CGE-LW	BLEU63.69	18	1mo ago
Hazard Detection (val)	Qwen2-VL-7B ft	BLEU-40.658	17	19d ago
FuseEval English Scenario	SpecEM	ROUGE-131.19	16	1mo ago
Decoding Throughput		Decoding Throughput (tokens/s)320	16	1mo ago
Wikipedia Biographies (test)	Pretrained	Delta Precision (δ-P)25.37	16	1mo ago
VPI Generation Tasks Llama3-8B Mistral-7B (test)		ASR100	16	1mo ago
AutoPoison Generation Llama3-8B Mistral-7B (test)		ASR82.7	16	1mo ago
DTBA Llama3-8B Mistral-7B (test)		ASR77	16	1mo ago

Showing 25 of 121 rows