Generative Retrieval

Benchmarks

Dataset Name	SOTA Method	Metric
Industrial Dataset	ADC-SID	Reconstruction Loss0.0031	14	2mo ago
MS-MARCO new documents		R@100.772	11	3mo ago
MS-MARCO initial documents		R@100.775	11	3mo ago
NQ new documents		R@169.3	11	3mo ago
NQ initial documents		R@169.6	11	3mo ago
Musical Instruments	SID-MLP	NDCG@100.0332	10	20d ago
JD.com industrial dataset (test)		Hallucination Rate5.75	8	1mo ago
VK-LSVD (block 10)	LETTER (FT-old)	Recall@104.32	8	1mo ago
Yambda (block 10)	LETTER (FT-ours, Hungarian)	Recall@101.44	8	1mo ago
Beauty (block 10)	LETTER (Full)	Recall@102.54	8	1mo ago
AE-PV (test)	Sentence-T5	Hit Rate @ 12.23	8	2mo ago
AOL4PS (test)	DGI	Hit Rate @150.52	8	2mo ago
Amazon Product Reviews Beauty (test)		Average Text Performance35.72	7	21d ago
Amazon Product Reviews Toys and Games (test)		Avg Text Performance35.72	7	21d ago
Amazon Product Reviews Sports and Outdoors (test)		Avg Text Perf.35.72	7	21d ago
Amazon Beauty	MMQ	L_recon0.447	7	3mo ago
Pinterest Search (test)	PinRec-OC	Unordered Recall@1035.2	6	3mo ago
Pinterest Related Pins (test)	HSTU	Unordered Recall@1053.9	6	3mo ago
Pinterest Home Feed (test)	PinRec-OC	Unordered Recall@1062.5	6	3mo ago
BEIR		nDCG@10 (ArguAna)42.5	5	1mo ago
OxygenREC	OCP	Hit@123.94	4	2mo ago
Large-scale e-commerce platform Online Traffic A/B (test)	ADC-SID	Advertising Revenue Uplift3.5	1	2mo ago

Showing 22 of 22 rows