Generative Retrieval

Benchmarks

Dataset Name	SOTA Method	Metric
Industrial Dataset	ADC-SID	Reconstruction Loss0.0031	14	4mo ago
MS-MARCO new documents		R@100.772	11	4mo ago
MS-MARCO initial documents		R@100.775	11	4mo ago
NQ new documents		R@169.3	11	4mo ago
NQ initial documents		R@169.6	11	4mo ago
Musical Instruments	SID-MLP	NDCG@100.0332	10	2mo ago
Yandex Music dataset		Recall@1030.13	8	1mo ago
JD.com industrial dataset (test)		Hallucination Rate5.75	8	2mo ago
VK-LSVD (block 10)	LETTER (FT-old)	Recall@104.32	8	3mo ago
Yambda (block 10)	LETTER (FT-ours, Hungarian)	Recall@101.44	8	3mo ago
Beauty (block 10)	LETTER (Full)	Recall@102.54	8	3mo ago
AE-PV (test)	Sentence-T5	Hit Rate @ 12.23	8	4mo ago
AOL4PS (test)	DGI	Hit Rate @150.52	8	4mo ago
Amazon Product Reviews Beauty (test)		Average Text Performance35.72	7	2mo ago
Amazon Product Reviews Toys and Games (test)		Avg Text Performance35.72	7	2mo ago
Amazon Product Reviews Sports and Outdoors (test)		Avg Text Perf.35.72	7	2mo ago
Amazon Beauty	MMQ	L_recon0.447	7	4mo ago
Pinterest Search (test)	PinRec-OC	Unordered Recall@1035.2	6	4mo ago
Pinterest Related Pins (test)	HSTU	Unordered Recall@1053.9	6	4mo ago
Pinterest Home Feed (test)	PinRec-OC	Unordered Recall@1062.5	6	4mo ago
BEIR		nDCG@10 (ArguAna)42.5	5	2mo ago
Industrial Multi-scenario Retrieval Dataset	UniSGR-M	HR@5015.79	4	18d ago
D4 (pattern-holdout)	HPPO	AUC0.6216	4	29d ago
D4 (item-holdout)	HPPO	AUC0.6561	4	29d ago
D3 (pattern-holdout)	HPPO	AUC58.1	4	29d ago

Showing 25 of 37 rows