Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Amazon Product Reviews

Benchmarks

Task NameDataset NameSOTA ResultTrend
Sequential RecommendationAmazon Product Reviews Video Games leave-one-out (test)
HR@10.0233
12
Sequential RecommendationAmazon Product Reviews Arts, Crafts and Sewing leave-one-out (test)
HR@17.56
12
Sequential RecommendationAmazon Product Reviews Musical Instruments leave-one-out (test)
HR@18.35
12
Click-through rate predictionAmazon Product Reviews Sports (test)
AUC0.6789
11
Sequential RecommendationAmazon Product Reviews Toys
R@57.38
9
Sequential RecommendationAmazon Product Reviews Sports
R@53.85
9
Sequential RecommendationAmazon Product Reviews Beauty
Recall@56.83
9
Generative RetrievalAmazon Product Reviews Beauty (test)
Average Text Performance35.72
7
Generative RetrievalAmazon Product Reviews Toys and Games (test)
Avg Text Performance35.72
7
Generative RetrievalAmazon Product Reviews Sports and Outdoors (test)
Avg Text Perf.35.72
7
Review Generation EvaluationAmazon Product Reviews Third-party (test)
Helpfulness56
4
Generative RecommendationAmazon Product Reviews Toys (test)
Entropy@102.574
3
Generative RecommendationAmazon Product Reviews Beauty (test)
Entropy@102.551
3
Sentiment PredictionAmazon Product Reviews Scenario 6 MEDIAN
Net Consumption (ALL)3.2
1
Sentiment PredictionAmazon Product Reviews Scenario 5 LOW
Net Consumption (ALL)4.5
1
Sentiment PredictionAmazon Product Reviews Scenario 3 HIGH
Net Consumption (ALL) (%)3.3
1
Sentiment PredictionAmazon Product Reviews Scenario 2 HIGH
Net Consumption (ALL)3.8
1
Sentiment PredictionAmazon Product Reviews Scenario 1 HIGH
Net Consumption (ALL)4.1
1
Sentiment PredictionAmazon Product Reviews Base
Net Consumption (ALL)3.6
1
Showing 19 of 19 rows