Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Amazon Reviews

Benchmarks

Task NameDataset NameSOTA ResultTrend
Indirect Prompt InjectionAmazon Reviews
ASR99.8
47
Sequential RecommendationAmazon Reviews 8 Domains
NDCG@10 (Avg)89.4
36
Sentiment AnalysisAmazon Reviews (test)
Average Accuracy91.74
24
Attribute Value ExtractionAmazon Reviews 2023
F1LLM88.4
21
Review RankingAmazon Reviews 2023 (test)
N@1 (All_Beauty)0.713
19
Cross-domain recommendationAmazon Reviews Movies → Music
MAE0.4348
18
Sentiment AnalysisAmazon Reviews 31
MCI22.57
16
Transfer Performance PredictionAmazon Reviews (test)
Mean Spearman Correlation7.72
16
Sentiment AnalysisAmazon Reviews
F1 Score58.9
16
Personalized Text GenerationAmazon Reviews Books, Movies_and_TV, and CDs_and_Vinyl 2023
R-10.273
14
RecommendationAmazon Reviews Arts, Crafts & Sewing
Hit Rate @ 157.8
14
RecommendationAmazon Reviews Sports & Outdoors
H@151.6
14
RecommendationAmazon Reviews Toys & Games
H@149.8
14
RecommendationAmazon Reviews Beauty & Personal Care
H@149.1
14
Membership Inference AttackAmazon Reviews
AUC0.901
14
Selective ClassificationAmazon Reviews Covariate Shift
AURC22.2
13
Selective ClassificationAmazon Reviews (In-Distribution)
AURC20.6
13
Sequential RecommendationAmazon Reviews Industrial-and-Scientific (test)
Recall@511.76
12
Sequential RecommendationAmazon Reviews Video-Games (test)
Recall@56.55
12
Sequential RecommendationAmazon Reviews Office-Products (test)
Recall@513.81
12
Sequential RecommendationAmazon Reviews Games 2023 (test)
Recall@56.18
12
Sequential RecommendationAmazon Reviews Scientific 2023 (test)
Recall@53.04
12
Sequential RecommendationAmazon Reviews Instruments 2023 (test)
Recall@54.01
12
Sequential RecommendationAmazon Reviews Sports (test)
HR@10.0162
11
Sequential RecommendationAmazon Reviews Toys (test)
HR@10.0334
11
Showing 25 of 65 rows