Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LaMP

Benchmarks

Task NameDataset NameSOTA ResultTrend
Tweet Paraphrasing/GenerationLaMP Tweet
ROUGE-142.2
36
News Headline GenerationLaMP News
RG118.8
36
Personalized Scholarly RefinementLaMP-5
Rouge-L40.5
32
Scholarly Abstract GenerationLaMP Scholar
ROUGE-144.6
24
Product Rating PredictionLaMP Rating
MAE0.236
24
Movie RecommendationLaMP Movie
Accuracy57
24
Citation RecommendationLaMP Citation
Accuracy73.8
24
LaMP-3 PersonalizationLaMP-3 (val)
MAE0.231
23
PersonalizationLaMP-2
Acc67.9
22
Scholarly Title GenerationLaMP Scholarly Title Generation
ROUGE-143.75
21
PersonalizationLaMP-3
MAE0.241
21
LaMP-1 PersonalizationLaMP-1 (val)
Accuracy68.2
21
Scholarly Title GenerationLaMP-5 1.0 (test)
ROUGE-10.483
17
Categorical classificationLaMP-2 (test)
Accuracy66.1
16
Personalized ClassificationLaMP-2 (val)
Accuracy53.1
14
Maximum Inner Product SearchLaMP Rating (test)
Top-1 Accuracy100
14
Maximum Inner Product SearchLaMP Movie (test)
Top-1 Accuracy100
14
Personalized Text GenerationLaMP-7 (val)
ROUGE-1 Score53.5
13
Multi-Objective Bayesian OptimizationLAMP
Hypervolume0.648
10
Personalized Question AnsweringLaMP-QA
Accuracy (Arts & Entertainment)53.27
10
News HeadlineLaMP News Headline
ROUGE-1 Score21.5
9
Topic WritingLaMP Topic Writing
ROUGE-10.291
9
Review WritingLaMP Review Writing
ROUGE-135.3
9
Abstract GenerationLaMP Abstract Gen.
ROUGE-139.8
9
News Headline GenerationLaMP News Headline (test)
ROUGE-115.1
9
Showing 25 of 65 rows