LaMP
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Human alignment evaluation | LaMP Citation Identification, Movie Tagging, and Product Rating (test) | Pos Score100 | 56 | |
| Tweet Paraphrasing/Generation | LaMP Tweet | ROUGE-142.2 | 36 | |
| News Headline Generation | LaMP News | RG118.8 | 36 | |
| Personalized Scholarly Refinement | LaMP-5 | Rouge-L40.5 | 32 | |
| Scholarly Abstract Generation | LaMP Scholar | ROUGE-144.6 | 24 | |
| Product Rating Prediction | LaMP Rating | MAE0.236 | 24 | |
| Movie Recommendation | LaMP Movie | Accuracy57 | 24 | |
| Citation Recommendation | LaMP Citation | Accuracy73.8 | 24 | |
| LaMP-3 Personalization | LaMP-3 (val) | MAE0.231 | 23 | |
| Personalized News Categorization | LaMP 2N | Accuracy83.8 | 22 | |
| Personalized Movie Tagging | LaMP-2M | Accuracy75.1 | 22 | |
| Personalization | LaMP-2 | Acc67.9 | 22 | |
| Scholarly Title Generation | LaMP Scholarly Title Generation | ROUGE-143.75 | 21 | |
| Personalization | LaMP-3 | MAE0.241 | 21 | |
| LaMP-1 Personalization | LaMP-1 (val) | Accuracy68.2 | 21 | |
| Product Rating | LaMP-3 1.0 (test) | MAE0.195 | 19 | |
| Movie Tagging | LaMP-2 Personalized Movie Tagging 1.0 (test) | Accuracy69 | 19 | |
| Scholarly Title Generation | LaMP-5 1.0 (test) | ROUGE-10.483 | 17 | |
| Categorical classification | LaMP-2 (test) | Accuracy66.1 | 16 | |
| Personalized News Categorization | LaMP-2N 1.0 (test) | Accuracy82.6 | 15 | |
| Personalized Citation Identification | LaMP-1 1.0 (test) | Accuracy81.3 | 15 | |
| Personalized Scholarly Title Generation | LaMP-5 | R-1 Score53.8 | 15 | |
| Personalized Product Rating | LaMP-3 | MAE0.17 | 15 | |
| Personalized Classification | LaMP-2 (val) | Accuracy53.1 | 14 | |
| Maximum Inner Product Search | LaMP Rating (test) | Top-1 Accuracy100 | 14 |
Showing 25 of 83 rows