Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Personalization on Mnemonic (test)
Loading...
0.644
Personalization Win Rate
PTDPO
0.39856
0.46228
0.526
0.58972
Jan 20, 2025
Personalization Win Rate
Personalization Tie Rate
Personalization Loss Rate
Quality Win Rate
Quality Tie Rate
Quality Loss Rate
Delta Preference Quality Score
Updated 5mo ago
Evaluation Results
Method
Method
Links
Personalization Win Rate
Personalization Tie Rate
Personalization Loss Rate
Quality Win Rate
Quality Tie Rate
Quality Loss Rate
Delta Preference Quality Score
PTDPO
Persona Source=Pretr,...
2025.01
0.644
0.26
0.096
0.278
0.332
0.39
0.286
PTFS
Persona Source=Pretr,...
2025.01
0.443
0.285
0.272
0.464
0.205
0.331
0.203
PTSFT
Persona Source=Pretr,...
2025.01
0.408
0.383
0.209
0.352
0.352
0.295
0.205
Feedback
Search any
task
Search any
task
