Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Pairwise Human Preference Prediction on Stanford Human Preferences (SHP) (held-out)
Loading...
75
Accuracy (r/askhr)
Supervised Model (RM)
49
55.75
62.5
69.25
Mar 3, 2026
Accuracy (r/askhr)
Accuracy (r/askbaking)
Accuracy (r/askculinary)
Accuracy (r/askhistorians)
Accuracy (r/changemyview)
Accuracy (r/asksocialscience)
Accuracy (r/asksciencefiction)
Updated 4mo ago
Evaluation Results
Method
Method
Links
Accuracy (r/askhr)
Accuracy (r/askbaking)
Accuracy (r/askculinary)
Accuracy (r/askhistorians)
Accuracy (r/changemyview)
Accuracy (r/asksocialscience)
Accuracy (r/asksciencefiction)
Supervised Model (RM)
Model Architecture=Ste...
2026.03
75
65
72
74
68
80
72
Local Acceptance Density
Base Model=Pythia-2.8B...
2026.03
71
60
57
72
61
64
65
Global Acceptance Density
Base Model=Pythia-2.8B...
2026.03
68
53
51
60
57
59
49
kNN
Base Model=Pythia-2.8B
2026.03
55
49
50
58
49
50
52
Random
Base Model=Pythia-2.8B
2026.03
50
50
50
50
50
50
50
Feedback
Search any
task
Search any
task