Generation Quality on RedPajama Generation Quality Prefixes (test)
32.4Standard Prefix Count
Self-Improving Pretraining: RF-NLL (rollout vs. rewrite)
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| 32.4 | 12.1 | ||
| 5.3 | 25.8 | ||
2026.01 | 1.6 | 2.4 | |
2026.01 | 1.3 | 2.4 |
Self-Improving Pretraining: RF-NLL (rollout vs. rewrite)
| Method | Links | ||
|---|---|---|---|
| 32.4 | 12.1 | ||
| 5.3 | 25.8 | ||
2026.01 | 1.6 | 2.4 | |
2026.01 | 1.3 | 2.4 |