Factual Question Answering on AURATown environment-grounded queries N=50, 3 seeds 1.0
76.6Factual Accuracy
Fixed-Probe
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.06 | 76.6 | 8 | 56 | 3.2 | 10 | 0.006 | |
2026.06 | 76.4 | 4.64 | 58.7 | 5.2 | - | 0.004 | |
2026.06 | 69.6 | 1.4 | 75.3 | 4.3 | 10 | 0.098 | |
2026.06 | 64 | 0 | 66.7 | 3.9 | 0.001 | - | |
2026.06 | 60.3 | 0 | 75.3 | 2.2 | 0.0005 | 0.06 | |
2026.06 | 55 | - | 51.3 | 6 | 0.1 | 0.033 | |
2026.06 | 45 | 0 | 70 | 1.8 | 0.032 | 10 | |
2026.06 | 17.4 | 2.15 | 55.9 | 20.6 | - | 10 | |
2026.06 | 7 | 0 | 93.3 | 2.3 | - | 10 |