Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

held-out

Benchmarks

Task NameDataset NameSOTA ResultTrend
Diagnosis PredictionHeld-out (test)
Median AUROC0.932
66
Sycophancy MitigationHeld-out
BRR43.6
40
Multi-path Speculative DecodingHeld-out (test)
Average Block Efficiency6.84
24
Tissue Boxheld-out N=50 randomized configurations (test)
Hand RMS Jerk0.122
22
Toy Rearrangementheld-out N=50 randomized configurations (test)
Hand RMS Jerk2.94
22
Peach Preparationheld-out N=50 randomized configurations (test)
Hand RMS Jerk4.086
22
Apple Preparationheld-out N=50 randomized configurations (test)
Hand RMS Jerk8.725
22
BargainingHeld-Out (test)
Reward0.7664
16
Query routing and tool-calling accuracy evaluationHeld-out 12,282 examples (test)
Accuracy89.39
15
Adversarial Attack DetectionHeld-out n = 560 (20% stratified test)
Detection Rate89.1
11
Steak Season.Held-out (test)
RMS Jerk2.132
11
Response Quality EvaluationHeld-out n=300 (test)
Pearson Correlation Coefficient0.747
8
Win probability forecastingHeld-out 2024 n=5185 (held-out)
Brier Score0.1355
7
Inverse KinematicsHeld-out (test)
Mean Error (mm)0
7
SUVR-to-PET RetrievalHeld-out 153 subjects (test)
Rank-1 Retrieval92.2
6
PET-to-SUVR RetrievalHeld-out 153 subjects (test)
R@177.8
6
SUVR PredictionHeld-out 153 subjects (test)
MAE0.07
6
Tone MappingHeld-out (test)
PSNR40.59
6
Clinical case generationHeld-out (test)
BLEU-418.98
6
Actuarial projectionHeld-out (test)
MAE0.0198
5
Selective ClassificationHeld-out (test)
Coverage100
5
Pairwise preference rankingHeld-out
ELO Score1,187
5
License Plate Recognitionheld-out (test)
Plate Accuracy92.3
5
Event-level market-impact predictionHeld-out 2021-2023 (test)
Non-neutral F135.6
4
Binary-level classificationheld-out (test)
Accuracy98.4
4
Showing 25 of 29 rows