Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Short-form generation on 1D-DiffTask Short-form generation
Loading...
64
PRR
MSP
5.76
20.88
36
51.12
Apr 13, 2026
PRR
Updated 4d ago
Evaluation Results
Method
Method
Links
PRR
MSP
Model=Gemma-2-9B
2026.04
64
HBO
Model=Gemma-2-9B
2026.04
64
MSP
Model=Llama 3.1-8B
2026.04
57
HBO
Model=Llama 3.1-8B
2026.04
57
SATRMD-MSP
Model=Gemma-2-9B
2026.04
52
SAPLMA (mid)
Model=Llama 3.1-8B
2026.04
32
SATMD-MSP
Model=Gemma-2-9B
2026.04
27
HUQ-SATMD
Model=Llama 3.1-8B
2026.04
24
HUQ-SATRMD
Model=Llama 3.1-8B
2026.04
22
SATRMD-MSP
Model=Llama 3.1-8B
2026.04
21
SAPLMA (mid)
Model=Gemma-2-9B
2026.04
21
HUQ-SATMD
Model=Gemma-2-9B
2026.04
17
HUQ-SATRMD
Model=Gemma-2-9B
2026.04
17
SATMD-MSP
Model=Llama 3.1-8B
2026.04
8
Feedback
Search any
task
Search any
task