Long-context understanding on LongBench (Comprehensive Metric Set)
48.37Average Score
Llama3.1-8B
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.09 | 48.37 | 40.88 | 51.72 | 58.47 | 52.68 | 35.8 | 42.52 | 30.64 | 24.44 | 47.1 | 92.83 | 73 | 0.5 | 39 | 68.56 | 67.48 | |
2025.02 | 48.17 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 48 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.09 | 47.91 | 33.76 | 51.4 | 57.17 | 56.76 | 29.4 | 38.09 | 31.57 | 24.4 | 46.73 | 92.5 | 72 | 2 | 66.5 | 62.86 | 53.53 | |
2025.02 | 47.79 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.09 | 47.67 | 31.09 | 50.52 | 56.95 | 55.61 | 29.41 | 38.27 | 31.25 | 23.16 | 46.53 | 92.5 | 72.5 | 3 | 68 | 62.72 | 53.5 | |
2025.09 | 47.62 | 39.14 | 49.93 | 53.45 | 52.29 | 34.4 | 42.98 | 31.05 | 23.89 | 47.2 | 93.08 | 72.5 | 0.5 | 38.5 | 68.31 | 66.99 | |
2025.09 | 47.32 | 40.17 | 51.16 | 55.73 | 52.83 | 35.52 | 42.78 | 28.21 | 24.31 | 45.6 | 92.88 | 72 | 0.5 | 32.66 | 68.64 | 66.86 | |
2025.09 | 47.21 | 31.68 | 50.56 | 56.26 | 56.11 | 28.19 | 37.64 | 28.95 | 24.51 | 46.44 | 92.5 | 72 | 1.5 | 66 | 62.36 | 53.47 | |
2025.09 | 46.8 | 35.94 | 50.96 | 54.13 | 50.54 | 30.95 | 41.83 | 27.5 | 23.06 | 46.23 | 92.83 | 73 | 0.5 | 39 | 68.43 | 67 | |
2025.02 | 46.23 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.09 | 46.16 | 28.88 | 50.37 | 50.47 | 51.6 | 24.55 | 37.76 | 30.36 | 22.27 | 46.84 | 91.5 | 72 | 2.5 | 67.5 | 62.68 | 53.07 | |
2025.02 | 46.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.09 | 45.95 | 36.23 | 51.16 | 51.81 | 47.7 | 27.83 | 40.85 | 27.12 | 21.84 | 46.89 | 92.83 | 72 | 0.5 | 37.5 | 68.5 | 66.54 | |
2025.09 | 45.14 | 26.43 | 50.18 | 50.29 | 47.25 | 22.83 | 36.34 | 28.31 | 21.14 | 46.71 | 91.5 | 71.5 | 1.5 | 65.5 | 62.88 | 52.84 | |
2025.02 | 44.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 43.99 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 43.77 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 43.74 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 43.46 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 43.3 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 42.85 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 40.22 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 39.77 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 39.52 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.02 | 31.13 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |