Commonsense Reasoning on BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA
74.6BoolQ Accuracy
DoRA
Updated 3d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2024.05 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.08 | 74.6 | 89.3 | 79.9 | 95.5 | 85.6 | 90.5 | 80.4 | 85.8 | 85.2 | |
2024.08 | 74.6 | 89.8 | 81.6 | 96 | 86.9 | 92.8 | 82.1 | 86.8 | 86.3 | |
2024.05 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2024.08 | 74.5 | 88.8 | 80.3 | 95.5 | 84.7 | 90.1 | 79.1 | 87.2 | 85 | |
2024.08 | 74.4 | 89.8 | 81.1 | 96.2 | 87.8 | 92.9 | 83 | 86.8 | 86.5 | |
2024.05 | 74.3 | 87.5 | 80.9 | 94.5 | 86.7 | 92.1 | 81.5 | 85.8 | 85.4 | |
2024.05 | 74.3 | 88.1 | 81.8 | 95.1 | 87.3 | 91.1 | 81.7 | 87.2 | 85.8 | |
2024.08 | 73.5 | 89 | 81.4 | 96 | 87.6 | 92.9 | 82.4 | 87.2 | 86.3 | |
2024.08 | 73 | 83.9 | 80.2 | 93.2 | 83 | 86.5 | 74.4 | 83 | 82.2 | |
2024.05 | 72.9 | 87.1 | 80.6 | 92.1 | 85.1 | 87.8 | 76 | 84.3 | 83.2 | |
2024.08 | 72.6 | 83.8 | 80 | 93.3 | 83 | 87.1 | 73.7 | 84.8 | 82.3 | |
2024.08 | 72 | 83.1 | 79.9 | 89.1 | 83 | 84.5 | 71 | 81.2 | 80.5 | |
2024.08 | 71.8 | 83.7 | 76 | 89.1 | 82.6 | 83.7 | 68.2 | 82.4 | 79.7 | |
2024.10 | 71.71 | 82.55 | 78.88 | 91.6 | 83.01 | 83.04 | 67.33 | 81.76 | - | |
2024.08 | 71.7 | 83 | 80.1 | 93 | 81.2 | 86 | 72.3 | 82.2 | 81.2 | |
2024.10 | 71.46 | 83.32 | 79.54 | 91.86 | 83.22 | 83.65 | 67.12 | 81.54 | - | |
2024.10 | 71.44 | 83.52 | 79.5 | 91.84 | 83.2 | 83.39 | 67.06 | 81.73 | - | |
2024.10 | 71.39 | 83.33 | 78.32 | 92.4 | 83.24 | 83.34 | 66.43 | 80.99 | - | |
2024.10 | 71.19 | 83.99 | 79.15 | 91.86 | 83.24 | 83.35 | 67.05 | 81.37 | - | |
2024.06 | 70.9 | 81.9 | 78.6 | 84.5 | 80.8 | 81.7 | 64.9 | 79.2 | 77.8 | |
2024.05 | 70.8 | 85.2 | 79.9 | 91.7 | 84.3 | 84.2 | 71.2 | 79 | 80.8 | |
2024.08 | 70.8 | 85.2 | 79.9 | 91.7 | 84.3 | 84.2 | 71.2 | 79 | 80.8 | |
2024.08 | 69.8 | 79.9 | 79.5 | 83.6 | 82.6 | 79.8 | 64.7 | 81 | 77.6 | |
2024.06 | 69.6 | 81.6 | 77.8 | 79.6 | 79.8 | 81.5 | 66.5 | 79.4 | 77 | |
2024.10 | 69.36 | 80.01 | 78.09 | 89.28 | 76.73 | 76.46 | 60.55 | 76.96 | - | |
2024.10 | 69.32 | 80.08 | 77.99 | 89.46 | 76.41 | 76.46 | 60.59 | 76.9 | - | |
2024.06 | 68.9 | 80.7 | 77.4 | 78.1 | 78.8 | 77.8 | 61.3 | 74.8 | 74.7 | |
2024.06 | 68.5 | 82.9 | 79.6 | 84.8 | 80.8 | 81.4 | 65.8 | 81 | 78.1 | |
2024.06 | 68.4 | 80.9 | 79.4 | 80.3 | 80.4 | 80.2 | 64.7 | 78.2 | 76.6 | |
2024.10 | 68.38 | 80.99 | 77.8 | 80 | 76.35 | 77.62 | 61.32 | 72.94 | - | |
2024.06 | 68.3 | 80.6 | 79.1 | 82.1 | 80 | 81.5 | 67.9 | 79.6 | 77.4 | |
2024.10 | 67.33 | 79.46 | 75.8 | 76.04 | 72.11 | 71.67 | 57.33 | 69.98 | - | |
2024.10 | 67.09 | 79.37 | 76.15 | 88.86 | 77.54 | 76.54 | 60.55 | 74.63 | - | |
2024.10 | 67.03 | 78.69 | 76.06 | 88.85 | 76.47 | 76.5 | 60.36 | 74.22 | - | |
2024.10 | 66.34 | 74.64 | 73.12 | 55.93 | 72.5 | 73.11 | 57.19 | 72.9 | - | |
2024.10 | 66.33 | 74.53 | 73.56 | 56.6 | 72.14 | 73.29 | 57.48 | 72.92 | - | |
2024.10 | 65.92 | 68.53 | 69.9 | 45.97 | 66.87 | 64.91 | 45.12 | 65.07 | - | |
2024.10 | 65.89 | 73.92 | 73.33 | 56.65 | 71.39 | 73.46 | 57.15 | 72.31 | - | |
2024.10 | 65.5 | 67.63 | 69.46 | 45.6 | 66.8 | 63.56 | 46.81 | 63.82 | - | |
2026.02 | 65.35 | 81.28 | 69.89 | 81.93 | 65.67 | 86.59 | 72.21 | 75.33 | 74.78 | |
2024.10 | 65.19 | 67.58 | 71.22 | 45.16 | 66.03 | 64.1 | 47.75 | 63.92 | - | |
2024.10 | 65.12 | 68.22 | 69.96 | 45.98 | 66.78 | 64.89 | 45.7 | 64.81 | - | |
2024.10 | 65.02 | 78.1 | 78 | 87.57 | 76.78 | 75.48 | 60.54 | 74.02 | - | |
2024.10 | 64.94 | 74.68 | 72.49 | 55.89 | 68.3 | 73.21 | 56.59 | 72.85 | - | |
2026.02 | 64.57 | 81.07 | 69.74 | 81.09 | 64.09 | 86.46 | 72.01 | 76.33 | 74.42 | |
2026.02 | 63.88 | 79.78 | 66.73 | 77.63 | 58.62 | 84.89 | 69.85 | 72.53 | 71.74 | |
2024.05 | 63.57 | 74.1 | 65.86 | 70 | 61.95 | 75.36 | 59.72 | 69 | 67.45 | |
2024.05 | 63.42 | 73.72 | 63.86 | 71.21 | 59.58 | 73.69 | 54.77 | 66.6 | 65.86 | |
2024.10 | 63.3 | 73.33 | 71.01 | 52.5 | 71.6 | 69.45 | 54.14 | 68.6 | - | |
2024.10 | 63.17 | 68.51 | 68.97 | 45.79 | 66.06 | 62.42 | 45.32 | 65.42 | - | |
2024.05 | 63.11 | 73.44 | 63.2 | 47.79 | 52.95 | 74.78 | 57.16 | 67 | 62.43 | |
2024.05 | 62.87 | 73.93 | 65.34 | 53.16 | 55.51 | 76.43 | 59.55 | 68.4 | 64.4 | |
2024.10 | 62.28 | 65.04 | 67.72 | 44.15 | 63.71 | 63.59 | 46.47 | 58.31 | - | |
2024.05 | 62.26 | 70.18 | 56.7 | 32.47 | 47.04 | 69.31 | 50.08 | 58.4 | 55.81 | |
2024.05 | 62.2 | 69.31 | 56.24 | 32.47 | 51.53 | 69.52 | 48.8 | 56.4 | 55.81 | |
2024.05 | 62.17 | 68.77 | 55.93 | 32.95 | 51.22 | 68.81 | 48.72 | 55.6 | 55.52 | |
2024.05 | 62.11 | 64.31 | 49.18 | 32 | 50.74 | 58.08 | 42.83 | 42.6 | 50.23 | |
2026.02 | 59.45 | 78.76 | 65.49 | 70.93 | 55.06 | 83.77 | 69.43 | 69.4 | 69.04 | |
2024.05 | 59.23 | 63.65 | 47.9 | 29.93 | 50.35 | 59.04 | 42.66 | 41 | 49.22 | |
2024.10 | 58.53 | 62.24 | 65.41 | 48.32 | 66.63 | 68.13 | 49.32 | 63.51 | - |