Text-to-SQL on BiomedSQL (test)
90Execution Accuracy (EX)
Domain Expert
Updated 1mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2025.05 | 90 | 90 | 95 | - | - | |
2025.05 | 62.6 | 69.2 | 83.1 | 38 | 2.6 | |
2025.05 | 61.2 | 63.6 | 81.4 | 42.1 | 0 | |
2025.05 | 60.4 | 67.2 | 79.8 | 64.5 | 4.9 | |
2025.05 | 58.4 | 59.7 | 80.6 | 35.8 | 0 | |
2025.05 | 58.1 | 62.4 | 81.8 | 52.4 | 0 | |
2025.05 | 56.2 | 64.8 | 73.6 | 13.2 | 0 | |
2025.05 | 55.9 | 61.3 | 84.6 | 32.1 | 0.2 | |
2025.05 | 54.8 | 58.1 | 75.5 | 63.4 | 6.6 | |
2025.05 | 53.5 | 60.4 | 73.3 | 29.4 | 0.2 | |
2025.05 | 53.1 | 58.8 | 82.8 | 30.6 | 0 | |
2025.05 | 49.6 | 57.9 | 67.2 | 8.9 | 0 | |
2025.05 | 48.9 | 56.6 | 60.4 | 10.2 | 0 | |
2025.05 | 48.5 | 54.6 | 75.3 | 35.6 | 2.7 | |
2025.05 | 46.9 | 54.7 | 71.2 | 26.1 | 1.3 | |
2025.05 | 46.1 | 48.5 | 54.2 | 59.6 | 8.1 | |
2025.05 | 45.4 | 49.8 | 69.8 | 43 | 1.6 | |
2025.05 | 40.8 | 44.4 | 58.2 | 61 | 15.7 | |
2025.05 | 38.1 | 42.5 | 57.9 | 41.7 | 4.6 | |
2025.05 | 37 | 32.4 | 62.1 | 42.5 | 11 | |
2025.05 | 34.4 | 39.8 | 57 | 37 | 6 | |
2025.05 | 33.7 | 37 | 71.1 | 27.2 | 4.2 | |
2025.05 | 27.1 | 30.6 | 44.1 | 47.5 | 2 | |
2025.05 | 25.5 | 28.3 | 44.1 | 66.9 | 27.5 |