3D Question Answering on ScanQA (test)
13.9BLEU-4
NaviLLM
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2023.12 | 13.9 | - | 16.6 | 40.2 | 80.8 | 26.3 | - | |
2024.06 | 12.4 | 39.5 | 13.4 | 35.9 | 68.8 | - | - | |
2023.07 | 12 | 31.6 | 13.5 | 34.3 | 67.3 | 23.5 | - | |
2023.12 | 12 | - | 13.5 | 34.3 | 67.3 | 23.5 | - | |
2024.06 | 12 | 39.3 | 14.5 | 35.7 | 69.4 | - | - | |
2023.07 | 11.6 | 38.3 | 14.9 | 35.3 | 69.6 | 19.1 | - | |
2023.12 | 11.6 | - | 14.9 | 35.3 | 69.6 | 19.1 | - | |
2023.07 | 10.7 | 37.3 | 14.3 | 34.5 | 67.1 | 19.1 | - | |
2024.06 | 10.1 | 30.2 | 13.1 | 33.3 | 64.9 | - | - | |
2023.07 | 8.4 | 32.6 | 13.5 | 34.8 | 65.6 | 23.2 | - | |
2023.12 | 8.4 | - | 13.5 | 34.8 | 65.6 | 23.2 | - | |
2024.06 | 8.4 | 25.6 | 11.3 | 31.1 | 55 | - | - | |
2024.06 | 7.9 | 26.9 | 11.5 | 30 | 55.4 | - | - | |
2023.07 | 7.5 | 27.9 | 11.9 | 30.7 | 57.4 | 20.6 | - | |
2023.12 | 7.5 | - | 11.9 | 30.7 | 57.4 | 20.6 | - | |
2024.06 | 6.2 | 28 | 11.4 | 29.8 | 54.7 | - | - | |
2023.07 | 6 | 29.5 | 12 | 30.9 | 58.2 | 19.7 | - | |
2023.12 | 6 | - | 12 | 30.9 | 58.2 | 19.7 | - | |
2024.06 | 5.9 | 29.7 | 11.3 | 26.6 | 45.7 | - | - | |
2023.07 | 0 | 16.5 | 8.4 | 21.5 | 38.6 | 15.8 | - | |
2023.12 | - | - | - | - | - | - | 19.1 | |
2023.12 | - | - | - | - | - | - | 26.3 |