ScanQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| 3D Question Answering | ScanQA (val) | CIDEr107.1 | 133 | |
| 3D Question Answering | ScanQA w/ objects (test) | EM@131.29 | 55 | |
| 3D Question Answering | ScanQA w/o objects (test) | EM@130.87 | 51 | |
| 3D Question Answering | ScanQA v1.0 (test) | ROUGE72.7 | 26 | |
| 3D Question Answering | ScanQA (test) | BLEU-413.9 | 20 | |
| 3D Question Answering | ScanQA | C Score102.1 | 16 | |
| Question Answering | ScanQA v1.0 (val) | EM@122.59 | 16 | |
| 3D Question Answering | ScanQA v1.0 (val) | BLEU-416.2 | 13 | |
| 3D Visual Question Answering | ScanQA | C Score87.7 | 10 | |
| 3D Scene Question Answering | ScanQA | M Score22.9 | 6 | |
| 3D Question Answering | ScanQA Leaderboard as of Nov 2023 (test) | EM30.82 | 5 | |
| Object localization | ScanQA w/ objects (test) | Acc@0.2525.44 | 3 | |
| Object localization | ScanQA (val) | Acc@0.2524.96 | 3 |
Showing 13 of 13 rows