| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ScanQA (val) | CVP | CIDEr107.1 | 290 | 7d ago | |
| SQA3D (test) | PolyV | EM@164.8 | 131 | 7d ago | |
| SQA3D | Cog3DMap-8B | EM61.3 | 69 | 1mo ago | |
| VSI-Bench | VLM-3R | Room Size Accuracy67.1 | 56 | 22d ago | |
| ScanQA w/ objects (test) | BridgeQA | EM@131.29 | 55 | 3mo ago | |
| ScanQA w/o objects (test) | BridgeQA | EM@130.87 | 51 | 3mo ago | |
| ScanQA | 3DRS | EM (Exact Match)30.3 | 48 | 1mo ago | |
| SQA3D | GPT4Scene | Exact Match (EM)60.6 | 34 | 1d ago | |
| ScanQA v1.0 (test) | C2RoPE | BLEU-423 | 28 | 5d ago | |
| MSQA | SCENECOT | Count Accuracy47.9 | 25 | 1mo ago | |
| Beacon3D | MAG-3D | Case Score65 | 23 | 1mo ago | |
| ScanQA (test) | NaviLLM | BLEU-413.9 | 20 | 3mo ago | |
| NuscenesQA v1.0 (test) | MSMDFusion + MCAN | Existence Accuracy (All)85.4 | 19 | 3mo ago | |
| ScanQA (evaluation) | V-LynX-7B | CIDEr107.4 | 13 | 1d ago | |
| ScanQA v1.0 (val) | Efficient-VLN | BLEU-416.2 | 13 | 3mo ago | |
| SQA3D (val) | LEO-VL | EM60.8 | 12 | 23d ago | |
| OpenEQA | LLaVA-OV-7B | LLM-Match56.2 | 12 | 2mo ago | |
| 3D MM-VET 42 (test) | MPM | Accuracy57.6 | 8 | 13d ago | |
| ObjaXL-LVIS 1K (test) | GPT4Point (FLANT5XL) | Accuracy27.6 | 8 | 3mo ago | |
| SQA3D v1.0 (test) | PAVE-7B (w/ 3D info) | EM@159 | 8 | 3mo ago | |
| Beacon3D ScanNet (test) | Loc3R-VLM | Class Accuracy44.8 | 7 | 2mo ago | |
| MMScan QA | LLaVA-3D | Overall Score55.4 | 7 | 3mo ago | |
| Real-3DQA | GPT4Scene | EM33.1 | 5 | 2mo ago | |
| City-3DQA (City-wise) | 3DCity-LLM | Accuracy (Single-hop)79.1 | 5 | 2mo ago | |
| City-3DQA Sentence-wise | 3DCity-LLM | Accuracy (Single-hop)82.41 | 5 | 2mo ago |
