ScanRefer
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| 3D Visual Grounding | ScanRefer (val) | Overall Accuracy @ IoU 0.5066.83 | 262 | |
| 3D Visual Grounding | ScanRefer | Acc@0.2566 | 172 | |
| 3D visual grounding | ScanRefer v1 (test) | Acc@0.25IoU58.89 | 96 | |
| 3D Dense Captioning | ScanRefer (val) | CIDEr106.11 | 91 | |
| 3D Visual Grounding | ScanRefer Overall | Acc @ 0.561.6 | 55 | |
| Referring 3D Instance Segmentation | ScanRefer (val) | mIoU74.6 | 43 | |
| 3D Visual Grounding | ScanRefer Unique | Acc@0.25 (IoU=0.25)90.3 | 41 | |
| 3D Dense Captioning | ScanRefer | CIDEr (IoU=0.50)89.57 | 36 | |
| Visual Grounding | ScanRefer v1 (val) | Acc@0.5 (Unique)84 | 35 | |
| 3D Dense Captioning | ScanRefer (test) | CIDEr86.28 | 30 | |
| 3D Visual Grounding | ScanRefer Multiple | Accuracy @ IoU=0.5052.5 | 29 | |
| 3D Visual Grounding | ScanRefer (test) | Accuracy@0.2559.98 | 29 | |
| 3D Referring Expression Segmentation | ScanRefer | Accuracy @ 0.2562 | 25 | |
| 3D Referring Expression Comprehension | ScanRefer | Overall@0.25 Accuracy58.47 | 21 | |
| 3D Dense Captioning | ScanRefer | CIDEr@0.5IoU78.8 | 21 | |
| 3D Visual Grounding | ScanRefer 10 (val) | Accuracy @ IoU=0.25 (Overall)62.9 | 16 | |
| 3D Visual Grounding | ScanRefer Multiple (val) | Accuracy @ IoU 0.2552 | 15 | |
| Dense Captioning | ScanRefer | Caption Score (0.5 IoU)84.1 | 13 | |
| Visual Grounding | ScanRefer Overall category (test) | Accuracy61.1 | 13 | |
| 3D box localization | ScanRefer | Accuracy @ 0.25 IoU62.6 | 11 | |
| 3D Object Grounding | ScanRefer detected proposals v1 (val) | Unique Acc@0.2588.63 | 10 | |
| 3D Object Detection | ScanRefer (test) | mAP@0.553.95 | 10 | |
| 3D Visual Grounding | ScanRefer 2020 (test) | Unique Metric Score88.7 | 9 | |
| 3D Referring Expression Segmentation | ScanRefer Overall 1 (val) | Acc@0.2557.9 | 9 | |
| Referring Expression Segmentation | ScanRefer | mIoU44.8 | 9 |
Showing 25 of 41 rows