Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Matterport3D

Benchmarks

Task NameDataset NameSOTA ResultTrend
Monocular Depth EstimationMatterport3D (test)
Delta Acc (< 1.25)98.09
48
Depth EstimationMatterport3D
delta196.08
35
Monocular 360 Depth EstimationMatterport3D official (test)
Delta Acc (1.25x)94.8
20
Depth CompletionMatterport3D (test)
RMSE0.5223
16
3D Semantic SegmentationMatterport3D (val)
mAcc67.2
15
Multi-robot Exploration and CoverageMatterPort3D Medium Scene
Exploration (%)99.66
12
Multi-robot Exploration and CoverageMatterPort3D Small Scene
Exploration Rate99.17
12
Multi-robot Exploration and CoverageMatterPort3D Large Scene
Exploration Percentage98.95
12
Multi-object NavigationMatterport3D (test)
SPL57.9
12
3D Semantic SegmentationMatterport3D (test)
Wall Accuracy90.8
12
Semantic SegmentationMatterport3D (val)
mIoU55.9
11
Room Layout EstimationMatterport3D official (test)
Overall 2D IoU0.8391
11
Semantic SegmentationMatterport3D 4
mIoU48.43
10
360-degree Depth EstimationMatterport3D
Delta 1 Acc91.7
9
3D Semantic SegmentationMatterport3D 4 (test)
mIoU67.2
9
Room Impulse Response (RIR) PredictionMatterport3D (Unseen environments)
STFT1.22
9
Room Impulse Response (RIR) PredictionMatterport3D (Seen environments)
STFT1.1
9
Monocular Depth EstimationMatterport3D 2K resolution (2048x1024) (test)
AbsRel0.2
9
Panoramic Metric Depth EstimationMatterport3D Indoor (test)
AbsRel0.0667
8
3D Semantic SegmentationMatterport3D 160 classes (test)
f-mIoU18.7
8
Episodic Memory Question Answering (Egocentric pixel)Matterport3D
IoU29.78
8
Episodic Memory Question Answering (Top-down map)Matterport3D
IoU29.11
8
360 Layout EstimationMatterport3D
2D IoU83.91
8
Semantic SegmentationMatterport3D 160
mIoU23.6
7
Audio-visual NavigationMatterport3D Unheard sound
SPL27.7
7
Showing 25 of 64 rows