Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SQA3D

Benchmarks

Task NameDataset NameSOTA ResultTrend
3D Question AnsweringSQA3D (test)
EM@163
55
3D Situated Question AnsweringSQA3D (test)
Average Accuracy54.57
40
Situated 3D Question AnsweringSQA3D (test)
EM@163
12
3D Question AnsweringSQA3D
EM58.6
11
Multimodal Compositional QASQA3D (test)
Accuracy41
9
3D Situated Question AnsweringSQA3D
What Accuracy47.7
9
3D Question AnsweringSQA3D v1.0 (test)
EM@159
8
Situated Question AnsweringSQA3D (test)
EM54.6
7
Situated 3D Question AnsweringSQA3D
EM62.3
5
OrientationSQA3D 1.0 (test)
Acc @ 15°28.7
5
LocalizationSQA3D 1.0 (test)
Accuracy @ 0.5m0.274
5
3D Visual Question AnsweringSQA3D
EM@148.09
3
Showing 12 of 12 rows