Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Embodied Question Answering on OpenEQA EM-EQA
Loading...
86.8
Accuracy
Human
25.96
41.755
57.55
73.345
Aug 1, 2024
Aug 10, 2024
Aug 19, 2024
Aug 29, 2024
Sep 7, 2024
Sep 16, 2024
Sep 26, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Human
Frame=Full
2024.08
86.8
Human
Frame=Full
2024.09
86.8
GPT-4o + Coarse Correspondences
Frame=4
2024.08
59.1
GPT-4V + Coarse Correspondences
Frame=8
2024.08
58.5
GPT-4V
Frame=50
2024.08
55.3
GPT-4V
Frame=50
2024.09
55.3
GPT-4V
Frame=15
2024.08
54.6
GPT-4V
Frame=15
2024.09
54.6
LLaVA-3D
Frame=32
2024.09
53.2
GPT-4o
Frame=4
2024.08
49.4
Gemini-Pro
Frame=15
2024.08
44.9
Gemini-Pro
Frame=15
2024.09
44.9
GPT-4V
Frame=8
2024.08
44.8
Claude3
Frame=20
2024.08
36.3
Claude3
Frame=20
2024.09
36.3
GPT-4
Frame=0
2024.08
33.5
GPT-4
Frame=0
2024.09
33.5
LLaMA2
Frame=0
2024.08
28.3
LLaMA2
Frame=0
2024.09
28.3
Feedback
Search any
task
Search any
task