3D Question Answering on VSI-Bench
67.1Room Size Accuracy
VLM-3R
Updated 22d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2026.03 | 67.1 | 60.9 | 70.2 | 49.4 | 69.2 | 65.4 | 80.5 | 45.4 | 40.1 | |
2026.05 | 67.1 | 60.9 | 70.2 | 49.4 | 69.2 | 65.4 | 80.5 | 45.4 | 40.1 | |
2026.05 | 65.7 | 64.7 | 69.1 | 61.9 | 70 | 65.4 | 88.9 | 44.3 | 52.3 | |
2026.03 | 62 | 50.7 | 67.9 | 37.7 | 58.6 | 46.6 | 40.7 | 32.4 | 59.2 | |
2026.03 | 61.2 | 63.2 | 68.9 | 47.3 | 64.9 | 62.1 | 82.4 | 44.9 | 73.8 | |
2026.05 | 57 | 62.1 | 69.8 | 52 | 76.4 | 61.4 | 52.7 | 39.2 | 72.2 | |
2026.04 | 54 | 49.3 | 67.5 | 39.3 | 63.5 | 50.3 | 55.8 | 36.6 | 27.2 | |
2026.04 | 53.8 | 48.7 | 67.4 | 39.6 | 64 | 48.9 | 44.9 | 38.7 | 32.4 | |
2026.04 | 53.5 | 50.7 | 67.1 | 38.3 | 65.8 | 51.7 | 57.3 | 41.2 | 29.8 | |
2026.04 | 53 | 50 | 68.3 | 38.8 | 64.8 | 52.8 | 47.3 | 37.1 | 37.7 | |
2026.05 | 52.7 | 50.8 | 36.6 | 34.6 | 58.8 | 47.3 | 62.4 | 46.9 | 59.7 | |
2026.03 | 50.14 | 59.72 | 46.7 | 41.43 | 72.49 | 63.69 | 58.62 | 55.5 | 72.61 | |
2026.05 | 49.4 | 48.8 | 49.6 | 28.8 | 58.6 | 46 | 48.1 | 42 | 68 | |
2026.05 | 47.7 | 52.2 | 46.4 | 27.8 | 60.1 | 51.3 | 71.7 | 43.8 | 53.7 | |
2026.03 | 47.3 | - | - | - | - | 41.1 | 37.1 | 36.1 | 40.4 | |
2026.03 | 47.01 | 38.06 | 17.89 | 26.2 | 53.15 | 41.55 | 36.78 | 35.05 | 44.01 | |
2026.04 | 46.4 | 46.4 | 63.8 | 28.9 | 57 | 48.9 | 48 | 35.1 | 43.4 | |
2026.05 | 46.3 | 48.1 | 53.7 | 30.5 | 60.5 | 49.9 | 42.9 | 33 | 59.1 | |
2026.03 | 45.62 | 60.15 | 47.55 | 38.82 | 73.9 | 63.85 | 61.7 | 58.01 | 72.97 | |
2026.03 | 45.55 | 58.88 | 44.55 | 42.12 | 72.2 | 65.35 | 57.83 | 55.62 | 73.73 | |
2026.05 | 45.2 | 45.7 | 50.8 | 33.6 | 56.5 | 48 | 39.8 | 32.7 | 59.2 | |
2026.03 | 45.1 | 48.4 | 65.3 | 34.8 | 63.1 | 41.3 | 46.2 | 33.5 | 46.3 | |
2026.03 | 44.48 | 38.34 | 35.09 | 24.47 | 48.22 | 43.1 | 30.79 | 35.05 | 49.5 | |
2026.05 | 44.2 | 47.9 | 65.3 | 34.6 | 63.8 | 40.7 | 44.3 | 34.5 | 45.5 | |
2026.03 | 44.15 | 59.52 | 45.19 | 40.72 | 73.36 | 65.82 | 60.4 | 53.59 | 73.64 | |
2026.04 | 43.9 | 42.8 | 61.8 | 30.2 | 49.8 | 49.3 | 47.8 | 33.6 | 26.1 | |
2026.03 | 43.6 | 45.4 | 56.2 | 30.9 | 64.1 | 51.3 | 46.3 | 36 | 34.6 | |
2026.03 | 43.23 | 37.49 | 34.27 | 23.5 | 48.52 | 38.73 | 32.75 | 27.84 | 49.23 | |
2026.03 | 42.99 | 52.61 | 33.77 | 32.57 | 67.09 | 62.54 | 50.52 | 51.03 | 70.71 | |
2026.03 | 42.95 | 39.79 | 36.02 | 29.84 | 52.38 | 40.14 | 33.78 | 31.44 | 47.41 | |
2026.03 | 42.6 | 41.9 | 46 | 34.7 | 56.4 | 35.1 | 44.9 | 33.5 | - | |
2026.05 | 42.2 | 37.6 | 42.9 | 16.6 | 52.7 | 35.5 | 39.6 | 31.4 | 36.7 | |
2026.03 | 41.56 | 41.42 | 33.27 | 31.51 | 58.67 | 39.44 | 35.33 | 28.87 | 51.29 | |
2026.03 | 41.49 | 36.28 | 33.36 | 20.53 | 49.31 | 43.38 | 27.79 | 32.47 | 44.01 | |
2026.03 | 40.94 | 29.78 | 21.27 | 24.95 | 16.31 | 39.44 | 33.16 | 28.87 | 43.53 | |
2026.03 | 40.76 | 53.65 | 30.35 | 34.54 | 64.05 | 61.78 | 58.09 | 61.34 | 71.96 | |
2026.03 | 40.14 | 39.14 | 29.45 | 30.44 | 54.26 | 41.41 | 32.02 | 32.47 | 46.6 | |
2026.03 | 39.8 | 34.6 | 23.1 | 28.7 | 48.2 | 36.7 | 30.7 | 29.9 | 39.6 | |
2026.05 | 39.8 | 35.2 | 23.1 | 28.7 | 48.2 | 36.7 | 30.7 | 29.9 | 39.6 | |
2026.03 | 39.06 | 36.85 | 27.43 | 23.14 | 50.14 | 41.41 | 32.54 | 27.84 | 46.76 | |
2026.03 | 38.99 | 39.38 | 22.05 | 28.03 | 59.98 | 40.85 | 37.4 | 31.96 | 42.56 | |
2026.03 | 38.68 | 38.01 | 23.27 | 31.39 | 54.49 | 42.96 | 34.71 | 29.9 | 36.73 | |
2026.03 | 38.2 | 34 | 46.2 | 5.3 | 43.8 | 37 | 41.3 | 31.5 | 28.5 | |
2026.05 | 38.2 | 34 | 46.2 | 5.3 | 43.8 | 37 | 41.3 | 31.5 | 28.5 | |
2026.03 | 37.26 | 35.47 | 21.58 | 15.67 | 52.65 | 39.44 | 36.05 | 34.54 | 42.39 | |
2026.04 | 36.7 | 36.6 | 41.5 | 21 | 50.5 | 38.6 | 41 | 29.4 | 34.5 | |
2026.05 | 35 | 27.5 | 21.8 | 24.9 | 22 | 33.8 | 44.2 | 30.5 | 7.1 | |
2026.05 | 34.2 | 41.4 | 38.8 | 27.8 | 27.8 | 49.3 | 80.4 | 36.6 | 17.6 | |
2026.05 | 31.8 | 45.4 | 52.4 | 30.6 | 66.7 | 56 | 46.3 | 24.5 | 55.1 | |
2026.03 | 30.9 | 45.4 | 63.5 | 34.4 | 60.6 | 48.9 | 45.2 | 30.4 | 49.2 | |
2026.05 | 30.4 | 43.1 | 39.9 | 27.3 | 36.9 | 41.1 | 72 | 40.2 | 40.6 | |
2026.04 | 26.2 | 27.9 | 25.2 | 17.4 | 16.5 | 37.2 | 45.4 | 28.4 | 27.3 | |
2026.05 | 22.6 | 30.5 | 24.3 | 24.7 | 31.7 | 38.3 | 41.6 | 26.3 | 21.2 | |
2026.05 | 21.9 | 45 | 44.5 | 25.8 | 51.3 | 46.9 | 66.5 | 36.1 | 39.3 | |
2026.05 | 12.3 | 35.1 | 47.7 | 14 | 47.4 | 43.5 | 42.4 | 29.4 | 24.4 | |
2026.03 | 10.7 | 33 | 40.9 | 14.8 | 43.4 | 38.6 | 38.5 | 33 | 29.8 | |
2026.03 | - | 41.1 | - | - | - | - | - | - | - |