Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

VECtor

Benchmarks

Task NameDataset NameSOTA ResultTrend
Event SequencingVECTOR L2 (Ne=8) 1.0 (test)
EM (Exact Match)8,500
26
Event SequencingVECTOR L1 (Ne=4) 1.0 (test)
EM Score90
26
Event Sequencing (Full-sequence ordering)VECTOR L2
Exact Match (EM)80
13
Event Sequencing (Full-sequence ordering)VECTOR L1
Exact Match (EM)8,500
13
2D-3D registrationVECtor E2P (test)
Rotation Error (deg)8.672
12
Event Position Identification (Single event detection)VECTOR L2
Exact Match (EM)71.33
6
TrackingVector 15
Average Tracking Score38.45
6
3D ReconstructionVECtor sofa-normal
Accuracy352.17
4
3D ReconstructionVECtor desk-normal
Accuracy182.56
4
3D ReconstructionVECtor sofa-fast
Accuracy361.92
4
3D ReconstructionVECtor desk-fast
Accuracy189.96
4
3D ReconstructionVECtor 65 (average)
Accuracy271.65
4
RegistrationVECtor (sofa-normal)
R Error (deg)6.6
4
RegistrationVECtor desk-normal
Rotation Error6.42
4
RegistrationVECtor (sofa-fast)
Rotational Error (deg)9.8
4
RegistrationVECtor desk-fast
Rotation Error (°)8.43
4
RegistrationVECtor (avg)
Rotational Error8.86
4
Relative Event Sequencing (Sub-sequence ordering)VECTOR L2
Exact Match (EM)53.67
4
Relative Event Sequencing (Sub-sequence ordering)VECTOR L1
Exact Match (EM)83.33
4
Linear velocity estimationVECtor sofa
Median Error (degree)18.9
4
Linear velocity estimationVECtor (mountain)
Median Velocity Error16.4
4
Linear velocity estimationVECtor desk
Median Linear Velocity Error21.8
4
Discordant Event Position Identification (Pattern s1s2s3)VECTOR L2
EM19
3
Discordant Event Position Identification (Pattern s1s2s3)VECTOR L1
Exact Match (EM)21.67
3
Discordant Event Position Identification (Pattern s1s2)VECTOR L2
Exact Match (EM)21.67
3
Showing 25 of 37 rows