Our new X account is live! Follow @wizwand_team for updates

Long-form Video Understanding on LVU

76.47Relation Attribute Accuracy

SVT SCALE

Updated 4d ago

Evaluation Results

Method
SVT SCALE 2023.04	76.47	42.27	74.02	49.09	58.97	62.76	39.23	-	-	-
Movies2Scenes 2023.04	71.2	42.2	68.2	70.9	55.9	53.7	57.8	-	-	-
Movies2Scene 2025.03	71.2	42.2	68.2	-	-	-	-	-	-	60.5
HierarQ 2025.03	69.4	49.3	85.1	-	-	-	-	-	-	67.9
HierarQ 2025.03	67.9	48.7	83.8	-	-	-	-	-	-	66.8
S5 2024.04	67.1	42.1	73.5	67.3	65.4	51.3	48	-	-	59.2
S5 2024.11	67.1	42.1	73.5	67.3	65.4	51.3	48	-	-	59.2
S5 2025.03	67.1	42.1	73.5	-	-	-	-	-	-	60.9
AdaCM² 2024.11	63.1	40.2	86.2	75.4	68	77	62.5	-	-	67.5
VideoMamba 2024.03	62.5	40.43	70.37	67.29	65.24	52.98	48.23	26	2.9	-
VideoMamba 2025.03	62.5	40.4	70.4	-	-	-	-	-	-	57.8
LF-VILA 2025.03	61.5	41.3	68	-	-	-	-	-	-	56.9
LSSD (B.3) 2023.04	60.98	46.03	63.41	69.16	60.88	48.81	52.48	-	-	-
LSSD (B.4) 2023.04	60.98	47.62	65.85	67.29	61.73	41.67	55.32	-	-	-
TranS4mer 2025.03	59.5	39.2	70.9	-	-	-	-	-	-	56.5
STCA 2023.04	59.25	41.62	69.15	66.7	56.62	52.93	53.3	-	-	-
LSSD (B.5) 2023.04	58.54	46.03	64.63	69.16	64.29	41.07	52.48	-	-	-
MA-LMM 2024.04	58.2	44.8	80.3	74.6	61	70.4	51.9	-	-	63
MA-LMM 2024.11	58.2	44.8	80.3	74.6	61	70.4	51.9	-	-	63
MA-LMM 2025.03	58.2	44.8	80.3	-	-	-	-	-	-	61.1
ViS4mer 2024.03	57.14	40.79	67.44	62.61	54.71	48.8	44.75	26	3.63	-
ViS4mer 2023.04	57.14	40.79	67.44	62.61	54.71	48.8	44.75	-	-	-
VIS4mer 2024.04	57.1	40.8	67.4	62.6	54.7	48.8	44.8	-	-	53.7
VIS4mer 2024.11	57.1	40.8	67.4	62.6	54.7	48.8	44.8	-	-	53.7
VIS4mer 2025.03	57.1	40.8	67.4	-	-	-	-	-	-	55.1
Obj_T4mer 2024.04	54.8	33.2	52.9	47.7	52.7	36.3	37.8	-	-	45
Obj-T4mer 2024.11	54.8	33.2	52.9	47.7	52.7	36.3	37.8	-	-	45.1
Obj_T4mer 2025.03	54.8	33.2	52.9	-	-	-	-	-	-	47
Object Transformer 2023.04	54.7	40.3	60	58.9	56.1	35.1	40.6	-	-	-
Object Trans. 2024.03	53.1	39.4	56.9	51.2	54.6	34.5	39.1	23	3.55	-
VideoBERT 2024.03	52.8	37.9	54.9	47.3	51.9	38.5	36.1	32	4.46	-
VideoBERT 2024.04	52.8	37.9	54.9	47.3	51.9	38.5	36.1	-	-	45.6
VideoBERT 2024.11	52.8	37.9	54.9	47.3	51.9	38.5	36.1	-	-	45.6
VideoBERT 2025.03	52.8	37.9	54.9	-	-	-	-	-	-	48.5
LST 2024.04	52.5	37.3	62.8	56.1	52.7	42.3	39.2	-	-	49
LST 2024.11	52.5	37.3	62.8	56.1	52.7	42.3	39.2	-	-	49
LST 2024.03	52.38	37.31	62.79	56.07	52.7	42.26	39.16	31	3.83	-
Performer 2024.03	50	38.8	60.46	58.87	49.45	48.21	41.25	31	3.93	-
Orthoformer 2024.03	50	39.3	66.27	55.14	55.79	47.02	43.35	29	3.86	-
Performer 2024.04	50	38.8	60.5	58.9	49.5	48.2	41.3	-	-	49.6
Orthoformer 2024.04	50	38.3	66.3	55.1	55.8	47	43.4	-	-	50.8
Performer 2024.11	50	38.8	60.5	58.9	49.5	48.2	41.3	-	-	49.6
Orthoformer 2024.11	50	38.3	66.3	55.1	55.8	47	43.4	-	-	50.8
Orthoformer 2025.03	50	38.3	66.3	-	-	-	-	-	-	51.5