Video Question Answering on iVQA (test)

60.9Accuracy

MoReVQA

Updated 2d ago

Evaluation Results

Method
MoReVQA 2024.04	60.9	-	-
JCEF 2024.04	56.9	-	-
InstructBLIP 2024.04	53.8	-	-
InstructBLIP 2024.04	51.1	-	-
ProViQ 2023.12	50.7	-	-
BLIP-2 2024.04	45.8	-	-
Supervised SOTA 2023.12	40.9	-	-
Flamingo-80B 2023.06	40.7	-	-
Text Tokens + Text Transformer 2022.06	40.2	-	-
Text+Text 2024.04	40.2	-	-
FrozenBiLM 2022.06	39.7	-	-
FrozenBiLM 2024.04	39.7	-	-
FrozenBiLM 2022.06	39.6	-	-
VideoCoCa 2024.04	39	-	-
Text Tokens + Text Transformer 2022.06	36.9	-	-
Text Tokens + Text Transformer 2022.06	36.8	-	-
Continuous Features + Multimodal Transformer 2022.06	36	-	-
Continuous Features + Multimodal Transformer 2022.06	35.4	-	-
VQA-T 2022.06	35.2	-	-
Flamingo-9B 2023.06	35.2	-	-
Flamingo-3B 2023.06	32.7	-	-
Text Tokens + Text Transformer 2022.06	31.6	-	-
R2A 2023.06	29.3	-	-
FrozenBiLM 2024.04	27.3	-	-
FrozenBiLM 2023.12	26.8	-	-
FrozenBiLM 2023.06	26.2	-	-
Just Ask 2023.06	13.3	-	-
Just Ask 2023.12	13.3	-	-
CLIP VIT-L/14 2023.06	9.2	-	-
CLIP-VIT-L/14 2023.12	9.2	-	-
Random 2023.12	0.1	-	-
Random 2020.12	-	0.09	0.9
QA-T 2020.12	-	4.4	23.2
VQA-T 2020.12	-	1.9	11.9
VQA-T 2020.12	-	12.2	43.3