Share your thoughts, 1 month free Claude Pro on usSee more

Text-based Visual Question Answering on TextVQA (VQA^T)

78Accuracy

GPT-4V

Updated 25d ago

Evaluation Results

Method	Links
GPT-4V 2025.01		78
Cambrian-1-34B 2025.01		76.7
CogVLM-17B 2024.07		70.4
MGM-HD+CAL 2024.05		68.8
Leo 2025.01		68.8
VILA-1.5 2025.01		68.5
SPHINX-MoE 2024.08		68
Monkey 2025.01		67.6
MGM-HD 2024.05		67.2
MGM-HD+CAL 2024.05		67.1
LLaVA-NeXT+CAL 2024.05		67.1
LLaVA-NeXT 2024.05		67
VILA-13B 2024.07		66.6
Mini-Gemini-13B 2024.07		65.9
MGM-HD 2024.05		65.5
Mini-Gemini-7B 2024.07		65.2
CoS-7B 2024.07		65.1
LLaVA-NeXT+CAL 2024.05		65
VILA-7B 2024.07		64.4
VILA 2025.01		64.4
LLaVA-NeXT 2024.05		64.2
Qwen-VL 2024.07		63.8
Qwen-VL-7B 2024.08		63.8
MGM+CAL 2024.05		63.8
Qwen-VL 2025.12		63.8
Vanilla 2026.03		63.8
MGM+CAL 2024.05		63
MGM 2024.05		62.6
Qwen-VL-7B-Chat 2024.08		61.5
LLaVA-1.5-13B 2024.07		61.3
LLaVA-1.5 2024.08		61.3
MGM 2024.05		61.1
QMoP 2026.03		59.4
FasterVLM 2026.03		58.8
TokenPacker 2026.03		58.8
MoExtend 2024.08		58.7
HyperLLaVA 2024.08		58.5
LDP-v2 2026.03		58.4
LLaVA-1.5-7B 2024.07		58.2
mPLUG-Owl2 2024.07		58.2
LLaVA-1.5 2024.08		58.2
LLaVA-1.5 2025.12		58.2
LLaVA.1.5 2025.01		58.2
Vanilla 2026.03		58.2
MoELoRA 2024.08		57.1
TeamLoRA 2024.08		57.1
FasterVLM 2026.03		57.1
QMoP 2026.03		57.1
MoE-LLaVA-2.7Bx4 2024.08		57
LLaVA-13b 2024.06		57
InternVL 2025.01		57
TokenPacker 2026.03		57
Pixel-Shuffle 2026.03		57
LoRA 2024.08		56.9
LLaVolta 2024.06		56.7
LDP-v2 2026.03		56.4
FasterVLM 2026.03		56
QMoP 2026.03		56
TokenPacker 2026.03		55.6
LDP-v2 2026.03		55.1
Pixel-Shuffle 2026.03		54.2
C-Abstractor 2026.03		54.1
C-Abstractor 2026.03		53.9
MQT-LLaVA 2026.03		52.6
Pixel-Shuffle 2026.03		52.2
MGM+CAL 2024.05		51.8
MQT-LLaVA 2026.03		51.6
MoE-LLaVA-2.7Bx4 2024.08		51.4
C-Abstractor 2026.03		51.3
InstructBLIP-13B 2024.07		50.7
InstructBLIP-13B 2024.08		50.7
InstructBLIP 2025.12		50.7
InstructBLIP-7B 2024.07		50.1
InstructBLIP-7B 2024.08		50.1
InstructBLIP 2025.12		50.1
Instruct-BLIP 2025.01		50.1
LLaVA-1.5+CAL 2024.05		49.6
LLaVA-1.5 2024.05		49
MobileVLM 3B 2025.12		48.58
MGM 2024.05		48.1
LLaVA-1.5 2024.05		47.6
LLaVA-1.5+CAL 2024.05		47.5
HyDRA(Coarse-grained) 2025.12		47.14
HyDRA(Fine-grained) 2025.12		46.91
MobileVLM 3B 2025.12		46.58
BLIP-2 2024.08		42.5
BLIP-2 2025.12		42.5
HyDRA(Coarse-grained) 2025.12		40.98
HyDRA(Fine-grained) 2025.12		40.75
MobileVLM 1.7B 2025.12		40.36
MobileVLM 1.7B 2025.12		40.28
IDEFICS-80B 2024.08		30.9
IDEFICS-80B 2025.12		30.9
IDEFICS-9B 2024.07		25.9
IDEFICS-9B 2024.08		25.9
IDEFICS-9B 2025.12		25.9