Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Visual Question Answering on TallyQA (test)
Loading...
86.2
Simple Accuracy
PaLI-X-VPD
80.168
81.734
83.3
84.866
Dec 1, 2023
Dec 2, 2023
Dec 3, 2023
Dec 4, 2023
Dec 5, 2023
Simple Accuracy
Complex Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Simple Accuracy
Complex Accuracy
PaLI-X-VPD
Scale=55B, Type=genera...
2023.12
86.2
76.6
PaLI-X-VPD
Scale=55B, Type=specia...
2023.12
86.2
76.4
PaLI-X
Category=Specialist
2023.12
86
75.6
PaLI-X
Scale=55B
2023.12
86
75.6
PaLI-XFT
Category=Generalist, F...
2023.12
83.8
71.8
SMOLA-PALI-XFT
Category=Generalist, F...
2023.12
83.3
70.7
PaLI-3
Scale=5B
2023.12
83.3
70.5
PaLI-3-VPD
Scale=5B, Type=specialist
2023.12
83.3
70.8
PaLI-3-VPD
Scale=5B, Type=generalist
2023.12
83.1
70.9
SMOLA48-PaLI-3FT
Category=Generalist, F...
2023.12
81.8
65.1
PaLI
Scale=17B
2023.12
81.7
70.9
PaLI-3FT
Category=Generalist, F...
2023.12
80.4
65.4
Feedback
Search any
task
Search any
task