Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PathVQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Medical Visual Question AnsweringPathVQA
Overall Accuracy72.61
86
Medical Visual Question AnsweringPathVQA (test)
Accuracy78.2
55
Medical Visual Question AnsweringPathVQA
Accuracy76.8
50
Medical Visual Question AnsweringPathVQA closed-end
Accuracy93.63
35
Vision-Language Medical ReasoningPathVQA
Token Cost (tokens/question)0.7
29
Medical Visual Question AnsweringPathVQA Open
Accuracy38.65
22
Hallucination detectionPathVQA
AUC82
20
Visual Question AnsweringPathVQA
Accuracy (Closed)92.9
19
Visual Question AnsweringPathVQA (test)
Overall Accuracy92.7
19
Medical Visual Question Answering (Free-text)PathVQA OOD
Accuracy62.3
12
Multi-modal Question AnsweringPathVQA
Accuracy65.9
12
Visual Question AnsweringPathVQA
Accuracy74.4
6
Medical Visual Question AnsweringPathVQA (held-out)
Accuracy59.9
6
Visual Question AnsweringPathVQA
BLEU-163.93
5
Out-of-distribution DetectionPathVQA (PVQA) (test)
FPR6.24
5
Showing 15 of 15 rows