Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

RAMIE

Benchmarks

Task NameDataset NameSOTA ResultTrend
Structure IdentificationRAMIE
BLEU-475.57
8
Tool IdentificationRAMIE
BLEU-491.34
4
GroundingRAMIE
mIoU64.78
4
Yes&No Question AnsweringRAMIE
Accuracy89.16
4
CountingRAMIE
Accuracy83.33
4
SegmentationRAMIE
Dice Score61
4
Showing 6 of 6 rows