Visual Machine Reading Comprehension on VisualMRC v1.0 (test)
57.2BLEU-1
LayoutT5
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2021.01 | 57.2 | 52.1 | 48.1 | 44.9 | 37.3 | 57.1 | 364.2 | 91.3 | |
2021.01 | 57.2 | 51.2 | 46.7 | 43 | 36.1 | 57 | 346 | 91.5 | |
2021.01 | 56 | 50.8 | 46.7 | 43.4 | 34.6 | 54.6 | 335.9 | 90.8 | |
2021.01 | 55.8 | 50.7 | 46.6 | 43.3 | 34.9 | 54.4 | 335.1 | 90.7 | |
2021.01 | 53 | 48.2 | 44.5 | 41.5 | 31.7 | 53 | 318.6 | 90.5 | |
2021.01 | 53 | 46.8 | 42.3 | 38.7 | 31.9 | 52.8 | 309.9 | 90.7 | |
2021.01 | 52 | 45.8 | 41.3 | 37.7 | 31.3 | 52.8 | 302.8 | 90.6 | |
2021.01 | 50.6 | 44.4 | 39.9 | 36.4 | 28.8 | 48.7 | 278.3 | 90.1 | |
2021.01 | 31.8 | 25.7 | 21.9 | 19 | 15 | 27.7 | 140.5 | 87.3 | |
2021.01 | 31.2 | 25.9 | 22.6 | 20 | 18.5 | 29.6 | 155 | 87.5 | |
2021.01 | 29.2 | 20.1 | 14.4 | 10.3 | 12.8 | 28.1 | 98.6 | 86.1 | |
2021.01 | 26.7 | 17.4 | 11.8 | 8.8 | 11.6 | 26.9 | 88.3 | 85.9 | |
2021.01 | 20.7 | 13.3 | 9.2 | 6.3 | 10.1 | 21.8 | 61 | 85.3 | |
2021.01 | 20.2 | 13 | 8.9 | 6.1 | 9.8 | 20.9 | 58.3 | 85.1 |