MMEdit
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Editing | MMEdit E-VQA | Reliability100 | 61 | |
| Knowledge Editing | MMEdit E-IC 1.0 (test) | Reliability100 | 24 | |
| Knowledge Editing | MMEdit E-IC | Reliability99.7 | 16 | |
| Multimodal Knowledge Editing | MMEdit 10-step sequential editing on VQA | Reliability91.5 | 12 | |
| Knowledge Editing | MMEdit One-Step Editing | Reliability98.6 | 7 | |
| Image Caption Editing | MMEdit 10-step sequential editing | Relevance91.8 | 6 | |
| Sequential Knowledge Editing | MMEdit VQA | Rel.88.9 | 6 | |
| Image Captioning Editing | MMEdit | Relevance Score88.4 | 6 | |
| Knowledge Editing | MMEdit Sequential Editing | Reliability90.2 | 6 | |
| Cross-task Knowledge Editing | MMEdit cross-task | Rel. Score90.7 | 6 |
Showing 10 of 10 rows