Share your thoughts, 1 month free Claude Pro on usSee more

Online Multimodal Model Editing on E-IC

100T-Gen (Text Generation Fidelity)

FT-M

Updated 22d ago

Evaluation Results

Method
FT-M 2026.05	100	100	76.92	100	24.79	80.34	-
MEND 2026.05	100	100	100	84.21	100	96.84	-
IKE 2026.05	100	100	100	63.16	10	74.63	-
M-ORE 2026.05	100	100	93.75	100	100	98.75	-
FT-L 2026.05	100	100	89.8	91.67	28.01	81.89	-
FT-M 2026.05	100	100	76.47	100	26.11	80.52	-
M-ORE 2026.05	100	100	94.12	100	100	98.82	-
FT-M 2026.07	100	-	76.92	100	24.79	80.34	100
MEND 2026.07	100	-	100	84.21	100	96.84	100
M-ORE 2026.07	100	-	84.62	100	100	97.44	100
IKE 2026.07	100	-	100	63.16	10	74.63	100
ScopeEdit 2026.07	100	-	92.31	100	100	98.72	100
FT-L 2026.07	100	-	89.8	91.67	28.01	81.89	100
FT-M 2026.07	100	-	76.47	100	26.11	80.52	100
M-ORE 2026.07	100	-	88.24	100	100	98.04	100
ScopeEdit 2026.07	100	-	94.12	100	100	99.02	100
M-ORE 2026.07	100	100	90.82	100	100	-	-
ScopeEdit 2026.07	100	100	100	100	100	-	-
M-ORE 2026.07	100	100	92.31	100	100	-	-
ScopeEdit 2026.07	100	100	92.31	100	100	-	-
MEND 2026.05	97.65	96.81	96.44	94.74	100	97.13	-
MEND 2026.07	97.65	-	96.44	94.74	100	97.13	96.81
SERAC 2026.05	95.52	97.38	86.11	100	63.82	88.57	-
SERAC 2026.07	95.52	-	86.11	100	63.82	88.57	97.38
M-ORE 2026.07	95.18	96.01	85.85	97.52	95	-	-
FT-L 2026.05	95.02	96.77	90.72	90.05	68.27	88.16	-
FT-L 2026.07	95.02	-	90.72	90.05	68.27	88.16	96.77
ScopeEdit 2026.07	94.66	-	86.35	98.42	92.26	93.42	95.42
IKE 2026.05	94.12	94.12	94.12	62.5	12.5	71.47	-
IKE 2026.07	94.12	-	94.12	62.5	12.5	71.47	94.12
M-ORE 2026.07	93.47	-	78.29	97.48	89.21	90.61	94.58
M-ORE 2026.07	93.43	94.2	82.57	91.28	95	-	-
M-ORE 2026.05	93.27	94.64	78.66	97.39	89.71	90.73	-
ScopeEdit 2026.07	92.5	95.1	90.75	97.83	96.67	-	-
M-ORE 2026.07	91.8	93.89	65.38	89.7	87.78	-	-
ScopeEdit 2026.07	91.75	-	85.48	97.63	97.17	93.01	93.01
ScopeEdit 2026.07	91.68	94.97	84.8	94.97	100	-	-
ScopeEdit 2026.07	91.4	92.11	77.96	89.37	86.11	-	-
M-ORE 2026.07	91.01	91.73	72.98	87.42	88.92	-	-
SERAC 2026.05	90.17	88.61	81.45	98.24	50.83	81.86	-
SERAC 2026.07	90.17	-	81.45	98.24	50.83	81.86	88.61
M-ORE 2026.07	87.75	-	66.31	97.21	94.97	87.28	90.14
ScopeEdit 2026.07	86.98	91.16	73.75	91.64	89.3	-	-
LiveEdit 2026.05	82.33	82.33	80.67	100	100	89.07	-
LiveEdit 2026.07	82.33	-	80.67	100	100	89.07	82.33
FT-L 2026.05	82.11	86	78.15	77.13	11.33	66.94	-
FT-L 2026.07	82.11	-	78.15	77.13	11.33	66.94	86
LiveEdit 2026.05	80.67	80.67	77.79	100	98.09	87.44	-
LiveEdit 2026.07	80.67	-	77.79	100	98.09	87.44	80.67
FT-M 2026.05	80.05	84.57	62.88	100	8.32	67.16	-
FT-M 2026.07	80.05	-	62.88	100	8.32	67.16	84.57
LiveEdit 2026.05	78.77	78.49	65.5	98.77	96.76	83.66	-
LiveEdit 2026.07	78.77	-	65.5	98.77	96.76	83.66	78.49
M-ORE 2026.05	78.17	83.14	60.08	95.51	95.58	82.49	-
IKE 2026.05	77.37	78.78	78.07	53.86	12.88	60.19	-
IKE 2026.07	77.37	-	78.07	53.86	12.88	60.19	78.78
LiveEdit 2026.05	74.33	74.63	61.95	96.77	95.34	80.6	-
LiveEdit 2026.07	74.33	-	61.95	96.77	95.34	80.6	74.63
FT-L 2026.05	71.69	79.45	57.82	92.23	55.18	71.27	-
FT-L 2026.07	71.69	-	57.82	92.23	55.18	71.27	79.45
IKE 2026.05	71.13	81.18	84.3	79.9	11.93	65.69	-
IKE 2026.07	71.13	-	84.3	79.9	11.93	65.69	81.18
SERAC 2026.05	71	73.38	59.72	72.88	25.85	60.57	-
SERAC 2026.07	71	-	59.72	72.88	25.85	60.57	73.38
SERAC 2026.05	63.79	74.02	56.93	77.52	42.94	63.04	-
SERAC 2026.07	63.79	-	56.93	77.52	42.94	63.04	74.02
FT-M 2026.05	62.17	67.18	51.63	100	9.81	58.16	-
FT-M 2026.07	62.17	-	51.63	100	9.81	58.16	67.18
AlphaEdit 2026.05	48.21	51.98	47.23	92.59	56.9	59.38	-
AlphaEdit 2026.07	48.21	-	47.23	92.59	56.9	59.38	51.98
AlphaEdit 2026.05	47.06	47.06	52.94	100	100	69.41	-
AlphaEdit 2026.07	47.06	-	52.94	100	100	69.41	47.06
AlphaEdit 2026.05	30.77	30.77	30.77	89.47	100	56.35	-
AlphaEdit 2026.07	30.77	-	30.77	89.47	100	56.35	30.77
AlphaEdit 2026.05	28.57	27.94	26.69	90.52	78.83	50.51	-
AlphaEdit 2026.07	28.57	-	26.69	90.52	78.83	50.51	27.94
MEND 2026.05	0.08	0.11	0.04	25.52	31.33	11.42	-
MEND 2026.07	0.08	-	0.04	25.52	31.33	11.42	0.11
MEND 2026.05	0	0	0	46.96	54.05	20.2	-
MEND 2026.07	0	-	0	46.96	54.05	20.2	0