Share your thoughts, 1 month free Claude Pro on usSee more

Crack Segmentation on Concrete3k Facade390 Road420 (Zero-shot)

75.47Zero-shot F1 (Concrete)

LoRA

Updated 1mo ago

Evaluation Results

Method
LoRA 2026.06	75.47	52.39	39.53	55.79	60.6	35.49	24.63	40.24
FisherAdapTune 2026.06	74.19	61.04	58.26	64.49	58.97	43.93	41.11	48
Full FT 2026.06	74.03	64.25	70.39	69.56	58.77	47.33	54.31	53.47
Random 2026.06	73.9	70.35	71.79	72.01	58.6	54.26	55.99	56.29
Full FT 2026.06	73.71	57.14	54	61.61	58.37	40	36.98	45.11
Full FT 2026.06	73.34	70.39	64.32	69.35	57.91	54.31	47.4	53.21
Full FT 2026.06	73.2	61.31	56.42	63.64	57.72	44.2	39.3	47.07
BitFit 2026.06	73.05	70.13	71.55	71.58	57.54	54	55.7	55.75
FisherAdapTune 2026.06	72.81	75.3	70.29	72.8	57.24	60.38	54.19	57.27
FisherAdapTune 2026.06	72.43	69.1	64.42	68.65	56.77	52.79	47.52	52.36
Random 2026.06	72.16	58.56	42.96	57.89	56.45	41.4	27.36	41.74
LoRA 2026.06	71.85	55.38	44.31	57.18	56.06	38.29	28.46	40.94
Decoder-only 2026.06	71.26	68.61	61.71	67.19	55.35	52.22	44.62	50.73
FisherAdapTune 2026.06	70.97	58.77	53.63	61.12	55.01	41.62	36.64	44.42
BitFit 2026.06	70.84	69.17	67.33	69.11	54.85	52.87	50.74	52.82
Random 2026.06	69.41	70.83	63.15	67.8	53.15	54.83	46.14	51.38
Decoder-only 2026.06	69.26	69.36	64.35	67.66	52.98	53.09	47.44	51.17
LoRA 2026.06	69.07	67.51	58.76	65.11	52.75	50.96	41.6	48.44
BitFit 2026.06	68.79	52.04	53.53	58.12	52.42	35.17	36.55	41.38
LayerNorm 2026.06	67.07	44.07	42.41	51.18	50.46	28.26	26.91	35.21
Random 2026.06	66.41	69.44	61.88	65.91	49.71	53.19	44.8	49.24
Decoder-only 2026.06	66.28	56.71	58.72	60.57	49.57	39.57	41.57	43.57
LayerNorm 2026.06	64.15	65.38	61.16	63.56	47.23	48.56	44.05	46.61
Random 2026.06	63.81	51.33	52.45	55.87	46.85	34.53	35.55	38.98
Decoder-only 2026.06	63.47	54.91	52.58	56.98	46.48	37.85	35.66	40
LayerNorm 2026.06	63.24	50.01	48.79	54.01	46.24	33.34	32.27	37.28
BitFit 2026.06	61.86	45.95	43.23	50.34	44.79	29.83	27.57	34.06
LoRA 2026.06	59.72	62.82	51.81	58.11	42.57	45.79	34.96	41.11
Random 2026.06	56	65.36	58.93	60.09	38.88	48.54	41.77	43.07
LayerNorm 2026.06	50.29	62.75	61.99	58.34	33.59	45.72	44.92	41.41
Freeze 2026.06	8.21	4.13	4.47	5.6	4.28	2.11	2.28	2.89
Freeze 2026.06	6.29	2.41	3.93	4.21	3.25	1.22	2	2.16