Share your thoughts, 1 month free Claude Pro on usSee more

Faithfulness Measurement on Alpaca

0.601BLEU

Random

Updated 1mo ago

Evaluation Results

Method	Links
Random 2024.05		0.601	0.527	0.533	0.522	0.825	0.842	0.134
Random 2024.05		0.587	0.541	0.552	0.535	0.786	0.891	0.079
Attention 2024.05		0.547	0.447	0.46	0.448	0.721	0.791	0.17
Integrated-Gradient 2024.05		0.541	0.424	0.435	0.424	0.725	0.726	0.242
Integrated-Gradient 2024.05		0.541	0.495	0.503	0.488	0.744	0.835	0.135
Last-Attention 2024.05		0.533	0.423	0.452	0.432	0.672	0.77	0.202
Captum 2024.05		0.515	0.409	0.421	0.409	0.68	0.602	0.417
Attention 2024.05		0.486	0.447	0.469	0.441	0.683	0.831	0.14
JoPA 2024.05		0.484	0.388	0.386	0.379	0.642	0.549	0.504
Last-Attention 2024.05		0.475	0.423	0.436	0.415	0.672	0.84	0.113
Captum 2024.05		0.466	0.435	0.427	0.418	0.649	0.654	0.347
JoPA 2024.05		0.433	0.395	0.39	0.377	0.639	0.589	0.459