Our new X account is live! Follow @wizwand_team for updates

Faithfulness Measurement on Alpaca

0.601BLEU

Random

Updated 4d ago

Evaluation Results

Method	Links
Random 2024.05		0.601	0.527	0.533	0.522	0.825	0.842	0.134
Random 2024.05		0.587	0.541	0.552	0.535	0.786	0.891	0.079
Attention 2024.05		0.547	0.447	0.46	0.448	0.721	0.791	0.17
Integrated-Gradient 2024.05		0.541	0.424	0.435	0.424	0.725	0.726	0.242
Integrated-Gradient 2024.05		0.541	0.495	0.503	0.488	0.744	0.835	0.135
Last-Attention 2024.05		0.533	0.423	0.452	0.432	0.672	0.77	0.202
Captum 2024.05		0.515	0.409	0.421	0.409	0.68	0.602	0.417
Attention 2024.05		0.486	0.447	0.469	0.441	0.683	0.831	0.14
JoPA 2024.05		0.484	0.388	0.386	0.379	0.642	0.549	0.504
Last-Attention 2024.05		0.475	0.423	0.436	0.415	0.672	0.84	0.113
Captum 2024.05		0.466	0.435	0.427	0.418	0.649	0.654	0.347
JoPA 2024.05		0.433	0.395	0.39	0.377	0.639	0.589	0.459