Share your thoughts, 1 month free Claude Pro on usSee more

Factuality Question Answering on TruthfulQA (score)

66.92Score

UNA-score & binary

Updated 23d ago

Evaluation Results

Method	Links
UNA-score & binary 2024.08		66.92
UNA-score & binary 2024.08		64.62
UNA-score (MSE) 2024.08		64.44
UNA-score & binary 2024.08		61.24
UNA-score (MSE) 2024.08		60.46
UNA-score (MSE) 2024.08		55.09
KTO 2024.08		55.07
UNA-binary (BCE) 2024.08		54.75
DPO 2024.08		53.47
UNA-pairwise 2024.08		53.47
Qwen 8B 2024.08		52.19
UNA-binary (BCE) 2024.08		52.1
KTO 2024.08		52.07
DPO 2024.08		51.78
UNA-pairwise 2024.08		51.78
UNA-binary (BCE) 2024.08		48.33
KTO 2024.08		47.72
UNA-score & binary 2024.08		46.69
UNA-score (MSE) 2024.08		45.74
Llama 8B 2024.08		45.16
DPO 2024.08		44.75
UNA-pairwise 2024.08		44.75
Mistral 7B 2024.08		42.58
UNA-binary (BCE) 2024.08		40.79
DPO 2024.08		40.37
UNA-pairwise 2024.08		40.37
Gemma 4B 2024.08		39.73
KTO 2024.08		39.71