Share your thoughts, 1 month free Claude Pro on usSee more

Summarization Faithfulness Evaluation on FeedSum

96Consistency Score

Gemini

Updated 1mo ago

Evaluation Results

Method	Links
Gemini 2026.04		96	89	93	93
GPT4omini 2026.04		95	93	93	94
GPT4-turbo 2026.04		95	92	92	93
GPT4o 2026.04		94	91	95	93
Mistral 2026.04		91	89	90	90
Qwen 2026.04		88	83	85	85
Qwen* 2026.04		87	83	85	85
SummLLaMA 2026.04		85	85	84	85
LLaMA* 2026.04		85	80	80	82
LLaMA 2026.04		83	83	80	82
Mistral* 2026.04		81	82	80	81