Our new X account is live! Follow @wizwand_team for updates

Meeting Summarization on SamSum

6.4347HPI

Gemma 7B

Updated 4d ago

Evaluation Results

Method	Links
Gemma 7B 2024.06		6.4347	-
Phi-3 3.8B 2024.06		5.7778	-
Gemma 7B 2024.06		5.7229	-
Llama-3 8B 2024.06		5.5756	-
Mistral 7B 2024.06		5.1336	-
Phi-3 3.8B 2024.06		5.0961	-
Llama-3 8B 2024.06		5.0316	-
Gemma 7B 2024.06		5.03	10
Mistral 7B 2024.06		4.7423	-
Gemma 7B 2024.06		3.31	11
Gemma-2 9B 2024.06		1.86	22
Llama-3 8B 2024.06		1.72	22
Mistral 7B 2024.06		1.68	22
Claude 3.5 Sonnet 2024.06		1.6	23
Mistral-Nemo 12B 2024.06		1.47	24
Gemma-2 9B 2024.06		1.3	22
Llama-3 8B 2024.06		1.3	22
Mistral 7B 2024.06		1.26	21
Claude 3.5 Sonnet 2024.06		1.25	23
GPT-4o 2024.06		1.21	29
Mistral-Nemo 12B 2024.06		1.19	23
GPT-4o 2024.06		1.11	30
OmniVec2 2025.07		-	55.4
OmniVec 2025.07		-	54.6