Cybersecurity Knowledge Question Answering on MMLU CSec

88CSec Score

RedSage-8B-Seed

Updated 25d ago

Evaluation Results

Method	Links
RedSage-8B-Seed 2026.01		88
RedSage-8B-Base 2026.01		87
RedSage-8B-CFW 2026.01		86
GPT-5 2026.01		86
LLM-based QA agent with external memory 2026.06		85.34
LLM-based QA agent with external memory 2026.06		85.34
Qwen3-32B 2026.01		84
Llama-3.1-8B 2026.01		83
Qwen3-8B-Base 2026.01		83
Foundation-Sec-8B 2026.01		80
Llama-Primus-Base 2026.01		79
RedSage-8B-DPO 2026.01		79
RedSage-8B-Ins 2026.01		78
LLM-based QA agent with external memory 2026.06		77.59
Llama-Primus-Merged 2026.01		76
Foundation-Sec-8B-Instruct 2026.01		76
Qwen3-8B 2026.01		76
DeepHat-V1-7B 2026.01		74
Llama-3.1-8B-Instruct 2026.01		72
Lily-Cybersecurity-7B-v0.2 2026.01		68
LLM-based QA agent with external memory 2026.06		64.66