Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on MuSiQue (F1)

52.27F1 Score

PANINI

Updated 2mo ago

Evaluation Results

Method	Links
PANINI 2026.02		52.27
Oracle 2026.01		51.9
Oracle 2026.01		49.7
HippoRAG 2 2026.02		49.3
Oracle 2026.01		48.7
Oracle 2026.01		48.6
Oracle 2026.01		46.2
NV-Embed-v2 (7B) 2026.02		46
IRCoT 2026.02		44.2
Oracle 2026.01		43.8
Qwen3-Embedding (8B) 2026.02		43.7
CoA 2024.06		42.49
GraphRAG 2026.02		42
Search-R1 2026.02		41.1
RAG 2024.06		40.38
Qwen3-Embedding (8B) 2026.02		39.4
RAPTOR 2026.02		39.2
DF-RAG + IC 2026.01		38.6
LongRAG 2026.01		38.1
DF-RAG + IC 2026.01		38
DF-RAG 2026.01		37.9
RAG with gMMR 2026.01		37.5
CoA 2024.06		37.09
LongRAG 2026.01		36.8
DF-RAG 2026.01		36.3
Vanilla RAG 2026.01		36
RAG with gMMR 2026.01		35.9
HippoRAG 2026.02		35.9
Vanilla RAG 2026.01		35.4
CoA 2024.06		35.09
RAG with gMMR 2026.01		34.6
RAPTOR 2026.01		34.3
DF-RAG + IC 2026.01		34
RAG 2024.06		33.83
Vanilla RAG 2026.01		33.6
HippoRAG 2026.01		33.5
DF-RAG 2026.01		33.3
RAG with gMMR 2026.01		33.3
DF-RAG + IC 2026.01		33.3
HippoRAG 2026.01		32.8
DF-RAG + IC 2026.01		32.7
DF-RAG 2026.01		32.2
Vanilla RAG 2026.01		31.9
DF-RAG + IC 2026.01		31.7
RAG 2024.06		31.56
DF-RAG 2026.01		31.3
RAG with gMMR 2026.01		30.9
Vanilla RAG 2026.01		29.9
BM25 2026.02		29.9
Vanilla 2024.06		29.67
RAPTOR 2026.01		29.6
DF-RAG 2026.01		28.8
Vanilla 2024.06		27.93
RAG with gMMR 2026.01		27.6
Vanilla 2024.06		26.87
TIPS 2026.03		26.58
BM25 2026.02		25.3
Vanilla RAG 2026.01		24.8
Vanilla 2024.06		23.61
INTRA 2026.05		23
Qwen3-Emb-4B + Reranker 2026.05		22.5
None 2026.02		22
Qwen3-Emb-4B 2026.05		21.8
Hybrid RAG 2026.05		20.1
Qwen3-Emb-0.6B 2026.05		20
MaxSim 2026.05		19.8
BGE 2026.05		19.7
PPO 2026.03		17.79
BM25 2026.05		16.8
TIPS 2026.03		15.85
GRPO 2026.03		14.81
TF-IDF 2026.05		14.6
MT-GRPO* 2026.03		14.29
PPO 2026.03		12.65
MT-PPO 2026.03		12.13
GRPO 2026.03		12.12
MT-PPO 2026.03		11.05
MT-GRPO* 2026.03		10.68
LightRAG 2026.02		9.3