Share your thoughts, 1 month free Claude Pro on usSee more

Open-domain Question Answering on MusiQue out-of-domain

35.8F1

UR2

Updated 1mo ago

Evaluation Results

Method	Links
UR2 2025.08		35.8	34.6
UR2 2025.08		35.8	34.6
Vanilla RL 2025.08		34.4	34.4
Vanilla RL 2025.08		34.4	34.4
UR2 2025.08		34.3	34
UR2 2025.08		34.3	34
R1-Searcher++ 2025.08		33.8	32.8
R1-Searcher++ 2025.08		33.8	32.8
R1-Searcher 2025.08		33.3	32.6
R1-Searcher 2025.08		33.3	32.6
Vanilla RL 2025.08		32.7	31.8
Vanilla RL 2025.08		32.7	31.8
Search-R1 2025.08		32.2	32
Search-R1 2025.08		32.2	32
Self-Ask 2025.08		31.6	35
R1-Searcher 2025.08		31.1	29.4
R1-Searcher 2025.08		31.1	29.4
UR2 2025.08		30.5	31.6
UR2 2025.08		30.5	31.6
Vanilla RL 2025.08		30	29.6
Vanilla RL 2025.08		30	29.6
Search-o1 2025.08		29.6	30.2
RAT 2025.08		29	31.4
Search-o1 2025.08		28.6	33.4
CoT 2025.08		28.3	35.4
Search-R1 2025.08		27.6	27.8
Search-R1 2025.08		27.6	27.8
Self-Ask 2025.08		26.1	27.8
CoT 2025.08		24.9	26.8
RAT 2025.08		24.3	24.8
Standard RAG 2025.08		21.9	28.4
Search-o1 2025.08		20.6	19.8
Standard RAG 2025.08		19.3	21.6
RAT 2025.08		17	16
Zero-Search 2025.08		16.9	17
Zero-Search 2025.08		16.9	17
Self-Ask 2025.08		16.8	16.4
Search-o1 2025.08		15.9	16.2
CoT 2025.08		14.8	12.2
CoT 2025.08		14.8	12.2
ZeroSearch 2025.08		14.7	13.8
ZeroSearch 2025.08		14.7	13.8
Self-Ask 2025.08		14.5	14.8
Standard RAG 2025.08		14.4	14.6
Standard RAG 2025.08		14.4	14.6
RAT 2025.08		14.4	12.4
Self-Ask 2025.08		13.6	19.6
Search-o1 2025.08		12.5	10
CoT 2025.08		11.3	9.6
CoT 2025.08		11.3	9.6
RAT 2025.08		11	8.2
Standard RAG 2025.08		10.1	10.2
Standard RAG 2025.08		10.1	10.2
CoT 2025.08		9.8	10.8
CoT 2025.08		9.8	10.8
Standard RAG 2025.08		9.7	7.4
Standard RAG 2025.08		9.7	7.4