Share your thoughts, 1 month free Claude Pro on usSee more

Open-domain Question Answering on HotpotQA in-domain

72.4F1 Score

Search-R1

Updated 1mo ago

Evaluation Results

Method	Links
Search-R1 2025.08		72.4	78.8
R1-Searcher 2025.08		71.8	78
UR2 2025.08		71.2	79.4
Vanilla RL 2025.08		70.9	78.8
R1-Searcher 2025.08		70.8	76.8
UR2 2025.08		70.1	78.8
Vanilla RL 2025.08		70	77.6
UR2 2025.08		67.7	76
Vanilla RL 2025.08		65.9	73.6
Search-o1 2025.08		64.3	73.4
Search-R1 2025.08		63.1	69.2
Standard RAG 2025.08		59.6	69.6
R1-Searcher++ 2025.08		59	64.2
RAT 2025.08		53.8	59.2
Search-o1 2025.08		53	59.4
Search-o1 2025.08		50.9	61.6
Standard RAG 2025.08		50.6	57
Standard RAG 2025.08		49.2	62.8
Standard RAG 2025.08		47.5	54.4
CoT 2025.08		46.5	51.2
ZeroSearch 2025.08		46	50.4
Self-Ask 2025.08		45	50.4
RAT 2025.08		44.5	48.8
Self-Ask 2025.08		43	50.8
Zero-Search 2025.08		42.7	45.8
RAT 2025.08		37.9	40.6
Search-o1 2025.08		36.4	37.6
Self-Ask 2025.08		33.8	47.2
RAT 2025.08		30.1	32.2
Self-Ask 2025.08		28.8	61
CoT 2025.08		28.6	31.6
CoT 2025.08		26.6	27.2
CoT 2025.08		24.9	31
Search-R1 2025.08		0.724	0.788
R1-Searcher 2025.08		0.718	0.78
UR2 2025.08		0.712	0.794
Vanilla RL 2025.08		0.709	0.788
R1-Searcher 2025.08		0.708	0.768
UR2 2025.08		0.701	0.788
Vanilla RL 2025.08		0.7	0.776
UR2 2025.08		0.677	0.76
Vanilla RL 2025.08		0.659	0.736
Self-Ask 2025.08		0.654	0.75
Search-R1 2025.08		0.631	0.692
R1-Searcher++ 2025.08		0.59	0.642
RAT 2025.08		0.569	0.642
Standard RAG 2025.08		0.545	0.744
Search-o1 2025.08		0.531	0.74
Standard RAG 2025.08		0.506	0.57
Standard RAG 2025.08		0.492	0.628
Standard RAG 2025.08		0.475	0.544
ZeroSearch 2025.08		0.46	0.504
CoT 2025.08		0.437	0.592
Zero-Search 2025.08		0.427	0.458
CoT 2025.08		0.286	0.316
CoT 2025.08		0.266	0.272
CoT 2025.08		0.249	0.31