Share your thoughts, 1 month free Claude Pro on usSee more

Long-context Recall on SQuAD, FDA, and SWDE Subset

72.3SQuAD Recall Accuracy

Qwen3

Updated 25d ago

Evaluation Results

Method	Links
Qwen3 2026.06		72.3	78.2	90.8	80.4
Qwen3 2026.06		58.7	81	90.8	76.8
HALO 2026.06		54.5	68.2	80.9	67.9
FlashMorph 2026.06		54.3	74.1	82.2	70.2
PostNAS* 2026.06		54.2	69.4	81.9	68.5
KL-LS 2026.06		54.1	73.5	81.2	69.6
PostNAS* 2026.06		52.8	67.9	82.4	67.7
FlashMorph 2026.06		52.7	73.5	87.3	71.2
PostNAS* 2026.06		51.3	64.7	80.9	65.7
HALO 2026.06		51.3	70.5	82.5	68.1
FlashMorph 2026.06		51.1	71.6	81.6	68.1
Uniform 2026.06		49.7	63.3	84.1	65.7
Uniform 2026.06		48.2	59.2	78.9	62.1
FlashMorph 2026.06		47.3	73.7	82.3	67.7
Qwen3 2026.06		44.1	82.1	80.5	68.9
KL-LS 2026.06		44.1	53.5	78.6	58.7
Qwen3 2026.06		44.1	82.1	80.5	68.9
HALO 2026.06		43.7	41.4	74.2	53.1
Uniform 2026.06		43.6	57.3	81.2	60.7
PostNAS* 2026.06		43.5	63.5	81.5	62.8
HALO 2026.06		41.9	59.7	80.9	60.8
FlashMorph 2026.06		41.7	62.4	76.2	60.1
Uniform 2026.06		40.2	64.5	80.4	61.7
Qwen3 2026.06		39.8	79	85.1	67.9
Qwen3 2026.06		39.8	79	85.1	67.9
FlashMorph 2026.06		39.8	70.2	81.4	63.8
KL-LS 2026.06		39.5	49.4	74.8	54.5
Uniform 2026.06		39	56.6	78.6	58.1
HALO 2026.06		38.5	67.8	80.7	62.3
FlashMorph 2026.06		38.4	71.3	76.7	62.1
HALO 2026.06		36.4	68.5	75.4	60.1
FlashMorph 2026.06		35.4	70.7	76	60.7
FlashMorph 2026.06		35.3	58.2	76.8	56.7
HALO 2026.06		34.7	60.4	72.6	55.9
KL-LS 2026.06		33.5	72.8	75.6	60.6
KL-LS 2026.06		32.7	61.4	75.2	56.4
Uniform 2026.06		31.1	55.6	75	53.9
Uniform 2026.06		30.3	51.3	71.8	51.1
Uniform 2026.06		30.3	55.5	72.2	52.7
KL-LS 2026.06		29.3	58.5	70.5	52.8
KL-LS 2026.06		26.7	48.8	73.9	49.8
HALO 2026.06		26.5	62	71.2	53.2
KL-LS 2026.06		25.7	58.4	70.8	51.6
Uniform 2026.06		23	35.9	76.8	45.2
HALO 2026.06		22.8	62.8	73.5	53
FlashMorph 2026.06		21.4	53.4	81.5	52.1
HALO 2026.06		20.8	41	77	46.3
Uniform 2026.06		20.7	52.6	70.6	48