Share your thoughts, 1 month free Claude Pro on usSee more

Long-context multi-task evaluation on LongBench-E

45.25Qasper

FluxAttn

Updated 8d ago

Evaluation Results

Method
FluxAttn 2026.04	45.25	54.42	54.54	41.34	34.54	26.16	68.33	91.91	42.17	9	97.67	47.74	65.35	52.28	51
TriangleMix 2026.04	45.1	54.6	56.67	41.88	34.09	25.51	71.33	90.93	42.63	10.62	94.67	43.64	59.35	51.67	50
FluxAttn 2026.04	44.77	54.12	57.35	43.43	34.31	25.8	72.33	91.32	42.62	9.33	98.33	45.48	60.7	52.42	62
Llama-3.1-8B-Instruct 2026.04	44.06	53.44	59.62	44.08	34.5	26.02	71	90.54	42.94	12.67	99.33	47.78	63.85	53.28	-
FluxAttn 2026.04	43.76	53.41	57.36	39.43	32.96	25.63	70.33	91.27	42.2	11	98.67	45.6	66.17	52.3	51
FluxAttn 2026.04	42.14	53.13	58.53	43.5	34.66	26.06	70.67	91.46	43.13	8	99.67	50.91	64.78	53.07	72
DuoAttention 2026.04	41.78	51.55	55.96	41.7	33.24	23.34	69.33	89.35	41.62	0.5	98.93	57.54	69.39	52.13	50
PruLong 2026.04	41.51	52.36	50.46	37.57	34.25	25.86	66.33	89.93	41.72	9.07	97	56.84	66.23	51.68	50
Qwen3-8B 2026.04	41.22	49.92	58.98	44.21	33.27	23.42	71.33	86.77	41.83	2	98.33	56.08	66.31	52.16	-
FluxAttn 2026.04	41	49.76	58.19	44.36	33.32	23.35	70	88.77	41.7	1.33	99.67	55.6	67.22	52.22	47
TriangleMix 2026.04	40.82	51.31	57.57	44.51	33.32	23.35	71.33	86.73	41.79	2	94.33	55.04	65.89	51.65	50
FluxAttn 2026.04	40.41	50.26	57.78	40.57	33.27	23.51	69.67	87.19	42.12	1.33	99.33	55.41	65.51	51.57	51
FluxAttn 2026.04	40.3	50.49	56.02	40.9	33.01	23.55	71.67	88.31	41.61	0.33	100	59.46	68.27	52.18	46
FluxAttn 2026.04	39.92	50.04	55.72	40.81	33.03	23.5	72	88.48	40.96	0.33	99.22	58.57	69.46	52.05	46
PruLong 2026.04	37.95	51.2	51.94	36.48	33.11	23.36	69	87.9	42.11	1	98	57.05	67.66	50.8	50
DuoAttention 2026.04	35.83	49.84	47.09	32.24	33.32	23.7	69.33	85.87	39.75	4.5	94.57	50.56	57.43	48.22	50
FluxAttn 2026.04	35.74	51.7	45.83	32.34	33.57	23.66	69	87.23	39.81	3.5	93.74	50.81	59.28	48.32	53
TriangleMix 2026.04	35.55	52.02	45.37	31.76	33.32	23.7	69	88.2	39.74	3.83	91.51	48.58	56.38	47.72	50
Qwen3-4B 2026.04	35.21	52.16	44.81	32.15	33.47	23.45	70.67	88.22	39.74	2.33	96.84	50.84	57.93	48.45	-
FluxAttn 2026.04	35.1	51.68	49.65	32.86	33.04	23.42	69.33	88	40	1.67	94.47	51.4	58.68	48.59	44
FluxAttn 2026.04	35.02	49.44	49.64	32.27	33.26	23.48	69.33	88.29	39.78	1.5	94.56	53.44	59.69	48.72	44
FluxAttn 2026.04	35.02	50.89	45.17	34.24	33.02	23.53	69	88.08	40.38	3.94	96.06	51.68	60	48.76	47
DuoAttention 2026.04	34.63	50.74	49.7	36.41	34.25	25.78	70	91.45	42.13	9.8	97.33	53.59	68.55	52.11	50
PruLong 2026.04	34.15	50.78	44.48	32.89	32.96	23.53	67.67	88.69	39.55	3.17	90.17	49	54.07	47.16	50