Share your thoughts, 1 month free Claude Pro on usSee more

Long-Context Language Modeling Performance and Speedup on RULER

97.27Score (4K)

FlashPrefill

Updated 1mo ago

Evaluation Results

Method	Links
FlashPrefill 2026.03		97.27	96.2	94.97	92.21	84.93	75.31	90.15	1.71	2.81	4.63	7.48	13.62	22.67
MInference 2026.03		96.34	93.79	93.48	89.76	84.32	71.28	88.16	0.11	0.16	0.45	0.83	1.34	2.45
Full Attention 2026.03		96.07	93.94	93.51	90.68	86.29	74.25	89.12	1	1	1	1	1	1
Full Attention 2026.03		95.78	95.79	95.82	94.31	90.25	87.71	93.28	1	1	1	1	1	1
FlashPrefill 2026.03		95.76	95.89	95.03	94.06	90.11	85.2	92.68	1.71	2.79	4.48	6.94	11.45	18.67
FlexPrefill 2026.03		95.67	95.42	95.23	93.62	89.62	86.12	92.61	0.12	0.34	0.98	2.31	3.92	5.43
FlexPrefill 2026.03		95.63	93.14	91.92	90.36	85.49	73.23	88.3	0.11	0.33	0.98	2.21	4.16	5.18
MInference 2026.03		95.61	93.21	91.62	90.16	68.22	24.38	77.2	0.11	0.16	0.45	0.86	1.39	2.88
MInference 2026.03		95.53	95.12	94.87	92.62	88.63	82.16	91.48	0.11	0.16	0.45	0.85	1.39	2.73
FlashPrefill 2026.03		95.37	93.64	91.98	88.25	70.45	34.1	78.97	1.72	-	4.51	6.02	10.68	16.87
FlexPrefill 2026.03		95.27	93.21	91.81	89.12	70.06	26.33	77.63	0.12	0.34	0.95	2.29	4	5.86
Full Attention 2026.03		95.21	93.17	92.18	90.14	71.87	25.23	77.97	1	1	1	1	1	1
XAttention 2026.03		95.01	92.16	91.91	90.06	85.17	71.68	87.67	0.77	1.27	1.83	2.34	3.19	3.48
XAttention 2026.03		94.72	93.68	92.32	90.44	88.12	83.69	90.5	0.84	1.43	2.02	2.45	2.97	3.45
XAttention 2026.03		94.52	92.14	89.72	86.21	66.65	26.36	75.93	0.84	1.56	2.32	3.04	3.64	4.34
FlashMoBA 2026.03		93.14	83.23	79.28	72.13	60.12	31.26	69.86	0.75	1.16	1.99	3.34	4.7	5.98
FlashMoBA 2026.03		92.36	83.68	76.11	68.12	49.31	20.13	64.95	0.73	1.14	1.97	3.34	4.7	5.98
FlashMoBA 2026.03		92.18	89.13	84.22	76.13	67.12	60.12	78.15	0.7	1.13	1.97	3.34	4.7	5.98