Our new X account is live! Follow @wizwand_team for updates

Long-context Language Modeling on LongBench (Aggregated Metrics)

42.77Single-Document QA

MXFP8

Updated 2d ago

Evaluation Results

Method
MXFP8 2026.02	42.77	29.95	22.91	32.2	68.97	5.29	34.71
MXFP8 2026.02	42.64	29.48	23.07	33.31	68.78	5.36	34.82
MXFP8 2026.02	42.56	29.57	22.64	31.3	68.72	4.96	34.3
BF16 2026.02	42.42	29.5	23.09	29.99	67.89	4.4	33.93
HiF8 2026.02	42.23	29.16	22.8	32.67	69.14	3.84	34.41
HiF8 2026.02	42.15	28.49	22.86	33.18	68.83	3.55	34.3
HiF8 2026.02	42.05	28.97	22.91	33.83	68.89	3.94	34.55
INT8 2026.02	41.93	29.63	22.67	31.77	68.56	4.7	34.24
INT8 2026.02	41.92	30.08	22.67	30.57	68.43	4.95	34.1
INT8 2026.02	41.88	30.5	22.64	30.65	69.47	4.67	34.31
HiF4 2026.02	41.08	27.91	22.82	28.37	66.14	7.34	33.04
MXFP4 2026.02	40.73	25.07	22.46	31.88	63.14	26.96	34.47
HiF4 2026.02	39.7	27.92	22.63	26.77	67.5	5.85	32.49
HiF4 2026.02	39.65	27.7	22.6	26.02	64.56	5.47	31.83
NVFP4 2026.02	39.34	28.61	23	25.42	65.1	8.44	32.27
NVFP4 2026.02	39.25	26.39	22.93	26.01	61.97	7.87	31.43
NVFP4 2026.02	38.74	25.88	22.72	25.95	61.39	9.83	31.28
MXFP4 2026.02	37.95	23.98	22.17	24.61	58.65	25.59	31.52
INT8 2026.02	37.22	26.2	20.29	40.94	60.41	26.85	34.93
MXFP8 2026.02	37.12	26.54	20.55	41.1	57.49	30.29	34.97
INT8 2026.02	36.86	26.94	20.49	40.05	61.81	26.6	35.05
INT8 2026.02	36.83	26.71	20.44	41.3	59.72	25.7	34.84
MXFP8 2026.02	36.73	26.21	20.45	42.54	60	27.15	35.14
HiF4 2026.02	36.28	25.81	20.4	39.34	61.09	23.34	34.16
HiF8 2026.02	36.27	25.34	20.63	38.53	53.51	23.27	32.86
BF16 2026.02	36.25	24.78	20.5	41.84	60.7	23.96	34.45
MXFP4 2026.02	36.2	23.88	22.27	22.66	53.72	27.24	30.27
MXFP8 2026.02	36.06	27.1	20.41	39.88	55.71	28.47	34.18
HiF8 2026.02	36.03	25.49	20.37	42.67	59.72	21.57	34.31
HiF8 2026.02	35.42	25.4	20.47	39	55.65	23.92	33.14
NVFP4 2026.02	35.35	23.78	20.53	37.71	59.71	16.04	32.41
HiF4 2026.02	35.14	22.96	20.24	32.48	54.76	30.69	31.85
HiF4 2026.02	34.74	25.63	20.18	33.34	53.01	26.46	31.79
MXFP4 2026.02	33.14	20.18	20.51	29.81	58.86	27.63	30.78
NVFP4 2026.02	32.97	23.14	20.11	26.34	55.21	15.13	28.86
NVFP4 2026.02	30.08	22.07	20	25.42	51.27	14.31	27.27
MXFP4 2026.02	26	14.91	19.64	12.21	23.75	18.59	19.02
MXFP4 2026.02	21.89	13.35	19.23	11.33	17.85	15.79	16.59
INT4 2026.02	14.09	8.51	14.6	5.34	5.03	10.26	9.8
INT4 2026.02	3.69	3.16	12.51	2.09	2.2	13.54	5.69
INT4 2026.02	3.56	3.28	12.71	2.13	2.88	13.54	5.83
INT4 2026.02	1.17	1.11	2.13	0.59	0.91	7.81	1.83
INT4 2026.02	1.14	1.42	2.45	0.54	1.24	7.31	1.93
INT4 2026.02	1.03	1.12	2.54	0.51	1.43	7.75	1.93