Share your thoughts, 1 month free Claude Pro on usSee more

Binary Classification on RelBench 1.0 (test)

72.03Relational Amazon User Churn

KumoRFM-2

Updated 4d ago

Evaluation Results

Method
KumoRFM-2 2026.04	72.03	-	69.27	87.15	89.4	82.17	69.41	67.42	90.83	84.59	-	79.6	92.18	81.66	3.08
DS+LightGBM 2026.04	72	-	69	86.2	90.3	81.8	64.46	64.27	84.23	69.8	-	75.62	82.4	75.42	7.75
Rel LLM 2025.10	71.9	-	70.5	89.6	91.2	83.4	67	66.7	71	77.2	82.2	77.1	-	-	-
TabPFN-2.5* 2026.04	71.74	-	54.99	52.26	59.66	59.3	51.45	54.44	70.91	61.21	-	61.63	77.35	69.1	16.42
RDBLearn 2026.04	71.58	-	68.05	85.26	89.39	82.07	65.49	69.04	82.52	70.87	-	75.97	79.69	75.04	8.08
RelGNN 2026.04	71.24	-	70.93	88.98	90.75	82.64	66.18	68.23	86.18	75.29	-	78.06	85.69	79.61	3.75
Rel GNN 2025.10	71	-	70.9	89	90.8	82.6	66.2	68.2	71.2	75.3	85.7	77.1	-	-	-
RT 2025.10	70.8	-	70.5	88.7	90.2	83.4	65.2	59	68.2	84.2	91.9	77.2	-	-	-
KumoRFM-1 2026.04	70.79	-	67.71	80	87.09	79.93	64.11	64.85	89.2	82.41	-	76.71	91.07	76.08	8.33
DS+TabPFN-2.5* 2026.04	70.75	-	68.31	85.08	89.07	79.83	64.53	64.21	85.7	71.16	-	74.92	77.7	76.43	9.5
RDL GNN 2025.10	70.7	-	69.4	88.9	90.6	82.8	66.1	63.1	68.6	72.5	80.9	75.4	-	-	-
DS+AutoGluon* 2026.04	70.51	-	68.71	85.38	89.94	80.45	65.87	65.66	82.31	70.01	-	75.36	82.53	74.85	8.5
RT 2025.10	70.5	-	69.9	88.5	90	83.2	65	63.6	68.6	78.7	82.7	76.1	-	-	-
Rel GT 2025.10	70.4	-	69.3	86.3	90.5	82.5	66.8	68.3	68.6	75.9	83.5	76.2	-	-	-
LightGBM 2026.04	70.09	-	55.21	63.43	63.39	62.54	53.05	53.6	79.93	68.56	-	63.67	73.92	68.04	16.75
Griffin 2025.10	70	-	68.3	87	89.8	81.1	65	63	68.9	74.5	82.5	75	-	-	-
Griffin 2025.10	69.4	-	68	87	90.4	79.9	62.6	64.7	64.6	66.7	78.7	73.2	-	-	-
RelGT 2026.04	68.61	-	69.27	86.32	90.53	82.55	66.78	68.3	81.57	75.87	-	76.65	83.52	76.09	6
GraphSAGE 2026.04	68.6	-	69.88	88.86	90.59	82.81	66.2	65.9	81.62	72.62	-	75.83	75.54	76.89	6.42
HGTPE 2026.04	59.21	-	65.69	85.66	88.17	78.03	64.95	64.57	81.61	71.17	-	72.24	76.27	65.36	11.75
LLM2 2026.04	59.17	-	63.81	79.99	81.23	73.41	54.07	53.36	68.65	80.03	-	69.46	87.11	70.11	13.92
HGT 2026.04	58.37	-	66.95	86.08	88.47	77.97	64.32	63.76	82.47	70.77	-	71.78	70.75	64.96	12.5
LLM1 2026.04	57.4	-	59.8	80	78	62.1	62.7	59.8	69.3	75.8	-	68.82	91.4	71.4	13.92
GNN+TabPFN 2026.04	56.68	-	64.34	85.34	87.48	77.89	65.35	60.68	84.13	64.26	-	71.56	74.67	73.58	12.58
RTzero 2026.04	51.8	-	62.8	80.1	75.7	70.9	61.8	59.5	77.47	81.2	-	67.73	89.3	73.22	13.25
Griffin 2026.04	51	-	60.2	73.5	77.5	69	60.7	45.9	83.27	57.7	-	66.29	82.5	71.88	15.42