Share your thoughts, 1 month free Claude Pro on usSee more

Out-of-Distribution Generalization

Benchmarks

Dataset Name	SOTA Method	Metric
AIME '26	TTT no-QK	Saving Score19.8	6	16d ago
AIME '25	TTT no-QK	Saving Score26.5	6	16d ago
AIME'24	TTT QK (dh=128)	Saving Score29.5	6	16d ago
GPQA Diamond OOD	TTT no-QK	Sav.71.5	6	16d ago
MATH-500 OOD (test)	TTT QK (dh=128)	Score (Sav.)67	6	16d ago
Financial domain dataset (test)	ERM	Minimum Accuracy47.6	3	1mo ago
Real-world FC Property: MolWt (51to75)	EG-GNN	EGS3.27	2	1mo ago
Real-world FC Property: MolWt (0to25)	EG-GNN	EGS49	2	1mo ago
Synthetic TRIANGLE Property: NumSubgraph (26to50)	EG-GNN	EGS3.55	2	1mo ago
Real-world MUTAG Property: NumRB (76to100)	EG-GNN	EGS0.01	1	1mo ago
Real-world MUTAG Property NumRB (51to75)	EG-GNN	EGS3.72	1	1mo ago
Real-world MUTAG Property: NumRB (26to50)	EG-GNN	EGS4.62	1	1mo ago
Real-world MUTAG Property: NumRB (0to25)	EG-GNN	EGS Score3.97	1	1mo ago
Real-world FC Property: NumRB (76to100)	EG-GNN	EGS2.4	1	1mo ago
Real-world FC Property: NumRB (51to75)	EG-GNN	EGS1.72	1	1mo ago
Real-world FC Property: NumRB (26to50)	EG-GNN	Estimated Generalization Score (EGS)100	1	1mo ago
Real-world FC Property: NumRB (0to25)	EG-GNN	EGS0.33	1	1mo ago
Real-world MUTAG Property: MolWt (76to100)	EG-GNN	EGS7.22	1	1mo ago
Real-world MUTAG Property: MolWt (26to50)	EG-GNN	EGS5.95	1	1mo ago
Real-world FC Property: MolWt (76to100)	EG-GNN	EGS5.04	1	1mo ago
Real-world FC Property: MolWt (26to50)	EG-GNN	EGS70	1	1mo ago
Synthetic PENTAGON Property: SubgraphSize (76to100)	EG-GNN	EGS1.16	1	1mo ago
Synthetic PENTAGON Property: SubgraphSize (51to75)	EG-GNN	EGS0.58	1	1mo ago
Synthetic PENTAGON Property: SubgraphSize (26to50)	EG-GNN	EGS2.37	1	1mo ago
Synthetic PENTAGON Property: SubgraphSize (0to25)	EG-GNN	EGS4.06	1	1mo ago

Showing 25 of 35 rows