Share your thoughts, 1 month free Claude Pro on usSee more

Out-of-Distribution Generalization

Benchmarks

Dataset Name	SOTA Method	Metric
MedMNIST+ out-of-distribution	BioMedCoOp	PathMNIST Accuracy32.72	9	1mo ago
AIME '26	TTT no-QK	Saving Score19.8	6	2mo ago
AIME '25	TTT no-QK	Saving Score26.5	6	2mo ago
AIME'24	TTT QK (dh=128)	Saving Score29.5	6	2mo ago
GPQA Diamond OOD	TTT no-QK	Sav.71.5	6	2mo ago
MATH-500 OOD (test)	TTT QK (dh=128)	Score (Sav.)67	6	2mo ago
MMLU-Redux and GPQA-Diamond (out-of-distribution)	Qwen3-30B-A3B	Average Accuracy76.7	4	15d ago
Financial domain dataset (test)	ERM	Minimum Accuracy47.6	3	3mo ago
Real-world FC Property: MolWt (51to75)	EG-GNN	EGS3.27	2	3mo ago
Real-world FC Property: MolWt (0to25)	EG-GNN	EGS49	2	3mo ago
Synthetic TRIANGLE Property: NumSubgraph (26to50)	EG-GNN	EGS3.55	2	3mo ago
Real-world MUTAG Property: NumRB (76to100)	EG-GNN	EGS0.01	1	3mo ago
Real-world MUTAG Property NumRB (51to75)	EG-GNN	EGS3.72	1	3mo ago
Real-world MUTAG Property: NumRB (26to50)	EG-GNN	EGS4.62	1	3mo ago
Real-world MUTAG Property: NumRB (0to25)	EG-GNN	EGS Score3.97	1	3mo ago
Real-world FC Property: NumRB (76to100)	EG-GNN	EGS2.4	1	3mo ago
Real-world FC Property: NumRB (51to75)	EG-GNN	EGS1.72	1	3mo ago
Real-world FC Property: NumRB (26to50)	EG-GNN	Estimated Generalization Score (EGS)100	1	3mo ago
Real-world FC Property: NumRB (0to25)	EG-GNN	EGS0.33	1	3mo ago
Real-world MUTAG Property: MolWt (76to100)	EG-GNN	EGS7.22	1	3mo ago
Real-world MUTAG Property: MolWt (26to50)	EG-GNN	EGS5.95	1	3mo ago
Real-world FC Property: MolWt (76to100)	EG-GNN	EGS5.04	1	3mo ago
Real-world FC Property: MolWt (26to50)	EG-GNN	EGS70	1	3mo ago
Synthetic PENTAGON Property: SubgraphSize (76to100)	EG-GNN	EGS1.16	1	3mo ago
Synthetic PENTAGON Property: SubgraphSize (51to75)	EG-GNN	EGS0.58	1	3mo ago

Showing 25 of 37 rows