Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Reliable OOD Virtual Screening with Extrapolatory Pseudo-Label Matching

About

Machine learning (ML) models are increasingly deployed for virtual screening in drug discovery, where the goal is to identify novel, chemically diverse scaffolds while minimizing experimental costs. This creates a fundamental challenge: the most valuable discoveries lie in out-of-distribution (OOD) regions beyond the training data, yet ML models often degrade under distribution shift. Standard novelty-rejection strategies ensure reliability within the training domain but limit discovery by rejecting precisely the novel scaffolds most worth finding. Moreover, experimental budgets permit testing only a small fraction of nominated candidates, demanding models that produce reliable confidence estimates. We introduce EXPLOR (Extrapolatory Pseudo-Label Matching for OOD Uncertainty-Based Rejection), a framework that addresses both challenges through extrapolatory pseudo-labeling on latent-space augmentations, requiring only a single labeled training set and no access to unlabeled test compounds, mirroring the realistic conditions of prospective screening campaigns. Through a multi-headed architecture with a novel per-head matching loss, EXPLOR learns to extrapolate to OOD chemical space while producing reliable confidence estimates, with particularly strong performance in high-confidence regions, which is critical for virtual screening where only top-ranked candidates advance to experimental validation. We demonstrate state-of-the-art performance across chemical and tabular benchmarks using different molecular embeddings.

Yunni Qu, Bhargav Vaduri, Karthikeya Jatoth, James Wellnitz, Dzung Dinh, Seth Veenbaas, Jonathan Chapman, Alexander Tropsha, Junier Oliva (1) __INSTITUTION_9__ Department of Computer Science, University of North Carolina at Chapel Hill, (2) Eshelman School of Pharmacy, University of North Carolina at Chapel Hill)• 2024

Related benchmarks

TaskDatasetResultRank
ClassificationTableShift Childhood Lead v1 (OOD test)
AUPRC @ R<0.199.72
14
ClassificationTableShift FICO HELOC v1 (OOD test)
AUPRC (R<0.1)96.99
14
Molecular property predictionhERG ChEMBL
AUPRC (R<0.2)94.67
14
Molecular property predictionA549_cells ChEMBL
AUPRC@R<0.299.05
14
Molecular property predictioncyp_2D6 ChEMBL
AUPRC @ R<0.296.88
14
Molecular property predictionAmes Therapeutics Data Commons
AUPRC (R<0.2)99.87
14
Molecular property predictionDrugOOD refined ec50 (val)
AUPRC (R<0.2)98.45
14
Molecular property predictionDrugOOD refined ec50 (test)
AUPRC @ R<0.289.76
14
Molecular property predictionDrugOOD core ic50 (val)
AUPRC (R<0.2)99.15
14
Molecular property predictionDrugOOD core ic50 (test)
AUPRC (R<0.2)94.52
14
Showing 10 of 18 rows

Other info

Follow for update