Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MoleculeNet: A Benchmark for Molecular Machine Learning

About

Molecular machine learning has been maturing rapidly over the last few years. Improved methods and the presence of larger datasets have enabled machine learning algorithms to make increasingly accurate predictions about molecular properties. However, algorithmic progress has been limited due to the lack of a standard benchmark to compare the efficacy of proposed methods; most new algorithms are benchmarked on different datasets making it challenging to gauge the quality of proposed methods. This work introduces MoleculeNet, a large scale benchmark for molecular machine learning. MoleculeNet curates multiple public datasets, establishes metrics for evaluation, and offers high quality open-source implementations of multiple previously proposed molecular featurization and learning algorithms (released as part of the DeepChem open source library). MoleculeNet benchmarks demonstrate that learnable representations are powerful tools for molecular machine learning and broadly offer the best performance. However, this result comes with caveats. Learnable representations still struggle to deal with complex tasks under data scarcity and highly imbalanced classification. For quantum mechanical and biophysical datasets, the use of physics-aware featurizations can be more important than choice of particular learning algorithm.

Zhenqin Wu, Bharath Ramsundar, Evan N. Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S. Pappu, Karl Leswing, Vijay Pande• 2017

Related benchmarks

TaskDatasetResultRank
Molecular property predictionQM9 (test)
mu0.244
174
Toxicity PredictionTox21 (scaffold)
AUC0.751
46
Molecular Property Prediction (Classification)MoleculeNet (test)
BBBP72.9
20
Molecular Property Prediction (Regression)MoleculeNet (test)
ESOL Error0.58
17
Atomization energy predictionQM7 (10-fold cross validation)
MAE8.2
13
RegressionQM9
Dipole Moment (mu) Error0.244
13
Toxicity PredictionTox21 (random)
AUC82.9
11
Toxicity PredictionTOXCAST (random)
AUC71.8
11
Toxicity PredictionTox21
AUC0.821
11
Toxicity PredictionTOXCAST (index)
AUC0.69
11
Showing 10 of 11 rows

Other info

Code

Follow for update