Calibrated uncertainty for molecular property prediction using ensembles of message passing neural networks

Research output: Contribution to journalJournal articleResearchpeer-review

168 Downloads (Pure)

Abstract

Data-driven methods based on machine learning have the potential to accelerate computational analysis of atomic structures. In this context, reliable uncertainty estimates are important for assessing confidence in predictions and enabling decision making. However, machine learning models can produce badly calibrated uncertainty estimates and it is therefore crucial to detect and handle uncertainty carefully. In this work we extend a message passing neural network designed specifically for predicting properties of molecules and materials with a calibrated probabilistic predictive distribution. The method presented in this paper differs from previous work by considering both aleatoric and epistemic uncertainty in a unified framework, and by recalibrating the predictive distribution on unseen data. Through computer experiments, we show that our approach results in accurate models for predicting molecular formation energies with well calibrated uncertainty in and out of the training data distribution on two public molecular benchmark datasets, QM9 and PC9. The proposed method provides a general framework for training and evaluating neural network ensemble models that are able to produce accurate predictions of properties of molecules with well calibrated uncertainty estimates.
Original languageEnglish
Article number015012
JournalMachine Learning: Science and Technology
Volume3
Issue number1
Number of pages13
ISSN2632-2153
DOIs
Publication statusPublished - 2022

Keywords

  • Molecular property prediction
  • Machine learning potential
  • Uncertainty quantification
  • Uncertainty calibration
  • Message passing neural network
  • Graph neural network
  • Ensemble model

Fingerprint

Dive into the research topics of 'Calibrated uncertainty for molecular property prediction using ensembles of message passing neural networks'. Together they form a unique fingerprint.

Cite this