Alert button

GPS++: Reviving the Art of Message Passing for Molecular Property Prediction

Feb 06, 2023
Dominic Masters, Josef Dean, Kerstin Klaser, Zhiyi Li, Sam Maddrell-Mander, Adam Sanders, Hatem Helal, Deniz Beker, Andrew Fitzgibbon, Shenyang Huang, Ladislav Rampášek, Dominique Beaini

Figure 1 for GPS++: Reviving the Art of Message Passing for Molecular Property Prediction
Figure 2 for GPS++: Reviving the Art of Message Passing for Molecular Property Prediction
Figure 3 for GPS++: Reviving the Art of Message Passing for Molecular Property Prediction
Figure 4 for GPS++: Reviving the Art of Message Passing for Molecular Property Prediction

Share this with someone who'll enjoy it:

We present GPS++, a hybrid Message Passing Neural Network / Graph Transformer model for molecular property prediction. Our model integrates a well-tuned local message passing component and biased global attention with other key ideas from prior literature to achieve state-of-the-art results on large-scale molecular dataset PCQM4Mv2. Through a thorough ablation study we highlight the impact of individual components and, contrary to expectations set by recent trends, find that nearly all of the model's performance can be maintained without any use of global self-attention. We also show that our approach is significantly more accurate than prior art when 3D positional information is not available.

* arXiv admin note: text overlap with arXiv:2212.02229  
View paper onarxiv icon

Share this with someone who'll enjoy it: