Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors

Jul 31, 2018
Soumya Ghosh, Jiayu Yao, Finale Doshi-Velez

Share this with someone who'll enjoy it:

Bayesian Neural Networks (BNNs) have recently received increasing attention for their ability to provide well-calibrated posterior uncertainties. However, model selection---even choosing the number of nodes---remains an open question. Recent work has proposed the use of a horseshoe prior over node pre-activations of a Bayesian neural network, which effectively turns off nodes that do not help explain the data. In this work, we propose several modeling and inference advances that consistently improve the compactness of the model learned while maintaining predictive performance, especially in smaller-sample settings including reinforcement learning.

* ICML 2018. v2 -- Minor edits and fixes typos. arXiv admin note: text overlap with arXiv:1705.10388 

   Access Paper Source

Share this with someone who'll enjoy it: