Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox


Scaling Gaussian Process Regression with Derivatives

Oct 29, 2018
David Eriksson, Kun Dong, Eric Hans Lee, David Bindel, Andrew Gordon Wilson


Share this with someone who'll enjoy it:


Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at $n$ points in $d$ dimensions requires linear solves and log determinants with an ${n(d+1) \times n(d+1)}$ positive definite matrix -- leading to prohibitive $\mathcal{O}(n^3d^3)$ computations for standard direct methods. We propose iterative solvers using fast $\mathcal{O}(nd)$ matrix-vector multiplications (MVMs), together with pivoted Cholesky preconditioning that cuts the iterations to convergence by several orders of magnitude, allowing for fast kernel learning and prediction. Our approaches, together with dimensionality reduction, enables Bayesian optimization with derivatives to scale to high-dimensional problems and large evaluation budgets.

* Advances in Neural Information Processing Systems 32 (NIPS), 2018 
* Appears at Advances in Neural Information Processing Systems 32 (NIPS), 2018 


   Access Paper Source



Share this with someone who'll enjoy it: