Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

VIABLE: Fast Adaptation via Backpropagating Learned Loss

Nov 29, 2019
Leo Feng, Luisa Zintgraf, Bei Peng, Shimon Whiteson

Share this with someone who'll enjoy it:

In few-shot learning, typically, the loss function which is applied at test time is the one we are ultimately interested in minimising, such as the mean-squared-error loss for a regression problem. However, given that we have few samples at test time, we argue that the loss function that we are interested in minimising is not necessarily the loss function most suitable for computing gradients in a few-shot setting. We propose VIABLE, a generic meta-learning extension that builds on existing meta-gradient-based methods by learning a differentiable loss function, replacing the pre-defined inner-loop loss function in performing task-specific updates. We show that learning a loss function capable of leveraging relational information between samples reduces underfitting, and significantly improves performance and sample efficiency on a simple regression task. Furthermore, we show VIABLE is scalable by evaluating on the Mini-Imagenet dataset.

* Published at the 3rd Workshop on Meta-Learning at NeurIPS 2019 

   Access Paper Source

Share this with someone who'll enjoy it: