Alert button

L$_0$onie: Compressing COINs with L$_0$-constraints

Jul 08, 2022
Juan Ramirez, Jose Gallego-Posada

Figure 1 for L$_0$onie: Compressing COINs with L$_0$-constraints
Figure 2 for L$_0$onie: Compressing COINs with L$_0$-constraints
Figure 3 for L$_0$onie: Compressing COINs with L$_0$-constraints
Figure 4 for L$_0$onie: Compressing COINs with L$_0$-constraints

Share this with someone who'll enjoy it:

Advances in Implicit Neural Representations (INR) have motivated research on domain-agnostic compression techniques. These methods train a neural network to approximate an object, and then store the weights of the trained model. For example, given an image, a network is trained to learn the mapping from pixel locations to RGB values. In this paper, we propose L$_0$onie, a sparsity-constrained extension of the COIN compression method. Sparsity allows to leverage the faster learning of overparameterized networks, while retaining the desirable compression rate of smaller models. Moreover, our constrained formulation ensures that the final model respects a pre-determined compression rate, dispensing of the need for expensive architecture search.

* Presented at the Sparsity in Neural Networks (SNN) Workshop 2022. Code available at https://github.com/juan43ramirez/l0onie  
View paper onarxiv icon

Share this with someone who'll enjoy it: