Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations

Jan 03, 2021
Amir Zadeh, Santiago Benoit, Louis-Philippe Morency

Share this with someone who'll enjoy it:

In this paper we present an approach for training deep generative models solely based on solving determined systems of linear equations. A network that uses this approach, called a StarNet, has the following desirable properties: 1) training requires no gradient as solution to the system of linear equations is not stochastic, 2) is highly scalable when solving the system of linear equations w.r.t the latent codes, and similarly for the parameters of the model, and 3) it gives desirable least-square bounds for the estimation of latent codes and network parameters within each layer.

* Work in progress at CMU 

   Access Paper Source

Share this with someone who'll enjoy it: