Blind Descent: A Prequel to Gradient Descent

Add code
Jun 20, 2020
Akshat Gupta, Prasad N R
Figure 1 for Blind Descent: A Prequel to Gradient Descent
Figure 2 for Blind Descent: A Prequel to Gradient Descent
Figure 3 for Blind Descent: A Prequel to Gradient Descent
Figure 4 for Blind Descent: A Prequel to Gradient Descent

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

We describe an alternative to gradient descent for backpropogation through a neural network, which we call Blind Descent. We believe that Blind Descent can be used to augment backpropagation by using it as an initialisation method and can also be used at saturation. Blind Descent, inherently by design, does not face problems like exploding or vanishing gradients.

* We have discovered a new learning method which does random optimisation and solves the problem of initialisation for backpropagation in global optimisation. However, we also pose open questions that we discovered while performing experiments  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon