Alert button

Critical initialization of wide and deep neural networks through partial Jacobians: general theory and applications to LayerNorm

Nov 23, 2021
Darshil Doshi, Tianyu He, Andrey Gromov

Figure 1 for Critical initialization of wide and deep neural networks through partial Jacobians: general theory and applications to LayerNorm
Figure 2 for Critical initialization of wide and deep neural networks through partial Jacobians: general theory and applications to LayerNorm
Figure 3 for Critical initialization of wide and deep neural networks through partial Jacobians: general theory and applications to LayerNorm
Figure 4 for Critical initialization of wide and deep neural networks through partial Jacobians: general theory and applications to LayerNorm

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: