Alert button

Mutual Information Decay Curves and Hyper-Parameter Grid Search Design for Recurrent Neural Architectures

Add code
Alert button
Dec 08, 2020
Abhijit Mahalunkar, John D. Kelleher
Figure 1 for Mutual Information Decay Curves and Hyper-Parameter Grid Search Design for Recurrent Neural Architectures
Figure 2 for Mutual Information Decay Curves and Hyper-Parameter Grid Search Design for Recurrent Neural Architectures
Figure 3 for Mutual Information Decay Curves and Hyper-Parameter Grid Search Design for Recurrent Neural Architectures
Figure 4 for Mutual Information Decay Curves and Hyper-Parameter Grid Search Design for Recurrent Neural Architectures

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

We present an approach to design the grid searches for hyper-parameter optimization for recurrent neural architectures. The basis for this approach is the use of mutual information to analyze long distance dependencies (LDDs) within a dataset. We also report a set of experiments that demonstrate how using this approach, we obtain state-of-the-art results for DilatedRNNs across a range of benchmark datasets.

* Published at the 27th International Conference on Neural Information Processing, ICONIP 2020, Bangkok, Thailand, November 18-22, 2020. arXiv admin note: text overlap with arXiv:1810.02966  
Access Paper Source

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon