Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Layer Flexible Adaptive Computational Time for Recurrent Neural Networks

Dec 06, 2018
Lida Zhang, Diego Klabjan

Deep recurrent neural networks show significant benefits in prediction tasks, but a universal problem is deciding the number of layers for the network, especially considering the different computation requests for tasks of different difficulties. We propose a layer flexible recurrent neural network with adaptive computational time, and expand it to sequence to sequence model with teacher-forcing based input policies. The model applies the attention mechanism on all the computation rounds in each step to structure a transmission state for each layer individually in the next step. We evaluate the model on the problem of tick prices prediction. Experimental results show the performance improvement and indicate the model's ability to dynamically change the number of layers.

Share this with someone who'll enjoy it:

   Access Paper Source

Share this with someone who'll enjoy it: