Alert button

Recurrent Estimation of Distributions

May 30, 2017
Junier B. Oliva, Kumar Avinava Dubey, Barnabas Poczos, Eric Xing, Jeff Schneider

Figure 1 for Recurrent Estimation of Distributions
Figure 2 for Recurrent Estimation of Distributions
Figure 3 for Recurrent Estimation of Distributions
Figure 4 for Recurrent Estimation of Distributions

Share this with someone who'll enjoy it:

This paper presents the recurrent estimation of distributions (RED) for modeling real-valued data in a semiparametric fashion. RED models make two novel uses of recurrent neural networks (RNNs) for density estimation of general real-valued data. First, RNNs are used to transform input covariates into a latent space to better capture conditional dependencies in inputs. After, an RNN is used to compute the conditional distributions of the latent covariates. The resulting model is efficient to train, compute, and sample from, whilst producing normalized pdfs. The effectiveness of RED is shown via several real-world data experiments. Our results show that RED models achieve a lower held-out negative log-likelihood than other neural network approaches across multiple dataset sizes and dimensionalities. Further context of the efficacy of RED is provided by considering anomaly detection tasks, where we also observe better performance over alternative models.

View paper onarxiv icon

Share this with someone who'll enjoy it: