Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Why Normalizing Flows Fail to Detect Out-of-Distribution Data

Jun 15, 2020
Polina Kirichenko, Pavel Izmailov, Andrew Gordon Wilson



Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow trained on pictures of clothing assigns higher likelihood to handwritten digits. We investigate why normalizing flows perform poorly for OOD detection. We demonstrate that flows learn local pixel correlations and generic image-to-latent-space transformations which are not specific to the target image dataset. We show that by modifying the architecture of flow coupling layers we can bias the flow towards learning the semantic structure of the target data, improving OOD detection. Our investigation reveals that properties that enable flows to generate high-fidelity images can have a detrimental effect on OOD detection.

* Code is available at https://github.com/PolinaKirichenko/flows_ood 


Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: