Alert button

A Generative Approach to Titling and Clustering Wikipedia Sections

May 22, 2020
Figure 1 for A Generative Approach to Titling and Clustering Wikipedia Sections
Figure 2 for A Generative Approach to Titling and Clustering Wikipedia Sections
Figure 3 for A Generative Approach to Titling and Clustering Wikipedia Sections
Figure 4 for A Generative Approach to Titling and Clustering Wikipedia Sections

Share this with someone who'll enjoy it:

We evaluate the performance of transformer encoders with various decoders for information organization through a new task: generation of section headings for Wikipedia articles. Our analysis shows that decoders containing attention mechanisms over the encoder output achieve high-scoring results by generating extractive text. In contrast, a decoder without attention better facilitates semantic encoding and can be used to generate section embeddings. We additionally introduce a new loss function, which further encourages the decoder to generate high-quality embeddings.

* Accepted to WNGT Workshop at ACL 2020  

Share this with someone who'll enjoy it: