Alert button

InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling

Apr 07, 2023
Xiaobao Wu, Xinshuai Dong, Thong Nguyen, Chaoqun Liu, Liangming Pan, Anh Tuan Luu

Figure 1 for InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling
Figure 2 for InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling
Figure 3 for InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling
Figure 4 for InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling

Share this with someone who'll enjoy it:

Cross-lingual topic models have been prevalent for cross-lingual text analysis by revealing aligned latent topics. However, most existing methods suffer from producing repetitive topics that hinder further analysis and performance decline caused by low-coverage dictionaries. In this paper, we propose the Cross-lingual Topic Modeling with Mutual Information (InfoCTM). Instead of the direct alignment in previous work, we propose a topic alignment with mutual information method. This works as a regularization to properly align topics and prevent degenerate topic representations of words, which mitigates the repetitive topic issue. To address the low-coverage dictionary issue, we further propose a cross-lingual vocabulary linking method that finds more linked cross-lingual words for topic alignment beyond the translations of a given dictionary. Extensive experiments on English, Chinese, and Japanese datasets demonstrate that our method outperforms state-of-the-art baselines, producing more coherent, diverse, and well-aligned topics and showing better transferability for cross-lingual classification tasks.

* Accepted to AAAI2023 conference  
View paper onarxiv icon

Share this with someone who'll enjoy it: