Yulan He
2020
Neural Topic Modeling with Bidirectional Adversarial Training
Rui Wang
|
Xuemeng Hu
|
Deyu Zhou
|
Yulan He
|
Yuxuan Xiong
|
Chenchen Ye
|
Haiyang Xu
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Recent years have witnessed a surge of interests of using neural topic models for automatic topic extraction from text, since they avoid the complicated mathematical derivations for model inference as in traditional topic models such as Latent Dirichlet Allocation (LDA). However, these models either typically assume improper prior (e.g. Gaussian or Logistic Normal) over latent topic space or could not infer topic distribution for a given document. To address these limitations, we propose a neural topic modeling approach, called Bidirectional Adversarial Topic (BAT) model, which represents the first attempt of applying bidirectional adversarial training for neural topic modeling. The proposed BAT builds a two-way projection between the document-topic distribution and the document-word distribution. It uses a generator to capture the semantic patterns from texts and an encoder for topic inference. Furthermore, to incorporate word relatedness information, the Bidirectional Adversarial Topic model with Gaussian (Gaussian-BAT) is extended from BAT. To verify the effectiveness of BAT and Gaussian-BAT, three benchmark corpora are used in our experiments. The experimental results show that BAT and Gaussian-BAT obtain more coherent topics, outperforming several competitive baselines. Moreover, when performing text clustering based on the extracted topics, our models outperform all the baselines, with more significant improvements achieved by Gaussian-BAT where an increase of near 6% is observed in accuracy.
Neural Temporal Opinion Modelling for Opinion Prediction on Twitter
Lixing Zhu
|
Yulan He
|
Deyu Zhou
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Opinion prediction on Twitter is challenging due to the transient nature of tweet content and neighbourhood context. In this paper, we model users’ tweet posting behaviour as a temporal point process to jointly predict the posting time and the stance label of the next tweet given a user’s historical tweet sequence and tweets posted by their neighbours. We design a topic-driven attention mechanism to capture the dynamic topic shifts in the neighbourhood context. Experimental results show that the proposed model predicts both the posting time and the stance labels of future tweets more accurately compared to a number of competitive baselines.
Search
Co-authors
- Deyu Zhou 2
- Rui Wang 1
- Xuemeng Hu 1
- Yuxuan Xiong 1
- Chenchen Ye 1
- show all...
Venues
- ACL2