Alert button

Meta Policy Learning for Cold-Start Conversational Recommendation

May 24, 2022
Zhendong Chu, Hongning Wang, Yun Xiao, Bo Long, Lingfei Wu

Figure 1 for Meta Policy Learning for Cold-Start Conversational Recommendation
Figure 2 for Meta Policy Learning for Cold-Start Conversational Recommendation
Figure 3 for Meta Policy Learning for Cold-Start Conversational Recommendation
Figure 4 for Meta Policy Learning for Cold-Start Conversational Recommendation

Share this with someone who'll enjoy it:

Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions employ reinforcement learning methods to train a single policy for a population of users. However, for users new to the system, such a global policy becomes ineffective to produce conversational recommendations, i.e., the cold-start challenge. In this paper, we study CRS policy learning for cold-start users via meta reinforcement learning. We propose to learn a meta policy and adapt it to new users with only a few trials of conversational recommendations. To facilitate policy adaptation, we design three synergetic components. First is a meta-exploration policy dedicated to identify user preferences via exploratory conversations. Second is a Transformer-based state encoder to model a user's both positive and negative feedback during the conversation. And third is an adaptive item recommender based on the embedded states. Extensive experiments on three datasets demonstrate the advantage of our solution in serving new users, compared with a rich set of state-of-the-art CRS solutions.

* 22 pages  
View paper onarxiv icon

Share this with someone who'll enjoy it: