Reinforcement Learning for Online Information Seeking

Information seeking techniques, satisfying users' information needs by suggesting users' personalized objects (information or services) at the appropriate time and place, play a crucial role in mitigating the information overload problem on the Web. With recent great advances in Reinforcement Learning (RL), there have been increasing interests in developing RL based information seeking techniques. These RL based techniques have two key advantages -- (1) they are able to continuously update information seeking strategies according to users' real-time feedback, and (2) they can maximize the expected cumulative long-term reward from users where reward has different definitions according to information seeking applications such as click-through rate, revenue, user satisfaction and engagement. In this survey, we give an overview about reinforcement learning for information seeking on the web from methodologies to applications, review representative algorithms, and discuss some appealing research directions.