Alert button
Picture for Ryen W. White

Ryen W. White

Alert button

Taking Search to Task

Jan 12, 2023
Chirag Shah, Ryen W. White, Paul Thomas, Bhaskar Mitra, Shawon Sarkar, Nicholas Belkin

Figure 1 for Taking Search to Task

The importance of tasks in information retrieval (IR) has been long argued for, addressed in different ways, often ignored, and frequently revisited. For decades, scholars made a case for the role that a user's task plays in how and why that user engages in search and what a search system should do to assist. But for the most part, the IR community has been too focused on query processing and assuming a search task to be a collection of user queries, often ignoring if or how such an assumption addresses the users accomplishing their tasks. With emerging areas of conversational agents and proactive IR, understanding and addressing users' tasks has become more important than ever before. In this paper, we provide various perspectives on where the state-of-the-art is with regard to tasks in IR, what are some of the bottlenecks in deriving and using task information, and how do we go forward from here. In addition to covering relevant literature, the paper provides a synthesis of historical and current perspectives on understanding, extracting, and addressing task-focused search. To ground ongoing and future research in this area, we present a new framing device for tasks using a tree-like structure and various moves on that structure that allow different interpretations and applications. Presented as a combination of synthesis of ideas and past works, proposals for future research, and our perspectives on technical, social, and ethical considerations, this paper is meant to help revitalize the interest and future work in task-based IR.

Viaarxiv icon

MS-LaTTE: A Dataset of Where and When To-do Tasks are Completed

Nov 12, 2021
Sujay Kumar Jauhar, Nirupama Chandrasekaran, Michael Gamon, Ryen W. White

Figure 1 for MS-LaTTE: A Dataset of Where and When To-do Tasks are Completed
Figure 2 for MS-LaTTE: A Dataset of Where and When To-do Tasks are Completed
Figure 3 for MS-LaTTE: A Dataset of Where and When To-do Tasks are Completed
Figure 4 for MS-LaTTE: A Dataset of Where and When To-do Tasks are Completed

Tasks are a fundamental unit of work in the daily lives of people, who are increasingly using digital means to keep track of, organize, triage and act on them. These digital tools -- such as task management applications -- provide a unique opportunity to study and understand tasks and their connection to the real world, and through intelligent assistance, help people be more productive. By logging signals such as text, timestamp information, and social connectivity graphs, an increasingly rich and detailed picture of how tasks are created and organized, what makes them important, and who acts on them, can be progressively developed. Yet the context around actual task completion remains fuzzy, due to the basic disconnect between actions taken in the real world and telemetry recorded in the digital world. Thus, in this paper we compile and release a novel, real-life, large-scale dataset called MS-LaTTE that captures two core aspects of the context surrounding task completion: location and time. We describe our annotation framework and conduct a number of analyses on the data that were collected, demonstrating that it captures intuitive contextual properties for common tasks. Finally, we test the dataset on the two problems of predicting spatial and temporal task co-occurrence, concluding that predictors for co-location and co-time are both learnable, with a BERT fine-tuned model outperforming several other baselines. The MS-LaTTE dataset provides an opportunity to tackle many new modeling challenges in contextual task understanding and we hope that its release will spur future research in task intelligence more broadly.

Viaarxiv icon

CoSEM: Contextual and Semantic Embedding for App Usage Prediction

Aug 26, 2021
Yonchanok Khaokaew, Mohammad Saiedur Rahaman, Ryen W. White, Flora D. Salim

Figure 1 for CoSEM: Contextual and Semantic Embedding for App Usage Prediction
Figure 2 for CoSEM: Contextual and Semantic Embedding for App Usage Prediction

App usage prediction is important for smartphone system optimization to enhance user experience. Existing modeling approaches utilize historical app usage logs along with a wide range of semantic information to predict the app usage; however, they are only effective in certain scenarios and cannot be generalized across different situations. This paper address this problem by developing a model called Contextual and Semantic Embedding model for App Usage Prediction (CoSEM) for app usage prediction that leverages integration of 1) semantic information embedding and 2) contextual information embedding based on historical app usage of individuals. Extensive experiments show that the combination of semantic information and history app usage information enables our model to outperform the baselines on three real-world datasets, achieving an MRR score over 0.55,0.57,0.86 and Hit rate scores of more than 0.71, 0.75, and 0.95, respectively.

* 5 pages, short paper in Proceedings of the 30th ACM International Conference on Information and Knowledge Management (CIKM '21) 
Viaarxiv icon

Formation of Social Ties Influences Food Choice: A Campus-Wide Longitudinal Study

Feb 17, 2021
Kristina Gligorić, Ryen W. White, Emre Kıcıman, Eric Horvitz, Arnaud Chiolero, Robert West

Figure 1 for Formation of Social Ties Influences Food Choice: A Campus-Wide Longitudinal Study
Figure 2 for Formation of Social Ties Influences Food Choice: A Campus-Wide Longitudinal Study
Figure 3 for Formation of Social Ties Influences Food Choice: A Campus-Wide Longitudinal Study
Figure 4 for Formation of Social Ties Influences Food Choice: A Campus-Wide Longitudinal Study

Nutrition is a key determinant of long-term health, and social influence has long been theorized to be a key determinant of nutrition. It has been difficult to quantify the postulated role of social influence on nutrition using traditional methods such as surveys, due to the typically small scale and short duration of studies. To overcome these limitations, we leverage a novel source of data: logs of 38 million food purchases made over an 8-year period on the Ecole Polytechnique Federale de Lausanne (EPFL) university campus, linked to anonymized individuals via the smartcards used to make on-campus purchases. In a longitudinal observational study, we ask: How is a person's food choice affected by eating with someone else whose own food choice is healthy vs. unhealthy? To estimate causal effects from the passively observed log data, we control confounds in a matched quasi-experimental design: we identify focal users who at first do not have any regular eating partners but then start eating with a fixed partner regularly, and we match focal users into comparison pairs such that paired users are nearly identical with respect to covariates measured before acquiring the partner, where the two focal users' new eating partners diverge in the healthiness of their respective food choice. A difference-in-differences analysis of the paired data yields clear evidence of social influence: focal users acquiring a healthy-eating partner change their habits significantly more toward healthy foods than focal users acquiring an unhealthy-eating partner. We further identify foods whose purchase frequency is impacted significantly by the eating partner's healthiness of food choice. Beyond the main results, the work demonstrates the utility of passively sensed food purchase logs for deriving insights, with the potential of informing the design of public health interventions and food offerings.

* Proc. ACM Hum.-Comput. Interact.5, CSCW1, Article 184 (April 2021)  
Viaarxiv icon

Optimizing Interactive Systems via Data-Driven Objectives

Jun 19, 2020
Ziming Li, Julia Kiseleva, Alekh Agarwal, Maarten de Rijke, Ryen W. White

Figure 1 for Optimizing Interactive Systems via Data-Driven Objectives
Figure 2 for Optimizing Interactive Systems via Data-Driven Objectives

Effective optimization is essential for real-world interactive systems to provide a satisfactory user experience in response to changing user behavior. However, it is often challenging to find an objective to optimize for interactive systems (e.g., policy learning in task-oriented dialog systems). Generally, such objectives are manually crafted and rarely capture complex user needs in an accurate manner. We propose an approach that infers the objective directly from observed user interactions. These inferences can be made regardless of prior knowledge and across different types of user behavior. We introduce Interactive System Optimizer (ISO), a novel algorithm that uses these inferred objectives for optimization. Our main contribution is a new general principled approach to optimizing interactive systems using data-driven objectives. We demonstrate the high effectiveness of ISO over several simulations.

* 30 pages, 12 figures. arXiv admin note: text overlap with arXiv:1802.06306 
Viaarxiv icon

Conversations with Documents. An Exploration of Document-Centered Assistance

Jan 27, 2020
Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, Ryen W. White

Figure 1 for Conversations with Documents. An Exploration of Document-Centered Assistance
Figure 2 for Conversations with Documents. An Exploration of Document-Centered Assistance
Figure 3 for Conversations with Documents. An Exploration of Document-Centered Assistance
Figure 4 for Conversations with Documents. An Exploration of Document-Centered Assistance

The role of conversational assistants has become more prevalent in helping people increase their productivity. Document-centered assistance, for example to help an individual quickly review a document, has seen less significant progress, even though it has the potential to tremendously increase a user's productivity. This type of document-centered assistance is the focus of this paper. Our contributions are three-fold: (1) We first present a survey to understand the space of document-centered assistance and the capabilities people expect in this scenario. (2) We investigate the types of queries that users will pose while seeking assistance with documents, and show that document-centered questions form the majority of these queries. (3) We present a set of initial machine learned models that show that (a) we can accurately detect document-centered questions, and (b) we can build reasonably accurate models for answering such questions. These positive results are encouraging, and suggest that even greater results may be attained with continued study of this interesting and novel problem space. Our findings have implications for the design of intelligent systems to support task completion via natural interactions with documents.

* Accepted as full paper at CHIIR 2020; 9 pages + Appendix 
Viaarxiv icon