Alert button
Picture for Ruslan Salakhutdinov

Ruslan Salakhutdinov

Alert button

OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web

Feb 28, 2024
Raghav Kapoor, Yash Parag Butala, Melisa Russak, Jing Yu Koh, Kiran Kamble, Waseem Alshikh, Ruslan Salakhutdinov

Viaarxiv icon

VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks

Jan 24, 2024
Jing Yu Koh, Robert Lo, Lawrence Jang, Vikram Duvvur, Ming Chong Lim, Po-Yu Huang, Graham Neubig, Shuyan Zhou, Ruslan Salakhutdinov, Daniel Fried

Viaarxiv icon

Manifold Preserving Guided Diffusion

Nov 28, 2023
Yutong He, Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Dongjun Kim, Wei-Hsiang Liao, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov, Stefano Ermon

Viaarxiv icon

MMOE: Mixture of Multimodal Interaction Experts

Nov 16, 2023
Haofei Yu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency

Viaarxiv icon

Contrastive Difference Predictive Coding

Oct 31, 2023
Chongyi Zheng, Ruslan Salakhutdinov, Benjamin Eysenbach

Viaarxiv icon

Multimodal Graph Learning for Generative Tasks

Oct 12, 2023
Minji Yoon, Jing Yu Koh, Bryan Hooi, Ruslan Salakhutdinov

Figure 1 for Multimodal Graph Learning for Generative Tasks
Figure 2 for Multimodal Graph Learning for Generative Tasks
Figure 3 for Multimodal Graph Learning for Generative Tasks
Figure 4 for Multimodal Graph Learning for Generative Tasks
Viaarxiv icon

Confronting Reward Model Overoptimization with Constrained RLHF

Oct 10, 2023
Ted Moskovitz, Aaditya K. Singh, DJ Strouse, Tuomas Sandholm, Ruslan Salakhutdinov, Anca D. Dragan, Stephen McAleer

Viaarxiv icon

Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions

Aug 16, 2023
Haitian Sun, William W. Cohen, Ruslan Salakhutdinov

Figure 1 for Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions
Figure 2 for Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions
Figure 3 for Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions
Figure 4 for Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions
Viaarxiv icon