Alert button
Picture for Qiuyuan Huang

Qiuyuan Huang

Alert button

Position Paper: Agent AI Towards a Holistic Intelligence

Add code
Bookmark button
Alert button
Feb 28, 2024
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley Llorens, John Langford, Hoi Vo, Li Fei-Fei, Katsu Ikeuchi, Jianfeng Gao

Viaarxiv icon

An Interactive Agent Foundation Model

Add code
Bookmark button
Alert button
Feb 08, 2024
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley Llorens, Hoi Vo, Katsu Ikeuchi, Li Fei-Fei, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

Figure 1 for An Interactive Agent Foundation Model
Figure 2 for An Interactive Agent Foundation Model
Figure 3 for An Interactive Agent Foundation Model
Figure 4 for An Interactive Agent Foundation Model
Viaarxiv icon

Agent AI: Surveying the Horizons of Multimodal Interaction

Add code
Bookmark button
Alert button
Jan 07, 2024
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong, Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Li Fei-Fei, Jianfeng Gao

Viaarxiv icon

Localized Symbolic Knowledge Distillation for Visual Commonsense Models

Add code
Bookmark button
Alert button
Dec 12, 2023
Jae Sung Park, Jack Hessel, Khyathi Raghavi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Youngjae Yu, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi

Viaarxiv icon

MindAgent: Emergent Gaming Interaction

Add code
Bookmark button
Alert button
Sep 19, 2023
Ran Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-Chun Zhu, Demetri Terzopoulos, Li Fei-Fei, Jianfeng Gao

Figure 1 for MindAgent: Emergent Gaming Interaction
Figure 2 for MindAgent: Emergent Gaming Interaction
Figure 3 for MindAgent: Emergent Gaming Interaction
Figure 4 for MindAgent: Emergent Gaming Interaction
Viaarxiv icon

ArK: Augmented Reality with Knowledge Interactive Emergent Ability

Add code
Bookmark button
Alert button
May 01, 2023
Qiuyuan Huang, Jae Sung Park, Abhinav Gupta, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Figure 1 for ArK: Augmented Reality with Knowledge Interactive Emergent Ability
Figure 2 for ArK: Augmented Reality with Knowledge Interactive Emergent Ability
Figure 3 for ArK: Augmented Reality with Knowledge Interactive Emergent Ability
Figure 4 for ArK: Augmented Reality with Knowledge Interactive Emergent Ability
Viaarxiv icon

Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback

Add code
Bookmark button
Alert button
Mar 08, 2023
Baolin Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao

Figure 1 for Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
Figure 2 for Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
Figure 3 for Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
Figure 4 for Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback
Viaarxiv icon

Training Vision-Language Transformers from Captions Alone

Add code
Bookmark button
Alert button
May 19, 2022
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Figure 1 for Training Vision-Language Transformers from Captions Alone
Figure 2 for Training Vision-Language Transformers from Captions Alone
Figure 3 for Training Vision-Language Transformers from Captions Alone
Figure 4 for Training Vision-Language Transformers from Captions Alone
Viaarxiv icon

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Add code
Bookmark button
Alert button
Dec 16, 2021
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Figure 1 for KAT: A Knowledge Augmented Transformer for Vision-and-Language
Figure 2 for KAT: A Knowledge Augmented Transformer for Vision-and-Language
Figure 3 for KAT: A Knowledge Augmented Transformer for Vision-and-Language
Figure 4 for KAT: A Knowledge Augmented Transformer for Vision-and-Language
Viaarxiv icon

Natural- to formal-language generation using Tensor Product Representations

Add code
Bookmark button
Alert button
Oct 05, 2019
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

Figure 1 for Natural- to formal-language generation using Tensor Product Representations
Figure 2 for Natural- to formal-language generation using Tensor Product Representations
Figure 3 for Natural- to formal-language generation using Tensor Product Representations
Figure 4 for Natural- to formal-language generation using Tensor Product Representations
Viaarxiv icon