Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
Where Are You? Localization from Embodied Dialog

Nov 16, 2020
Meera Hahn, Jacob Krantz, Dhruv Batra, Devi Parikh, James M. Rehg, Stefan Lee, Peter Anderson

* EMNLP 2020 

  Access Paper or Ask Questions

Sim-to-Real Transfer for Vision-and-Language Navigation

Nov 07, 2020
Peter Anderson, Ayush Shrivastava, Joanne Truong, Arjun Majumdar, Devi Parikh, Dhruv Batra, Stefan Lee

* CoRL 2020 

  Access Paper or Ask Questions

Language-Conditioned Imitation Learning for Robot Manipulation Tasks

Oct 22, 2020
Simon Stepputtis, Joseph Campbell, Mariano Phielipp, Stefan Lee, Chitta Baral, Heni Ben Amor

* Accepted to the 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada as spotlight presentation 

  Access Paper or Ask Questions

DeepAveragers: Offline Reinforcement Learning by Solving Derived Non-Parametric MDPs

Oct 18, 2020
Aayam Shrestha, Stefan Lee, Prasad Tadepalli, Alan Fern

* Preprint. Under review at ICLR 2021 

  Access Paper or Ask Questions

On the Sub-Layer Functionalities of Transformer Decoder

Oct 06, 2020
Yilin Yang, Longyue Wang, Shuming Shi, Prasad Tadepalli, Stefan Lee, Zhaopeng Tu

* Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (Long) 

  Access Paper or Ask Questions

Semantic MapNet: Building Allocentric SemanticMaps and Representations from Egocentric Views

Oct 02, 2020
Vincent Cartillier, Zhile Ren, Neha Jain, Stefan Lee, Irfan Essa, Dhruv Batra


  Access Paper or Ask Questions

Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents

Sep 07, 2020
Samyak Datta, Oleksandr Maksymets, Judy Hoffman, Stefan Lee, Dhruv Batra, Devi Parikh


  Access Paper or Ask Questions

Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data

Jul 24, 2020
Michael Cogswell, Jiasen Lu, Rishabh Jain, Stefan Lee, Devi Parikh, Dhruv Batra

* 19 pages, 8 figures 

  Access Paper or Ask Questions

Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

May 01, 2020
Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson, Devi Parikh, Dhruv Batra


  Access Paper or Ask Questions

Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments

Apr 06, 2020
Jacob Krantz, Erik Wijmans, Arjun Majumdar, Dhruv Batra, Stefan Lee


  Access Paper or Ask Questions

Are We Making Real Progress in Simulated Environments? Measuring the Sim2Real Gap in Embodied Visual Navigation

Dec 13, 2019
Abhishek Kadian, Joanne Truong, Aaron Gokaslan, Alexander Clegg, Erik Wijmans, Stefan Lee, Manolis Savva, Sonia Chernova, Dhruv Batra


  Access Paper or Ask Questions

12-in-1: Multi-Task Vision and Language Representation Learning

Dec 05, 2019
Jiasen Lu, Vedanuj Goswami, Marcus Rohrbach, Devi Parikh, Stefan Lee

* Jiasen Lu and Vedanuj Goswami contributed equally to this work 

  Access Paper or Ask Questions

Question-Conditioned Counterfactual Image Generation for VQA

Nov 14, 2019
Jingjing Pan, Yash Goyal, Stefan Lee

* Accepted by the VQA Workshop at CVPR 2019 

  Access Paper or Ask Questions

Decentralized Distributed PPO: Solving PointGoal Navigation

Nov 01, 2019
Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee, Irfan Essa, Devi Parikh, Manolis Savva, Dhruv Batra


  Access Paper or Ask Questions

Sunny and Dark Outside?! Improving Answer Consistency in VQA through Entailed Question Generation

Sep 10, 2019
Arijit Ray, Karan Sikka, Ajay Divakaran, Stefan Lee, Giedrius Burachas

* 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP 2019) 

  Access Paper or Ask Questions

ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

Aug 06, 2019
Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee

* 11 pages, 5 figures 

  Access Paper or Ask Questions

Chasing Ghosts: Instruction Following as Bayesian State Tracking

Jul 03, 2019
Peter Anderson, Ayush Shrivastava, Devi Parikh, Dhruv Batra, Stefan Lee


  Access Paper or Ask Questions

Emergence of Compositional Language with Deep Generational Transmission

Apr 19, 2019
Michael Cogswell, Jiasen Lu, Stefan Lee, Devi Parikh, Dhruv Batra


  Access Paper or Ask Questions

Counterfactual Visual Explanations

Apr 16, 2019
Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, Stefan Lee


  Access Paper or Ask Questions

Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

Apr 06, 2019
Erik Wijmans, Samyak Datta, Oleksandr Maksymets, Abhishek Das, Georgia Gkioxari, Stefan Lee, Irfan Essa, Devi Parikh, Dhruv Batra


  Access Paper or Ask Questions

Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering

Feb 21, 2019
Ramakrishna Vedantam, Karan Desai, Stefan Lee, Marcus Rohrbach, Dhruv Batra, Devi Parikh

* 15 pages, 3 figures, 2 tables 

  Access Paper or Ask Questions

Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded

Feb 11, 2019
Ramprasaath R. Selvaraju, Stefan Lee, Yilin Shen, Hongxia Jin, Dhruv Batra, Devi Parikh

* 13 pages 8 figures 

  Access Paper or Ask Questions

EvalAI: Towards Better Evaluation Systems for AI Agents

Feb 10, 2019
Deshraj Yadav, Rishabh Jain, Harsh Agrawal, Prithvijit Chattopadhyay, Taranjeet Singh, Akash Jain, Shiv Baran Singh, Stefan Lee, Dhruv Batra


  Access Paper or Ask Questions

Audio-Visual Scene-Aware Dialog

Jan 25, 2019
Huda Alamri, Vincent Cartillier, Abhishek Das, Jue Wang, Stefan Lee, Peter Anderson, Irfan Essa, Devi Parikh, Dhruv Batra, Anoop Cherian, Tim K. Marks, Chiori Hori


  Access Paper or Ask Questions

nocaps: novel object captioning at scale

Dec 20, 2018
Harsh Agrawal, Karan Desai, Xinlei Chen, Rishabh Jain, Dhruv Batra, Devi Parikh, Stefan Lee, Peter Anderson


  Access Paper or Ask Questions

Neural Modular Control for Embodied Question Answering

Oct 26, 2018
Abhishek Das, Georgia Gkioxari, Stefan Lee, Devi Parikh, Dhruv Batra

* 10 pages, 3 figures, 2 tables. Published at CoRL 2018. Webpage: https://embodiedqa.org/ 

  Access Paper or Ask Questions

Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models

Oct 22, 2018
Ashwin K Vijayakumar, Michael Cogswell, Ramprasath R. Selvaraju, Qing Sun, Stefan Lee, David Crandall, Dhruv Batra

* 16 pages; accepted at AAAI 2018 

  Access Paper or Ask Questions

Overcoming Language Priors in Visual Question Answering with Adversarial Regularization

Oct 08, 2018
Sainandan Ramakrishnan, Aishwarya Agrawal, Stefan Lee

* NIPS 2018. 11 pages ( with references ), 4 figures, 2 tables 

  Access Paper or Ask Questions

Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition

Oct 01, 2018
Jianwei Yang, Jiasen Lu, Stefan Lee, Dhruv Batra, Devi Parikh

* 18 pages, 10 figures, Oral Presentation in Conference on Robot Learning (CoRL) 2018 

  Access Paper or Ask Questions