Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Stefan Lee

Improving Multilingual Translation by Representation and Gradient Regularization


Sep 10, 2021
Yilin Yang, Akiko Eriguchi, Alexandre Muzio, Prasad Tadepalli, Stefan Lee, Hany Hassan

* EMNLP 2021 (Long) 

  Access Paper or Ask Questions

Piecewise-constant Neural ODEs


Jun 11, 2021
Sam Greydanus, Stefan Lee, Alan Fern

* 8 pages, 5 figures (not counting appendix) 

  Access Paper or Ask Questions

Deep Convolution for Irregularly Sampled Temporal Point Clouds


May 01, 2021
Erich Merrill, Stefan Lee, Li Fuxin, Thomas G. Dietterich, Alan Fern

* 12 pages, submitted to ICLR 2021 

  Access Paper or Ask Questions

Where Are You? Localization from Embodied Dialog


Nov 16, 2020
Meera Hahn, Jacob Krantz, Dhruv Batra, Devi Parikh, James M. Rehg, Stefan Lee, Peter Anderson

* EMNLP 2020 

  Access Paper or Ask Questions

Sim-to-Real Transfer for Vision-and-Language Navigation


Nov 07, 2020
Peter Anderson, Ayush Shrivastava, Joanne Truong, Arjun Majumdar, Devi Parikh, Dhruv Batra, Stefan Lee

* CoRL 2020 

  Access Paper or Ask Questions

Language-Conditioned Imitation Learning for Robot Manipulation Tasks


Oct 22, 2020
Simon Stepputtis, Joseph Campbell, Mariano Phielipp, Stefan Lee, Chitta Baral, Heni Ben Amor

* Accepted to the 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada as spotlight presentation 

  Access Paper or Ask Questions

DeepAveragers: Offline Reinforcement Learning by Solving Derived Non-Parametric MDPs


Oct 18, 2020
Aayam Shrestha, Stefan Lee, Prasad Tadepalli, Alan Fern

* Preprint. Under review at ICLR 2021 

  Access Paper or Ask Questions

On the Sub-Layer Functionalities of Transformer Decoder


Oct 06, 2020
Yilin Yang, Longyue Wang, Shuming Shi, Prasad Tadepalli, Stefan Lee, Zhaopeng Tu

* Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (Long) 

  Access Paper or Ask Questions

Semantic MapNet: Building Allocentric SemanticMaps and Representations from Egocentric Views


Oct 02, 2020
Vincent Cartillier, Zhile Ren, Neha Jain, Stefan Lee, Irfan Essa, Dhruv Batra


  Access Paper or Ask Questions

Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents


Sep 07, 2020
Samyak Datta, Oleksandr Maksymets, Judy Hoffman, Stefan Lee, Dhruv Batra, Devi Parikh


  Access Paper or Ask Questions

Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data


Jul 24, 2020
Michael Cogswell, Jiasen Lu, Rishabh Jain, Stefan Lee, Devi Parikh, Dhruv Batra

* 19 pages, 8 figures 

  Access Paper or Ask Questions

Improving Vision-and-Language Navigation with Image-Text Pairs from the Web


May 01, 2020
Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson, Devi Parikh, Dhruv Batra


  Access Paper or Ask Questions

Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments


Apr 06, 2020
Jacob Krantz, Erik Wijmans, Arjun Majumdar, Dhruv Batra, Stefan Lee


  Access Paper or Ask Questions

Are We Making Real Progress in Simulated Environments? Measuring the Sim2Real Gap in Embodied Visual Navigation


Dec 13, 2019
Abhishek Kadian, Joanne Truong, Aaron Gokaslan, Alexander Clegg, Erik Wijmans, Stefan Lee, Manolis Savva, Sonia Chernova, Dhruv Batra


  Access Paper or Ask Questions

12-in-1: Multi-Task Vision and Language Representation Learning


Dec 05, 2019
Jiasen Lu, Vedanuj Goswami, Marcus Rohrbach, Devi Parikh, Stefan Lee

* Jiasen Lu and Vedanuj Goswami contributed equally to this work 

  Access Paper or Ask Questions

Question-Conditioned Counterfactual Image Generation for VQA


Nov 14, 2019
Jingjing Pan, Yash Goyal, Stefan Lee

* Accepted by the VQA Workshop at CVPR 2019 

  Access Paper or Ask Questions

Decentralized Distributed PPO: Solving PointGoal Navigation


Nov 01, 2019
Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee, Irfan Essa, Devi Parikh, Manolis Savva, Dhruv Batra


  Access Paper or Ask Questions

Sunny and Dark Outside?! Improving Answer Consistency in VQA through Entailed Question Generation


Sep 10, 2019
Arijit Ray, Karan Sikka, Ajay Divakaran, Stefan Lee, Giedrius Burachas

* 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP 2019) 

  Access Paper or Ask Questions

ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks


Aug 06, 2019
Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee

* 11 pages, 5 figures 

  Access Paper or Ask Questions

Chasing Ghosts: Instruction Following as Bayesian State Tracking


Jul 03, 2019
Peter Anderson, Ayush Shrivastava, Devi Parikh, Dhruv Batra, Stefan Lee


  Access Paper or Ask Questions

Emergence of Compositional Language with Deep Generational Transmission


Apr 19, 2019
Michael Cogswell, Jiasen Lu, Stefan Lee, Devi Parikh, Dhruv Batra


  Access Paper or Ask Questions

Counterfactual Visual Explanations


Apr 16, 2019
Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, Stefan Lee


  Access Paper or Ask Questions

Embodied Question Answering in Photorealistic Environments with Point Cloud Perception


Apr 06, 2019
Erik Wijmans, Samyak Datta, Oleksandr Maksymets, Abhishek Das, Georgia Gkioxari, Stefan Lee, Irfan Essa, Devi Parikh, Dhruv Batra


  Access Paper or Ask Questions

Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering


Feb 21, 2019
Ramakrishna Vedantam, Karan Desai, Stefan Lee, Marcus Rohrbach, Dhruv Batra, Devi Parikh

* 15 pages, 3 figures, 2 tables 

  Access Paper or Ask Questions

Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded


Feb 11, 2019
Ramprasaath R. Selvaraju, Stefan Lee, Yilin Shen, Hongxia Jin, Dhruv Batra, Devi Parikh

* 13 pages 8 figures 

  Access Paper or Ask Questions

EvalAI: Towards Better Evaluation Systems for AI Agents


Feb 10, 2019
Deshraj Yadav, Rishabh Jain, Harsh Agrawal, Prithvijit Chattopadhyay, Taranjeet Singh, Akash Jain, Shiv Baran Singh, Stefan Lee, Dhruv Batra


  Access Paper or Ask Questions

Audio-Visual Scene-Aware Dialog


Jan 25, 2019
Huda Alamri, Vincent Cartillier, Abhishek Das, Jue Wang, Stefan Lee, Peter Anderson, Irfan Essa, Devi Parikh, Dhruv Batra, Anoop Cherian, Tim K. Marks, Chiori Hori


  Access Paper or Ask Questions

nocaps: novel object captioning at scale


Dec 20, 2018
Harsh Agrawal, Karan Desai, Xinlei Chen, Rishabh Jain, Dhruv Batra, Devi Parikh, Stefan Lee, Peter Anderson


  Access Paper or Ask Questions

Neural Modular Control for Embodied Question Answering


Oct 26, 2018
Abhishek Das, Georgia Gkioxari, Stefan Lee, Devi Parikh, Dhruv Batra

* 10 pages, 3 figures, 2 tables. Published at CoRL 2018. Webpage: https://embodiedqa.org/ 

  Access Paper or Ask Questions