Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Louis-Philippe Morency

Louis-Philippe Morency

Self-supervised Representation Learning with Relative Predictive Coding


Mar 28, 2021
Yao-Hung Hubert Tsai, Martin Q. Ma, Muqiao Yang, Han Zhao, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Self-supervised Representation Learning with Relative Predictive Coding
Figure 2 for Self-supervised Representation Learning with Relative Predictive Coding
Figure 3 for Self-supervised Representation Learning with Relative Predictive Coding
Figure 4 for Self-supervised Representation Learning with Relative Predictive Coding

  Access Paper or Ask Questions

Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition


Jan 22, 2021
Peter Wu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition
Figure 2 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition
Figure 3 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition
Figure 4 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition

  Access Paper or Ask Questions

StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations


Jan 03, 2021
Amir Zadeh, Santiago Benoit, Louis-Philippe Morency

Figure 1 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
Figure 2 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
Figure 3 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
Figure 4 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
* Work in progress at CMU 
  Access Paper or Ask Questions

Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment


Dec 04, 2020
Paul Pu Liang, Peter Wu, Liu Ziyin, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Figure 2 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Figure 3 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Figure 4 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment

  Access Paper or Ask Questions

Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study


Dec 04, 2020
Terrance Liu, Paul Pu Liang, Michal Muszynski, Ryo Ishii, David Brent, Randy Auerbach, Nicholas Allen, Louis-Philippe Morency

Figure 1 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
Figure 2 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
Figure 3 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
Figure 4 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study

  Access Paper or Ask Questions

Unsupervised Domain Adaptation for Visual Navigation


Nov 12, 2020
Shangda Li, Devendra Singh Chaplot, Yao-Hung Hubert Tsai, Yue Wu, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Unsupervised Domain Adaptation for Visual Navigation
Figure 2 for Unsupervised Domain Adaptation for Visual Navigation
Figure 3 for Unsupervised Domain Adaptation for Visual Navigation
Figure 4 for Unsupervised Domain Adaptation for Visual Navigation
* Deep Reinforcement Learning Workshop at NeurIPS 2020. Camera Ready Version 
  Access Paper or Ask Questions

MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences


Oct 22, 2020
Jianing Yang, Yongxin Wang, Ruitao Yi, Yuying Zhu, Azaan Rehman, Amir Zadeh, Soujanya Poria, Louis-Philippe Morency

Figure 1 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Figure 2 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Figure 3 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Figure 4 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences

  Access Paper or Ask Questions

Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach


Jul 24, 2020
Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano, Louis-Philippe Morency

Figure 1 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
Figure 2 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
Figure 3 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
Figure 4 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
* European Conference on Computer Vision 2020 
 * 24 pages, 12 figures 
  Access Paper or Ask Questions

Towards Debiasing Sentence Representations


Jul 16, 2020
Paul Pu Liang, Irene Mengze Li, Emily Zheng, Yao Chong Lim, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Towards Debiasing Sentence Representations
Figure 2 for Towards Debiasing Sentence Representations
Figure 3 for Towards Debiasing Sentence Representations
Figure 4 for Towards Debiasing Sentence Representations
* ACL 2020, code available at https://github.com/pliang279/sent_debias 
  Access Paper or Ask Questions

What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets


Jul 07, 2020
Jianing Yang, Yuying Zhu, Yongxin Wang, Ruitao Yi, Amir Zadeh, Louis-Philippe Morency

Figure 1 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
Figure 2 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
Figure 3 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
Figure 4 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets

  Access Paper or Ask Questions

Neural Methods for Point-wise Dependency Estimation


Jun 11, 2020
Yao-Hung Hubert Tsai, Han Zhao, Makoto Yamada, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Neural Methods for Point-wise Dependency Estimation
Figure 2 for Neural Methods for Point-wise Dependency Estimation
Figure 3 for Neural Methods for Point-wise Dependency Estimation
Figure 4 for Neural Methods for Point-wise Dependency Estimation

  Access Paper or Ask Questions

Demystifying Self-Supervised Learning: An Information-Theoretical Framework


Jun 11, 2020
Yao-Hung Hubert Tsai, Yue Wu, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Figure 2 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Figure 3 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Figure 4 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework

  Access Paper or Ask Questions

Improving Aspect-Level Sentiment Analysis with Aspect Extraction


May 03, 2020
Navonil Majumder, Rishabh Bhardwaj, Soujanya Poria, Amir Zadeh, Alexander Gelbukh, Amir Hussain, Louis-Philippe Morency

Figure 1 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Figure 2 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Figure 3 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Figure 4 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction

  Access Paper or Ask Questions

Interpretable Multimodal Routing for Human Multimodal Language


Apr 29, 2020
Yao-Hung Hubert Tsai, Martin Q. Ma, Muqiao Yang, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Interpretable Multimodal Routing for Human Multimodal Language
Figure 2 for Interpretable Multimodal Routing for Human Multimodal Language
Figure 3 for Interpretable Multimodal Routing for Human Multimodal Language
Figure 4 for Interpretable Multimodal Routing for Human Multimodal Language

  Access Paper or Ask Questions

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding


Apr 03, 2020
Seong Hyeon Park, Gyubok Lee, Manoj Bhat, Jimin Seo, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency

Figure 1 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding
Figure 2 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding
Figure 3 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding
Figure 4 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

  Access Paper or Ask Questions

On Emergent Communication in Competitive Multi-Agent Teams


Mar 04, 2020
Paul Pu Liang, Jeffrey Chen, Ruslan Salakhutdinov, Louis-Philippe Morency, Satwik Kottur

Figure 1 for On Emergent Communication in Competitive Multi-Agent Teams
Figure 2 for On Emergent Communication in Competitive Multi-Agent Teams
Figure 3 for On Emergent Communication in Competitive Multi-Agent Teams
Figure 4 for On Emergent Communication in Competitive Multi-Agent Teams
* AAMAS 2020 
  Access Paper or Ask Questions

Learning Not to Learn in the Presence of Noisy Labels


Feb 16, 2020
Liu Ziyin, Blair Chen, Ru Wang, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency, Masahito Ueda

Figure 1 for Learning Not to Learn in the Presence of Noisy Labels
Figure 2 for Learning Not to Learn in the Presence of Noisy Labels
Figure 3 for Learning Not to Learn in the Presence of Noisy Labels
Figure 4 for Learning Not to Learn in the Presence of Noisy Labels

  Access Paper or Ask Questions

Think Locally, Act Globally: Federated Learning with Local and Global Representations


Jan 06, 2020
Paul Pu Liang, Terrance Liu, Liu Ziyin, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
Figure 2 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
Figure 3 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
Figure 4 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
* Workshop on Federated Learning for Data Privacy and Confidentiality, NeurIPS 2019, Vancouver, Canada 
  Access Paper or Ask Questions

Context-Dependent Models for Predicting and Characterizing Facial Expressiveness


Dec 10, 2019
Victoria Lin, Jeffrey M. Girard, Louis-Philippe Morency

Figure 1 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness
Figure 2 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness
Figure 3 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness
Figure 4 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness

  Access Paper or Ask Questions

Factorized Multimodal Transformer for Multimodal Sequential Learning


Nov 22, 2019
Amir Zadeh, Chengfeng Mao, Kelly Shi, Yiwei Zhang, Paul Pu Liang, Soujanya Poria, Louis-Philippe Morency


  Access Paper or Ask Questions

WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation


Nov 21, 2019
Amir Zadeh, Tianjun Ma, Soujanya Poria, Louis-Philippe Morency

Figure 1 for WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation
Figure 2 for WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation
Figure 3 for WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation
Figure 4 for WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separation

  Access Paper or Ask Questions

To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations


Oct 05, 2019
Chaitanya Ahuja, Shugao Ma, Louis-Philippe Morency, Yaser Sheikh

Figure 1 for To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations
Figure 2 for To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations
Figure 3 for To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations
Figure 4 for To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations

  Access Paper or Ask Questions

Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel


Aug 30, 2019
Yao-Hung Hubert Tsai, Shaojie Bai, Makoto Yamada, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel
Figure 2 for Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel
Figure 3 for Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel
Figure 4 for Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel
* EMNLP 2019 
  Access Paper or Ask Questions

M-BERT: Injecting Multimodal Information in the BERT Structure


Aug 15, 2019
Wasifur Rahman, Md Kamrul Hasan, Amir Zadeh, Louis-Philippe Morency, Mohammed Ehsan Hoque

Figure 1 for M-BERT: Injecting Multimodal Information in the BERT Structure
Figure 2 for M-BERT: Injecting Multimodal Information in the BERT Structure

  Access Paper or Ask Questions

Language2Pose: Natural Language Grounded Pose Forecasting


Jul 02, 2019
Chaitanya Ahuja, Louis-Philippe Morency

Figure 1 for Language2Pose: Natural Language Grounded Pose Forecasting
Figure 2 for Language2Pose: Natural Language Grounded Pose Forecasting
Figure 3 for Language2Pose: Natural Language Grounded Pose Forecasting
Figure 4 for Language2Pose: Natural Language Grounded Pose Forecasting

  Access Paper or Ask Questions

Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization


Jul 01, 2019
Paul Pu Liang, Zhun Liu, Yao-Hung Hubert Tsai, Qibin Zhao, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization
Figure 2 for Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization
Figure 3 for Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization

  Access Paper or Ask Questions

Deep Gamblers: Learning to Abstain with Portfolio Theory


Jun 29, 2019
Liu Ziyin, Zhikang Wang, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency, Masahito Ueda

Figure 1 for Deep Gamblers: Learning to Abstain with Portfolio Theory
Figure 2 for Deep Gamblers: Learning to Abstain with Portfolio Theory
Figure 3 for Deep Gamblers: Learning to Abstain with Portfolio Theory
Figure 4 for Deep Gamblers: Learning to Abstain with Portfolio Theory

  Access Paper or Ask Questions

Multimodal Transformer for Unaligned Multimodal Language Sequences


Jun 01, 2019
Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, J. Zico Kolter, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Multimodal Transformer for Unaligned Multimodal Language Sequences
Figure 2 for Multimodal Transformer for Unaligned Multimodal Language Sequences
Figure 3 for Multimodal Transformer for Unaligned Multimodal Language Sequences
Figure 4 for Multimodal Transformer for Unaligned Multimodal Language Sequences

  Access Paper or Ask Questions