Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Louis-Philippe Morency

Louis-Philippe Morency

MultiBench: Multiscale Benchmarks for Multimodal Representation Learning


Jul 15, 2021
Paul Pu Liang, Yiwei Lyu, Xiang Fan, Zetian Wu, Yun Cheng, Jason Wu, Leslie Chen, Peter Wu, Michelle A. Lee, Yuke Zhu, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
Figure 2 for MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
* Code: https://github.com/pliang279/MultiBench and Website: https://cmu-multicomp-lab.github.io/multibench/ 
  Access Paper or Ask Questions

Towards Understanding and Mitigating Social Biases in Language Models


Jun 24, 2021
Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Towards Understanding and Mitigating Social Biases in Language Models
Figure 2 for Towards Understanding and Mitigating Social Biases in Language Models
Figure 3 for Towards Understanding and Mitigating Social Biases in Language Models
Figure 4 for Towards Understanding and Mitigating Social Biases in Language Models
* ICML 2021, code available at https://github.com/pliang279/LM_bias 
  Access Paper or Ask Questions

Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data


Jun 24, 2021
Paul Pu Liang, Terrance Liu, Anna Cai, Michal Muszynski, Ryo Ishii, Nicholas Allen, Randy Auerbach, David Brent, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data
Figure 2 for Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data
Figure 3 for Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data
Figure 4 for Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data
* ACL 2021. arXiv admin note: substantial text overlap with arXiv:2012.02359 
  Access Paper or Ask Questions

Integrating Auxiliary Information in Self-supervised Learning


Jun 05, 2021
Yao-Hung Hubert Tsai, Tianqin Li, Weixin Liu, Peiyuan Liao, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Integrating Auxiliary Information in Self-supervised Learning
Figure 2 for Integrating Auxiliary Information in Self-supervised Learning
Figure 3 for Integrating Auxiliary Information in Self-supervised Learning
Figure 4 for Integrating Auxiliary Information in Self-supervised Learning

  Access Paper or Ask Questions

Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations


Jun 05, 2021
Yao-Hung Hubert Tsai, Martin Q. Ma, Han Zhao, Kun Zhang, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations
Figure 2 for Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations
Figure 3 for Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations
Figure 4 for Conditional Contrastive Learning: Removing Undesirable Information in Self-Supervised Representations

  Access Paper or Ask Questions

A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning


Apr 28, 2021
Yao-Hung Hubert Tsai, Shaojie Bai, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning
Figure 2 for A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning

  Access Paper or Ask Questions

Self-supervised Representation Learning with Relative Predictive Coding


Apr 12, 2021
Yao-Hung Hubert Tsai, Martin Q. Ma, Muqiao Yang, Han Zhao, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Self-supervised Representation Learning with Relative Predictive Coding
Figure 2 for Self-supervised Representation Learning with Relative Predictive Coding
Figure 3 for Self-supervised Representation Learning with Relative Predictive Coding
Figure 4 for Self-supervised Representation Learning with Relative Predictive Coding

  Access Paper or Ask Questions

StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer


Apr 12, 2021
Yiwei Lyu, Paul Pu Liang, Hai Pham, Eduard Hovy, Barnabás Póczos, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer
Figure 2 for StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer
Figure 3 for StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer
Figure 4 for StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer
* NAACL 2021, code available at https://github.com/lvyiwei1/StylePTB/ 
  Access Paper or Ask Questions

Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition


Jan 22, 2021
Peter Wu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition
Figure 2 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition
Figure 3 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition
Figure 4 for Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition

  Access Paper or Ask Questions

StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations


Jan 03, 2021
Amir Zadeh, Santiago Benoit, Louis-Philippe Morency

Figure 1 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
Figure 2 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
Figure 3 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
Figure 4 for StarNet: Gradient-free Training of Deep Generative Models using Determined System of Linear Equations
* Work in progress at CMU 
  Access Paper or Ask Questions

Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment


Dec 04, 2020
Paul Pu Liang, Peter Wu, Liu Ziyin, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Figure 2 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Figure 3 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment
Figure 4 for Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment

  Access Paper or Ask Questions

Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study


Dec 04, 2020
Terrance Liu, Paul Pu Liang, Michal Muszynski, Ryo Ishii, David Brent, Randy Auerbach, Nicholas Allen, Louis-Philippe Morency

Figure 1 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
Figure 2 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
Figure 3 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study
Figure 4 for Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study

  Access Paper or Ask Questions

Unsupervised Domain Adaptation for Visual Navigation


Nov 12, 2020
Shangda Li, Devendra Singh Chaplot, Yao-Hung Hubert Tsai, Yue Wu, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Unsupervised Domain Adaptation for Visual Navigation
Figure 2 for Unsupervised Domain Adaptation for Visual Navigation
Figure 3 for Unsupervised Domain Adaptation for Visual Navigation
Figure 4 for Unsupervised Domain Adaptation for Visual Navigation
* Deep Reinforcement Learning Workshop at NeurIPS 2020. Camera Ready Version 
  Access Paper or Ask Questions

MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences


Oct 22, 2020
Jianing Yang, Yongxin Wang, Ruitao Yi, Yuying Zhu, Azaan Rehman, Amir Zadeh, Soujanya Poria, Louis-Philippe Morency

Figure 1 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Figure 2 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Figure 3 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences
Figure 4 for MTGAT: Multimodal Temporal Graph Attention Networks for Unaligned Human Multimodal Language Sequences

  Access Paper or Ask Questions

Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach


Jul 24, 2020
Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano, Louis-Philippe Morency

Figure 1 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
Figure 2 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
Figure 3 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
Figure 4 for Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach
* European Conference on Computer Vision 2020 
 * 24 pages, 12 figures 
  Access Paper or Ask Questions

Towards Debiasing Sentence Representations


Jul 16, 2020
Paul Pu Liang, Irene Mengze Li, Emily Zheng, Yao Chong Lim, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Towards Debiasing Sentence Representations
Figure 2 for Towards Debiasing Sentence Representations
Figure 3 for Towards Debiasing Sentence Representations
Figure 4 for Towards Debiasing Sentence Representations
* ACL 2020, code available at https://github.com/pliang279/sent_debias 
  Access Paper or Ask Questions

What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets


Jul 07, 2020
Jianing Yang, Yuying Zhu, Yongxin Wang, Ruitao Yi, Amir Zadeh, Louis-Philippe Morency

Figure 1 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
Figure 2 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
Figure 3 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets
Figure 4 for What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets

  Access Paper or Ask Questions

Neural Methods for Point-wise Dependency Estimation


Jun 11, 2020
Yao-Hung Hubert Tsai, Han Zhao, Makoto Yamada, Louis-Philippe Morency, Ruslan Salakhutdinov

Figure 1 for Neural Methods for Point-wise Dependency Estimation
Figure 2 for Neural Methods for Point-wise Dependency Estimation
Figure 3 for Neural Methods for Point-wise Dependency Estimation
Figure 4 for Neural Methods for Point-wise Dependency Estimation

  Access Paper or Ask Questions

Demystifying Self-Supervised Learning: An Information-Theoretical Framework


Jun 11, 2020
Yao-Hung Hubert Tsai, Yue Wu, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Figure 2 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Figure 3 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework
Figure 4 for Demystifying Self-Supervised Learning: An Information-Theoretical Framework

  Access Paper or Ask Questions

Improving Aspect-Level Sentiment Analysis with Aspect Extraction


May 03, 2020
Navonil Majumder, Rishabh Bhardwaj, Soujanya Poria, Amir Zadeh, Alexander Gelbukh, Amir Hussain, Louis-Philippe Morency

Figure 1 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Figure 2 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Figure 3 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Figure 4 for Improving Aspect-Level Sentiment Analysis with Aspect Extraction

  Access Paper or Ask Questions

Interpretable Multimodal Routing for Human Multimodal Language


Apr 29, 2020
Yao-Hung Hubert Tsai, Martin Q. Ma, Muqiao Yang, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Interpretable Multimodal Routing for Human Multimodal Language
Figure 2 for Interpretable Multimodal Routing for Human Multimodal Language
Figure 3 for Interpretable Multimodal Routing for Human Multimodal Language
Figure 4 for Interpretable Multimodal Routing for Human Multimodal Language

  Access Paper or Ask Questions

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding


Apr 03, 2020
Seong Hyeon Park, Gyubok Lee, Manoj Bhat, Jimin Seo, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency

Figure 1 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding
Figure 2 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding
Figure 3 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding
Figure 4 for Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

  Access Paper or Ask Questions

On Emergent Communication in Competitive Multi-Agent Teams


Mar 04, 2020
Paul Pu Liang, Jeffrey Chen, Ruslan Salakhutdinov, Louis-Philippe Morency, Satwik Kottur

Figure 1 for On Emergent Communication in Competitive Multi-Agent Teams
Figure 2 for On Emergent Communication in Competitive Multi-Agent Teams
Figure 3 for On Emergent Communication in Competitive Multi-Agent Teams
Figure 4 for On Emergent Communication in Competitive Multi-Agent Teams
* AAMAS 2020 
  Access Paper or Ask Questions

Learning Not to Learn in the Presence of Noisy Labels


Feb 16, 2020
Liu Ziyin, Blair Chen, Ru Wang, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency, Masahito Ueda

Figure 1 for Learning Not to Learn in the Presence of Noisy Labels
Figure 2 for Learning Not to Learn in the Presence of Noisy Labels
Figure 3 for Learning Not to Learn in the Presence of Noisy Labels
Figure 4 for Learning Not to Learn in the Presence of Noisy Labels

  Access Paper or Ask Questions

Think Locally, Act Globally: Federated Learning with Local and Global Representations


Jan 06, 2020
Paul Pu Liang, Terrance Liu, Liu Ziyin, Ruslan Salakhutdinov, Louis-Philippe Morency

Figure 1 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
Figure 2 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
Figure 3 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
Figure 4 for Think Locally, Act Globally: Federated Learning with Local and Global Representations
* Workshop on Federated Learning for Data Privacy and Confidentiality, NeurIPS 2019, Vancouver, Canada 
  Access Paper or Ask Questions

Context-Dependent Models for Predicting and Characterizing Facial Expressiveness


Dec 10, 2019
Victoria Lin, Jeffrey M. Girard, Louis-Philippe Morency

Figure 1 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness
Figure 2 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness
Figure 3 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness
Figure 4 for Context-Dependent Models for Predicting and Characterizing Facial Expressiveness

  Access Paper or Ask Questions

Factorized Multimodal Transformer for Multimodal Sequential Learning


Nov 22, 2019
Amir Zadeh, Chengfeng Mao, Kelly Shi, Yiwei Zhang, Paul Pu Liang, Soujanya Poria, Louis-Philippe Morency

Figure 1 for Factorized Multimodal Transformer for Multimodal Sequential Learning
Figure 2 for Factorized Multimodal Transformer for Multimodal Sequential Learning
Figure 3 for Factorized Multimodal Transformer for Multimodal Sequential Learning
Figure 4 for Factorized Multimodal Transformer for Multimodal Sequential Learning

  Access Paper or Ask Questions