Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

Apr 03, 2020
Seong Hyeon Park, Gyubok Lee, Manoj Bhat, Jimin Seo, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency

  Access Model/Code and Paper

Anchor & Transform: Learning Sparse Representations of Discrete Objects

Mar 18, 2020
Paul Pu Liang, Manzil Zaheer, Yuan Wang, Amr Ahmed

  Access Model/Code and Paper

On Emergent Communication in Competitive Multi-Agent Teams

Mar 04, 2020
Paul Pu Liang, Jeffrey Chen, Ruslan Salakhutdinov, Louis-Philippe Morency, Satwik Kottur

* AAMAS 2020 

  Access Model/Code and Paper

Learning Not to Learn in the Presence of Noisy Labels

Feb 16, 2020
Liu Ziyin, Blair Chen, Ru Wang, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency, Masahito Ueda

  Access Model/Code and Paper

Think Locally, Act Globally: Federated Learning with Local and Global Representations

Jan 06, 2020
Paul Pu Liang, Terrance Liu, Liu Ziyin, Ruslan Salakhutdinov, Louis-Philippe Morency

* Workshop on Federated Learning for Data Privacy and Confidentiality, NeurIPS 2019, Vancouver, Canada 

  Access Model/Code and Paper

Factorized Multimodal Transformer for Multimodal Sequential Learning

Nov 22, 2019
Amir Zadeh, Chengfeng Mao, Kelly Shi, Yiwei Zhang, Paul Pu Liang, Soujanya Poria, Louis-Philippe Morency

  Access Model/Code and Paper

Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization

Jul 01, 2019
Paul Pu Liang, Zhun Liu, Yao-Hung Hubert Tsai, Qibin Zhao, Ruslan Salakhutdinov, Louis-Philippe Morency

  Access Model/Code and Paper

Deep Gamblers: Learning to Abstain with Portfolio Theory

Jun 29, 2019
Liu Ziyin, Zhikang Wang, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency, Masahito Ueda

  Access Model/Code and Paper

Multimodal Transformer for Unaligned Multimodal Language Sequences

Jun 01, 2019
Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, J. Zico Kolter, Louis-Philippe Morency, Ruslan Salakhutdinov

  Access Model/Code and Paper

Strong and Simple Baselines for Multimodal Utterance Embeddings

May 14, 2019
Paul Pu Liang, Yao Chong Lim, Yao-Hung Hubert Tsai, Ruslan Salakhutdinov, Louis-Philippe Morency

* NAACL 2019 

  Access Model/Code and Paper

Variational Auto-Decoder

Apr 03, 2019
Amir Zadeh, Yao-Chong Lim, Paul Pu Liang, Louis-Philippe Morency

* Link to code and data available from https://github.com/A2Zadeh/Variational-Autodecoder 

  Access Model/Code and Paper

An Empirical Evaluation of Sketched SVD and its Application to Leverage Score Ordering

Dec 19, 2018
Hui Han Chin, Paul Pu Liang

* ACML 2018 

  Access Model/Code and Paper

Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalities

Dec 19, 2018
Hai Pham, Paul Pu Liang, Thomas Manzini, Louis-Philippe Morency, Barnabas Poczos

* AAAI 2019 

  Access Model/Code and Paper

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

Nov 26, 2018
Yansen Wang, Ying Shen, Zhun Liu, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency

* Accepted by AAAI2019 

  Access Model/Code and Paper

Multimodal Language Analysis with Recurrent Multistage Fusion

Aug 12, 2018
Paul Pu Liang, Ziyin Liu, Amir Zadeh, Louis-Philippe Morency

* EMNLP 2018 

  Access Model/Code and Paper

Multimodal Local-Global Ranking Fusion for Emotion Recognition

Aug 12, 2018
Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency

* ACM International Conference on Multimodal Interaction (ICMI 2018) 

  Access Model/Code and Paper

Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis

Aug 06, 2018
Hai Pham, Thomas Manzini, Paul Pu Liang, Barnabas Poczos

* 8 pages of content, 11 pages total, 2 figures. Published as a workshop paper at ACL 2018, Proceedings of Grand Challenge and Workshop on Human Multimodal Language (Challenge-HML). 2018 

  Access Model/Code and Paper

Learning Factorized Multimodal Representations

Jun 16, 2018
Yao-Hung Hubert Tsai, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency, Ruslan Salakhutdinov

  Access Model/Code and Paper

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

May 31, 2018
Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency

* * Equal contribution. 10 pages. Accepted by ACL 2018 

  Access Model/Code and Paper

Memory Fusion Network for Multi-view Sequential Learning

Feb 03, 2018
Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, Louis-Philippe Morency

* AAAI 2018 Oral Presentation 

  Access Model/Code and Paper

Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning

Feb 03, 2018
Minghai Chen, Sen Wang, Paul Pu Liang, Tadas Baltrušaitis, Amir Zadeh, Louis-Philippe Morency

* ICMI 2017 Oral Presentation, Honorable Mention Award 

  Access Model/Code and Paper

Multi-attention Recurrent Network for Human Communication Comprehension

Feb 03, 2018
Amir Zadeh, Paul Pu Liang, Soujanya Poria, Prateek Vij, Erik Cambria, Louis-Philippe Morency

* AAAI 2018 Oral Presentation 

  Access Model/Code and Paper