Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for James Glass

James Glass

Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos


Apr 26, 2021
Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, Angie Boggust, Rameswar Panda, Brian Kingsbury, Rogerio Feris, David Harwath, James Glass, Michael Picheny, Shih-Fu Chang

Figure 1 for Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos
Figure 2 for Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos
Figure 3 for Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos
Figure 4 for Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos

  Access Paper or Ask Questions

AST: Audio Spectrogram Transformer


Apr 06, 2021
Yuan Gong, Yu-An Chung, James Glass

Figure 1 for AST: Audio Spectrogram Transformer
Figure 2 for AST: Audio Spectrogram Transformer
Figure 3 for AST: Audio Spectrogram Transformer
Figure 4 for AST: Audio Spectrogram Transformer

  Access Paper or Ask Questions

Cooperative Learning of Zero-Shot Machine Reading Comprehension


Mar 22, 2021
Hongyin Luo, Shang-Wen Li, Seunghak Yu, James Glass

Figure 1 for Cooperative Learning of Zero-Shot Machine Reading Comprehension
Figure 2 for Cooperative Learning of Zero-Shot Machine Reading Comprehension
Figure 3 for Cooperative Learning of Zero-Shot Machine Reading Comprehension
Figure 4 for Cooperative Learning of Zero-Shot Machine Reading Comprehension

  Access Paper or Ask Questions

PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation


Feb 02, 2021
Yuan Gong, Yu-An Chung, James Glass

Figure 1 for PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation
Figure 2 for PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation
Figure 3 for PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation
Figure 4 for PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation

  Access Paper or Ask Questions

Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks


Jan 24, 2021
Hongyin Luo, Shang-Wen Li, James Glass

Figure 1 for Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks
Figure 2 for Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks
Figure 3 for Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks
Figure 4 for Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks
* Appears in the Proceedings of the 3rd Clinical Natural Language Processing Workshop 
  Access Paper or Ask Questions

Text-Free Image-to-Speech Synthesis Using Learned Segmental Units


Dec 31, 2020
Wei-Ning Hsu, David Harwath, Christopher Song, James Glass

Figure 1 for Text-Free Image-to-Speech Synthesis Using Learned Segmental Units
Figure 2 for Text-Free Image-to-Speech Synthesis Using Learned Segmental Units
Figure 3 for Text-Free Image-to-Speech Synthesis Using Learned Segmental Units
Figure 4 for Text-Free Image-to-Speech Synthesis Using Learned Segmental Units

  Access Paper or Ask Questions

Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies


Nov 01, 2020
Alexander H. Liu, Yu-An Chung, James Glass

Figure 1 for Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies
Figure 2 for Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies
Figure 3 for Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies
Figure 4 for Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies
* Preprint 
  Access Paper or Ask Questions

Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining


Oct 26, 2020
Cheng-I Lai, Yung-Sung Chuang, Hung-Yi Lee, Shang-Wen Li, James Glass

Figure 1 for Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining
Figure 2 for Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining
Figure 3 for Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining
Figure 4 for Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining

  Access Paper or Ask Questions

Similarity Analysis of Self-Supervised Speech Representations


Oct 22, 2020
Yu-An Chung, Yonatan Belinkov, James Glass

Figure 1 for Similarity Analysis of Self-Supervised Speech Representations
Figure 2 for Similarity Analysis of Self-Supervised Speech Representations
Figure 3 for Similarity Analysis of Self-Supervised Speech Representations
Figure 4 for Similarity Analysis of Self-Supervised Speech Representations

  Access Paper or Ask Questions

We Can Detect Your Bias: Predicting the Political Ideology of News Articles


Oct 11, 2020
Ramy Baly, Giovanni Da San Martino, James Glass, Preslav Nakov

Figure 1 for We Can Detect Your Bias: Predicting the Political Ideology of News Articles
Figure 2 for We Can Detect Your Bias: Predicting the Political Ideology of News Articles
Figure 3 for We Can Detect Your Bias: Predicting the Political Ideology of News Articles
Figure 4 for We Can Detect Your Bias: Predicting the Political Ideology of News Articles
* EMNLP-2020 
 * Political bias, bias in news, neural networks bias, adversarial adaptation, triplet loss, transformers, recurrent neural networks 
  Access Paper or Ask Questions

A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation


Sep 15, 2020
Moin Nadeem, Tianxing He, Kyunghyun Cho, James Glass

Figure 1 for A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
Figure 2 for A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
Figure 3 for A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
Figure 4 for A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
* To appear at AACL 2020; 9 pages, 12 figures, 2 tables 
  Access Paper or Ask Questions

Constructing a Knowledge Graph from Unstructured Documents without External Alignment


Aug 20, 2020
Seunghak Yu, Tianxing He, James Glass

Figure 1 for Constructing a Knowledge Graph from Unstructured Documents without External Alignment
Figure 2 for Constructing a Knowledge Graph from Unstructured Documents without External Alignment
Figure 3 for Constructing a Knowledge Graph from Unstructured Documents without External Alignment
Figure 4 for Constructing a Knowledge Graph from Unstructured Documents without External Alignment

  Access Paper or Ask Questions

AVLnet: Learning Audio-Visual Language Representations from Instructional Videos


Jun 16, 2020
Andrew Rouditchenko, Angie Boggust, David Harwath, Dhiraj Joshi, Samuel Thomas, Kartik Audhkhasi, Rogerio Feris, Brian Kingsbury, Michael Picheny, Antonio Torralba, James Glass

Figure 1 for AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
Figure 2 for AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
Figure 3 for AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
Figure 4 for AVLnet: Learning Audio-Visual Language Representations from Instructional Videos

  Access Paper or Ask Questions

CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning


Jun 04, 2020
Sameer Khurana, Antoine Laurent, James Glass

Figure 1 for CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning
Figure 2 for CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning
Figure 3 for CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning
Figure 4 for CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning
* submitted to INTERSPEECH 
  Access Paper or Ask Questions

A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning


Jun 03, 2020
Sameer Khurana, Antoine Laurent, Wei-Ning Hsu, Jan Chorowski, Adrian Lancucki, Ricard Marxer, James Glass

Figure 1 for A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning
Figure 2 for A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning
Figure 3 for A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning
* Submitted to Interspeech 2020 
  Access Paper or Ask Questions

Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption


May 19, 2020
Hongyin Luo, Shang-Wen Li, James Glass

Figure 1 for Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption
Figure 2 for Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption
Figure 3 for Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption
Figure 4 for Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption

  Access Paper or Ask Questions

Vector-Quantized Autoregressive Predictive Coding


May 17, 2020
Yu-An Chung, Hao Tang, James Glass

Figure 1 for Vector-Quantized Autoregressive Predictive Coding
Figure 2 for Vector-Quantized Autoregressive Predictive Coding
Figure 3 for Vector-Quantized Autoregressive Predictive Coding
Figure 4 for Vector-Quantized Autoregressive Predictive Coding

  Access Paper or Ask Questions

What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context


May 09, 2020
Ramy Baly, Georgi Karadzhov, Jisun An, Haewoon Kwak, Yoan Dinkov, Ahmed Ali, James Glass, Preslav Nakov

Figure 1 for What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context
Figure 2 for What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context
Figure 3 for What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context
Figure 4 for What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context
* ACL-2020 
 * Factuality of reporting, fact-checking, political ideology, media bias, disinformation, propaganda, social media, news media 
  Access Paper or Ask Questions

Similarity Analysis of Contextual Word Representation Models


May 03, 2020
John M. Wu, Yonatan Belinkov, Hassan Sajjad, Nadir Durrani, Fahim Dalvi, James Glass

Figure 1 for Similarity Analysis of Contextual Word Representation Models
Figure 2 for Similarity Analysis of Contextual Word Representation Models
Figure 3 for Similarity Analysis of Contextual Word Representation Models
Figure 4 for Similarity Analysis of Contextual Word Representation Models
* Accepted to ACL 2020 
  Access Paper or Ask Questions

Improved Speech Representations with Multi-Target Autoregressive Predictive Coding


Apr 11, 2020
Yu-An Chung, James Glass

Figure 1 for Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Figure 2 for Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Figure 3 for Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Figure 4 for Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
* Accepted to ACL 2020 
  Access Paper or Ask Questions

SemEval-2016 Task 3: Community Question Answering


Dec 03, 2019
Preslav Nakov, Lluís Màrquez, Alessandro Moschitti, Walid Magdy, Hamdy Mubarak, Abed Alhakim Freihat, James Glass, Bilal Randeree

Figure 1 for SemEval-2016 Task 3: Community Question Answering
Figure 2 for SemEval-2016 Task 3: Community Question Answering
Figure 3 for SemEval-2016 Task 3: Community Question Answering
Figure 4 for SemEval-2016 Task 3: Community Question Answering
* SemEval-2016 
 * community question answering, question-question similarity, question-comment similarity, answer reranking, English, Arabic. arXiv admin note: substantial text overlap with arXiv:1912.00730 
  Access Paper or Ask Questions

SemEval-2015 Task 3: Answer Selection in Community Question Answering


Nov 26, 2019
Preslav Nakov, Lluís Màrquez, Walid Magdy, Alessandro Moschitti, James Glass, Bilal Randeree

Figure 1 for SemEval-2015 Task 3: Answer Selection in Community Question Answering
Figure 2 for SemEval-2015 Task 3: Answer Selection in Community Question Answering
Figure 3 for SemEval-2015 Task 3: Answer Selection in Community Question Answering
Figure 4 for SemEval-2015 Task 3: Answer Selection in Community Question Answering
* SemEval-2015 
 * community question answering, answer selection, English, Arabic 
  Access Paper or Ask Questions

Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech


Nov 21, 2019
David Harwath, Wei-Ning Hsu, James Glass

Figure 1 for Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech
Figure 2 for Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech
Figure 3 for Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech
Figure 4 for Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech

  Access Paper or Ask Questions

On the Linguistic Representational Power of Neural Machine Translation Models


Nov 01, 2019
Yonatan Belinkov, Nadir Durrani, Fahim Dalvi, Hassan Sajjad, James Glass

Figure 1 for On the Linguistic Representational Power of Neural Machine Translation Models
Figure 2 for On the Linguistic Representational Power of Neural Machine Translation Models
Figure 3 for On the Linguistic Representational Power of Neural Machine Translation Models
Figure 4 for On the Linguistic Representational Power of Neural Machine Translation Models
* Accepted to appear in the Journal of Computational Linguistics 
  Access Paper or Ask Questions

Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models


Oct 29, 2019
Tianxing He, Jun Liu, Kyunghyun Cho, Myle Ott, Bing Liu, James Glass, Fuchun Peng

Figure 1 for Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models
Figure 2 for Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models
Figure 3 for Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models
Figure 4 for Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models

  Access Paper or Ask Questions

Generative Pre-Training for Speech with Autoregressive Predictive Coding


Oct 23, 2019
Yu-An Chung, James Glass

Figure 1 for Generative Pre-Training for Speech with Autoregressive Predictive Coding
Figure 2 for Generative Pre-Training for Speech with Autoregressive Predictive Coding
Figure 3 for Generative Pre-Training for Speech with Autoregressive Predictive Coding
Figure 4 for Generative Pre-Training for Speech with Autoregressive Predictive Coding
* Code and pre-trained models are available at https://github.com/iamyuanchung/Autoregressive-Predictive-Coding 
  Access Paper or Ask Questions