Alert button
Picture for Ivan Montero

Ivan Montero

Alert button

University of Washington

How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers

Nov 07, 2022
Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, Roy Schwartz

Figure 1 for How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
Figure 2 for How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
Figure 3 for How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
Figure 4 for How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
Viaarxiv icon

Sentence Bottleneck Autoencoders from Transformer Language Models

Aug 31, 2021
Ivan Montero, Nikolaos Pappas, Noah A. Smith

Figure 1 for Sentence Bottleneck Autoencoders from Transformer Language Models
Figure 2 for Sentence Bottleneck Autoencoders from Transformer Language Models
Figure 3 for Sentence Bottleneck Autoencoders from Transformer Language Models
Figure 4 for Sentence Bottleneck Autoencoders from Transformer Language Models
Viaarxiv icon

Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval

Dec 28, 2020
Ivan Montero, Shayne Longpre, Ni Lao, Andrew J. Frank, Christopher DuBois

Figure 1 for Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Figure 2 for Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Figure 3 for Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Figure 4 for Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Viaarxiv icon

Plug and Play Autoencoders for Conditional Text Generation

Oct 12, 2020
Florian Mai, Nikolaos Pappas, Ivan Montero, Noah A. Smith, James Henderson

Figure 1 for Plug and Play Autoencoders for Conditional Text Generation
Figure 2 for Plug and Play Autoencoders for Conditional Text Generation
Figure 3 for Plug and Play Autoencoders for Conditional Text Generation
Figure 4 for Plug and Play Autoencoders for Conditional Text Generation
Viaarxiv icon