Picture for Ryan Cotterell

Ryan Cotterell

Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition

Nov 23, 2022
Jennifer C. White, Ryan Cotterell

Figure 1 for Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition

Figure 2 for Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition

Figure 3 for Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition

Figure 4 for Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition

Access Paper or Ask Questions

On Parsing as Tagging

Nov 20, 2022
Afra Amini, Ryan Cotterell

Figure 1 for On Parsing as Tagging

Figure 2 for On Parsing as Tagging

Figure 3 for On Parsing as Tagging

Figure 4 for On Parsing as Tagging

* Will appear in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing

Access Paper or Ask Questions

Autoregressive Structured Prediction with Language Models

Nov 17, 2022
Tianyu Liu, Yuchen Jiang, Nicholas Monath, Ryan Cotterell, Mrinmaya Sachan

Figure 1 for Autoregressive Structured Prediction with Language Models

Figure 2 for Autoregressive Structured Prediction with Language Models

Figure 3 for Autoregressive Structured Prediction with Language Models

Figure 4 for Autoregressive Structured Prediction with Language Models

* EMNLP 2022 (findings)

Access Paper or Ask Questions

The Architectural Bottleneck Principle

Nov 11, 2022
Tiago Pimentel, Josef Valvoda, Niklas Stoehr, Ryan Cotterell

Figure 1 for The Architectural Bottleneck Principle

Figure 2 for The Architectural Bottleneck Principle

Figure 3 for The Architectural Bottleneck Principle

Figure 4 for The Architectural Bottleneck Principle

* Accepted at EMNLP 2022. Tiago Pimentel and Josef Valvoda contributed equally to this work. Code available in https://github.com/rycolab/attentional-probe

Access Paper or Ask Questions

Algorithms for Weighted Pushdown Automata

Oct 19, 2022
Alexandra Butoi, Brian DuSell, Tim Vieira, Ryan Cotterell, David Chiang

Figure 1 for Algorithms for Weighted Pushdown Automata

Figure 2 for Algorithms for Weighted Pushdown Automata

Figure 3 for Algorithms for Weighted Pushdown Automata

Figure 4 for Algorithms for Weighted Pushdown Automata

* 12 pages, 7 figures. Submitted to EMNLP 2022

Access Paper or Ask Questions