Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Roger Wattenhofer

On Isotropy Calibration of Transformers


Sep 27, 2021
Yue Ding, Karolis Martinkus, Damian Pascual, Simon Clematide, Roger Wattenhofer


  Access Paper or Ask Questions

A Plug-and-Play Method for Controlled Text Generation


Sep 20, 2021
Damian Pascual, Beni Egressy, Clara Meister, Ryan Cotterell, Roger Wattenhofer

* Findings of EMNLP 2021 

  Access Paper or Ask Questions

BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification


Sep 15, 2021
Jens Hauser, Zhao Meng, Damián Pascual, Roger Wattenhofer

* 12 pages with appendix, 7 figures 

  Access Paper or Ask Questions

Self-Supervised Contrastive Learning with Adversarial Perturbations for Robust Pretrained Language Models


Jul 15, 2021
Zhao Meng, Yihan Dong, Mrinmaya Sachan, Roger Wattenhofer

* Work in progress 

  Access Paper or Ask Questions

Towards BERT-based Automatic ICD Coding: Limitations and Opportunities


Apr 14, 2021
Damian Pascual, Sandro Luck, Roger Wattenhofer

* Accepted at BioNLP 2021 

  Access Paper or Ask Questions

Should Graph Neural Networks Use Features, Edges, Or Both?


Mar 11, 2021
Lukas Faber, Yifan Lu, Roger Wattenhofer


  Access Paper or Ask Questions

Towards Robust Graph Contrastive Learning


Feb 25, 2021
Nikola Jovanović, Zhao Meng, Lukas Faber, Roger Wattenhofer


  Access Paper or Ask Questions

Of Non-Linearity and Commutativity in BERT


Jan 14, 2021
Sumu Zhao, Damian Pascual, Gino Brunner, Roger Wattenhofer


  Access Paper or Ask Questions

KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation


Jan 02, 2021
Yiran Xing, Zai Shi, Zhao Meng, Yunpu Ma, Roger Wattenhofer

* Work in progress. The first three authors contribute equally to this work 

  Access Paper or Ask Questions

Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation


Dec 31, 2020
Damian Pascual, Beni Egressy, Florian Bolli, Roger Wattenhofer

* Preprint. Work in progress 

  Access Paper or Ask Questions

Contrastive Graph Neural Network Explanation


Oct 26, 2020
Lukas Faber, Amin K. Moghaddam, Roger Wattenhofer

* ICML 2020 Workshop on Graph Representation Learning and Beyond (GRL+) 

  Access Paper or Ask Questions

Brain2Word: Decoding Brain Activity for Language Generation


Oct 13, 2020
Nicolas Affolter, Beni Egressy, Damian Pascual, Roger Wattenhofer


  Access Paper or Ask Questions

A Geometry-Inspired Attack for Generating Natural Language Adversarial Examples


Oct 03, 2020
Zhao Meng, Roger Wattenhofer

* COLING 2020 Long Paper 

  Access Paper or Ask Questions

Medley2K: A Dataset of Medley Transitions


Aug 25, 2020
Lukas Faber, Sandro Luck, Damian Pascual, Andreas Roth, Gino Brunner, Roger Wattenhofer

* MML 2020 - 13th Int. Workshop on Machine Learning and Music at ECML-PKDD 2020 

  Access Paper or Ask Questions

Normalized Attention Without Probability Cage


May 19, 2020
Oliver Richter, Roger Wattenhofer

* Preprint, work in progress. Feedback welcome 

  Access Paper or Ask Questions

Neural Status Registers


Apr 15, 2020
Lukas Faber, Roger Wattenhofer


  Access Paper or Ask Questions

Telling BERT's full story: from Local Attention to Global Aggregation


Apr 10, 2020
Damian Pascual, Gino Brunner, Roger Wattenhofer

* Preprint. Work in progress 

  Access Paper or Ask Questions

On the Validity of Self-Attention as Explanation in Transformer Models


Aug 12, 2019
Gino Brunner, Yang Liu, Damián Pascual, Oliver Richter, Roger Wattenhofer

* Preprint. Work in progress 

  Access Paper or Ask Questions

Synthetic Epileptic Brain Activities Using Generative Adversarial Networks


Jul 22, 2019
Damian Pascual, Amir Aminifar, David Atienza, Philippe Ryvlin, Roger Wattenhofer


  Access Paper or Ask Questions

Attentive Multi-Task Deep Reinforcement Learning


Jul 05, 2019
Timo Bram, Gino Brunner, Oliver Richter, Roger Wattenhofer

* Accepted as conference paper at ECML PKDD 2019 

  Access Paper or Ask Questions

Quantile Regression Deep Reinforcement Learning


Jun 27, 2019
Oliver Richter, Roger Wattenhofer

* Preprint 

  Access Paper or Ask Questions

Using State Predictions for Value Regularization in Curiosity Driven Deep Reinforcement Learning


Sep 30, 2018
Gino Brunner, Manuel Fritsche, Oliver Richter, Roger Wattenhofer


  Access Paper or Ask Questions

The Urban Last Mile Problem: Autonomous Drone Delivery to Your Balcony


Sep 21, 2018
Gino Brunner, Bence Szebedy, Simon Tanner, Roger Wattenhofer


  Access Paper or Ask Questions

MIDI-VAE: Modeling Dynamics and Instrumentation of Music with Applications to Style Transfer


Sep 20, 2018
Gino Brunner, Andres Konrad, Yuyi Wang, Roger Wattenhofer

* Paper accepted at the 19th International Society for Music Information Retrieval Conference, ISMIR 2018, Paris, France 

  Access Paper or Ask Questions

Symbolic Music Genre Transfer with CycleGAN


Sep 20, 2018
Gino Brunner, Yuyi Wang, Roger Wattenhofer, Sumu Zhao

* Paper accepted at the 30th International Conference on Tools with Artificial Intelligence, ICTAI 2018, Volos, Greece 

  Access Paper or Ask Questions

Natural Language Multitasking: Analyzing and Improving Syntactic Saliency of Hidden Representations


Jan 18, 2018
Gino Brunner, Yuyi Wang, Roger Wattenhofer, Michael Weigelt

* The 31st Annual Conference on Neural Information Processing (NIPS) - Workshop on Learning Disentangled Features: from Perception to Control, Long Beach, CA, December 2017 

  Access Paper or Ask Questions

JamBot: Music Theory Aware Chord Based Generation of Polyphonic Music with LSTMs


Nov 21, 2017
Gino Brunner, Yuyi Wang, Roger Wattenhofer, Jonas Wiesendanger

* Paper presented at the 29th International Conference on Tools with Artificial Intelligence, ICTAI 2017, Boston, MA, USA 

  Access Paper or Ask Questions

Teaching a Machine to Read Maps with Deep Reinforcement Learning


Nov 20, 2017
Gino Brunner, Oliver Richter, Yuyi Wang, Roger Wattenhofer

* Paper accepted at 32nd AAAI Conference on Artificial Intelligence, AAAI 2018, New Orleans, Louisiana, USA 

  Access Paper or Ask Questions