Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Thomas Wolf

Multitask Prompted Training Enables Zero-Shot Task Generalization


Oct 15, 2021
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Fevry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, Alexander M. Rush

* https://github.com/bigscience-workshop/promptsource/ 

  Access Paper or Ask Questions

Datasets: A Community Library for Natural Language Processing


Sep 07, 2021
Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, Abhishek Thakur, Patrick von Platen, Suraj Patil, Julien Chaumond, Mariama Drame, Julien Plu, Lewis Tunstall, Joe Davison, Mario Šaško, Gunjan Chhablani, Bhavitvya Malik, Simon Brandeis, Teven Le Scao, Victor Sanh, Canwen Xu, Nicolas Patry, Angelina McMillan-Major, Philipp Schmid, Sylvain Gugger, Clément Delangue, Théo Matussière, Lysandre Debut, Stas Bekman, Pierric Cistac, Thibault Goehringer, Victor Mustar, François Lagunas, Alexander M. Rush, Thomas Wolf

* EMNLP Demo 2021 

  Access Paper or Ask Questions

VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning


Jun 21, 2021
Hao Tan, Jie Lei, Thomas Wolf, Mohit Bansal

* Under review, 23 Pages 

  Access Paper or Ask Questions

Distributed Deep Learning in Open Collaborations


Jun 18, 2021
Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Quentin Lhoest, Anton Sinitsin, Dmitry Popov, Dmitry Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko

* 30 pages, 9 figures. Code: https://github.com/yandex-research/DeDLOC 

  Access Paper or Ask Questions

Learning from others' mistakes: Avoiding dataset biases without modeling them


Dec 02, 2020
Victor Sanh, Thomas Wolf, Yonatan Belinkov, Alexander M. Rush

* 15 pages, 6 figures, 6 tables 

  Access Paper or Ask Questions

Movement Pruning: Adaptive Sparsity by Fine-Tuning


May 15, 2020
Victor Sanh, Thomas Wolf, Alexander M. Rush

* 12 pages, 6 figures, 3 tables 

  Access Paper or Ask Questions

TLDR: Token Loss Dynamic Reweighting for Reducing Repetitive Utterance Generation


Apr 09, 2020
Shaojie Jiang, Thomas Wolf, Christof Monz, Maarten de Rijke

* 9 pages, 4 figures, 1 table 

  Access Paper or Ask Questions

HuggingFace's Transformers: State-of-the-art Natural Language Processing


Oct 16, 2019
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Jamie Brew

* 11 pages, 1 figure, more details at https://github.com/huggingface/transformers 

  Access Paper or Ask Questions

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter


Oct 16, 2019
Victor Sanh, Lysandre Debut, Julien Chaumond, Thomas Wolf

* 5 pages, 1 figure, 4 tables. Accepted at the 5th Workshop on Energy Efficient Machine Learning and Cognitive Computing - NeurIPS 2019 

  Access Paper or Ask Questions

Transformers: State-of-the-art Natural Language Processing


Oct 09, 2019
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Jamie Brew

* 11 pages, 1 figure 

  Access Paper or Ask Questions

TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents


Feb 04, 2019
Thomas Wolf, Victor Sanh, Julien Chaumond, Clement Delangue

* 6 pages, 2 figures, 2 tables, NeurIPS 2018 CAI Workshop 

  Access Paper or Ask Questions

A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks


Nov 26, 2018
Victor Sanh, Thomas Wolf, Sebastian Ruder

* 8 pages, 1 figure, To appear in Proceedings of AAAI 2019 

  Access Paper or Ask Questions

Continuous Learning in a Hierarchical Multiscale Neural Network


May 15, 2018
Thomas Wolf, Julien Chaumond, Clement Delangue

* 5 pages, 2 figures, accepted as short paper at ACL 2018 

  Access Paper or Ask Questions

Meta-Learning a Dynamical Language Model


Mar 28, 2018
Thomas Wolf, Julien Chaumond, Clement Delangue

* 5 pages, 2 figures, accepted at ICLR 2018 workshop track 

  Access Paper or Ask Questions

Studying Invariances of Trained Convolutional Neural Networks


Mar 15, 2018
Charlotte Bunne, Lukas Rahmann, Thomas Wolf


  Access Paper or Ask Questions

A Dynamical Systems Approach for Static Evaluation in Go


Aug 21, 2011
Thomas Wolf

* IEEE Transactions on Computational Intelligence and AI in Games, vol 3 (2011), no 2 

  Access Paper or Ask Questions

Optimizing GoTools' Search Heuristics using Genetic Algorithms


Feb 02, 2003
Matthew Pratola, Thomas Wolf

* 23 pages, to appear in Journal of ICGA 

  Access Paper or Ask Questions