Alert button

vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations

Add code
Bookmark button
Alert button
Oct 12, 2019
Alexei Baevski, Steffen Schneider, Michael Auli

Figure 1 for vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
Figure 2 for vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
Figure 3 for vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
Figure 4 for vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

We propose vq-wav2vec to learn discrete representations of audio segments through a wav2vec-style self-supervised context prediction task. The algorithm uses either a gumbel softmax or online k-means clustering to quantize the dense representations. Discretization enables the direct application of algorithms from the NLP community which require discrete inputs. Experiments show that BERT pre-training achieves a new state of the art on TIMIT phoneme classification and WSJ speech recognition.

View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon