Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Training Speech Recognition Models with Federated Learning: A Quality/Cost Framework

Oct 29, 2020
Dhruv Guliani, Francoise Beaufays, Giovanni Motta

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data distributions, which are expected to negatively affect the quality of the trained model. We propose a framework by which the degree of non-IID-ness can be varied, consequently illustrating a trade-off between model quality and the computational cost of federated training, which we capture through a novel metric. Finally, we demonstrate that hyper-parameter optimization and appropriate use of variational noise are sufficient to compensate for the quality impact of non-IID distributions, while decreasing the cost.

* Paper submitted to ICASSP 2021 

Share this with someone who'll enjoy it:

   Access Paper Source

Share this with someone who'll enjoy it: