Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


An MPI-Based Python Framework for Distributed Training with Keras

Dec 16, 2017
Dustin Anderson, Jean-Roch Vlimant, Maria Spiropulu



We present a lightweight Python framework for distributed training of neural networks on multiple GPUs or CPUs. The framework is built on the popular Keras machine learning library. The Message Passing Interface (MPI) protocol is used to coordinate the training process, and the system is well suited for job submission at supercomputing sites. We detail the software's features, describe its use, and demonstrate its performance on systems of varying sizes on a benchmark problem drawn from high-energy physics research.

* 4 pages, 4 figures, 1 table, [email protected], SC17 


Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: