The authors of Distributed SLIDE: Enabling Training Large Neural Networks on Low Bandwidth and Simple CPU-Clusters via Model Parallelism and Sparsity have not publicly listed the code yet.
Request code directly from the authors:
Get an expert to implement this paper:
(OR if you have code to share with the community, please add it here 😊🙏 )