group :: ai_dl_club | BibSonomy

bookmarks (hide)1
display
all
bookmarks only
bookmarks per page
5
10
20
50
100
sort by
added at
title
RSS
BibTeX
XML

1Introduction to Distributed Training of Neural Networks
https://blog.skymind.ai/distributed-deep-learning-part-1-an-introduction-to-distributed-training-of-neural-networks/
7 years ago by @straybird321
show all tags
distributed
distributed
copydelete
- community post
- history of this post

⟨⟨
⟨
1
⟩
⟩⟩

publications (hide)1
display
all
publications only
publications per page
5
10
20
50
100
sort by
added at
title
author
publication date
entry type
help for advanced sorting...
RSS
BibTeX
RDF
more...

3Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Y. Lin, S. Han, H. Mao, Y. Wang, and W. Dally. (2017)cite arxiv:1712.01887Comment: we find 99.9% of the gradient exchange in distributed SGD is redundant; we reduce the communication bandwidth by two orders of magnitude without losing accuracy.
7 years ago by @straybird321
show all tags
computing
Distributed
SGD
compression
computingDistributedSGDcompression
copydeleteadd this publication to your clipboard

⟨⟨
⟨
1
⟩
⟩⟩