Y. Lin, S. Han, H. Mao, Y. Wang, and W. Dally. (2017)cite arxiv:1712.01887Comment: we find 99.9% of the gradient exchange in distributed SGD is redundant; we reduce the communication bandwidth by two orders of magnitude without losing accuracy.
R. Bommakanti, G. Bokoch, J. Tolley, R. Schreiber, D. Siemsen, K. Klotz, and A. Jesaitis. J Biol Chem, 267 (11):
7576-81(April 1992)Bommakanti, R K Bokoch, G M Tolley, J O Schreiber, R E Siemsen, D
W Klotz, K N Jesaitis, A J R01-AI22735/AI/NIAID NIH HHS/United States
R01-GM39434/GM/NIGMS NIH HHS/United States Research Support, Non-U.S.
Gov't Research Support, U.S. Gov't, P.H.S. United states The Journal
of biological chemistry J Biol Chem. 1992 Apr 15;267(11):7576-81..