Inproceedings,

Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers.

, , , and .
ICML, volume 162 of Proceedings of Machine Learning Research, page 13782-13792. PMLR, (2022)

Meta data

Tags

Users

  • @dblp

Comments and Reviews