Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.

A. Komatsuzaki, J. Puigcerver, J. Lee-Thorp, C. Ruiz, B. Mustafa, J. Ainslie, Y. Tay, M. Dehghani, and N. Houlsby. ICLR, OpenReview.net, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Daniel Thorpe

Michael James

Audrein James

Katherine James

Ammini James-Mammoottil

Other publications of authors with the same name

Scaling Up Models and Data with t5x and seqio.A. Roberts, H. Chung, G. Mishra, A. Levskaya, J. Bradbury, D. Andor, S. Narang, B. Lester, C. Gaffney, A. Mohiuddin and 35 other author(s). J. Mach. Learn. Res., (2023)ShopTalk: A System for Conversational Faceted Search.G. Manku, J. Lee-Thorp, B. Kanagal, J. Ainslie, J. Feng, Z. Pearson, E. Anjorin, S. Gandhe, I. Eckstein, J. Rosswog and 4 other author(s). CoRR, (2021)FNet: Mixing Tokens with Fourier Transforms.J. Lee-Thorp, J. Ainslie, I. Eckstein, and S. Ontañón. NAACL-HLT, page 4296-4313. Association for Computational Linguistics, (2022)Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT.J. Lee-Thorp, and J. Ainslie. EMNLP (Findings), page 58-75. Association for Computational Linguistics, (2022)GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints.J. Ainslie, J. Lee-Thorp, M. de Jong, Y. Zemlyanskiy, F. Lebrón, and S. Sanghai. EMNLP, page 4895-4901. Association for Computational Linguistics, (2023)Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.A. Komatsuzaki, J. Puigcerver, J. Lee-Thorp, C. Ruiz, B. Mustafa, J. Ainslie, Y. Tay, M. Dehghani, and N. Houlsby. ICLR, OpenReview.net, (2023)Memory Augmented Language Models through Mixture of Word Experts.C. dos Santos, J. Lee-Thorp, I. Noble, C. Chang, and D. Uthus. NAACL-HLT, page 4425-4438. Association for Computational Linguistics, (2024)FNet: Mixing Tokens with Fourier Transforms.J. Lee-Thorp, J. Ainslie, I. Eckstein, and S. Ontañón. CoRR, (2021)Memory Augmented Language Models through Mixture of Word Experts.C. dos Santos, J. Lee-Thorp, I. Noble, C. Chang, and D. Uthus. CoRR, (2023)CoLT5: Faster Long-Range Transformers with Conditional Computation.J. Ainslie, T. Lei, M. de Jong, S. Ontañón, S. Brahma, Y. Zemlyanskiy, D. Uthus, M. Guo, J. Lee-Thorp, Y. Tay and 2 other author(s). EMNLP, page 5085-5100. Association for Computational Linguistics, (2023)

BibSonomy

Disambiguation of "Lee-Thorp, James"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.

Please choose a person to relate this publication to

Daniel Thorpe

Michael James

Audrein James

Katherine James

Ammini James-Mammoottil

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Lee-Thorp, James"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.

Please choose a person to relate this publication to

Daniel Thorpe

Michael James

Audrein James

Katherine James

Ammini James-Mammoottil

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.