Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed.

H. Tang, S. Gan, A. Awan, S. Rajbhandari, C. Li, X. Lian, J. Liu, C. Zhang, and Y. He. ICML, volume 139 of Proceedings of Machine Learning Research, page 10118-10129. PMLR, (2021)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Ammar Ahmad

Ammar Ammar

Maha Ammar

Normah Awang Besar Raffie

Usman Khalid Awan

Other publications of authors with the same name

Exploiting Hardware Multicast and GPUDirect RDMA for Efficient Broadcast.C. Chu, X. Lu, A. Awan, H. Subramoni, B. Elton, and D. Panda. IEEE Trans. Parallel Distributed Syst., 30 (3): 575-588 (2019)Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?A. Awan, C. Chu, H. Subramoni, and D. Panda. CoRR, (2017)A Novel Tensor-Expert Hybrid Parallelism Approach to Scale Mixture-of-Experts Training.S. Singh, O. Ruwase, A. Awan, S. Rajbhandari, Y. He, and A. Bhatele. CoRR, (2023)1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence Speed.C. Li, A. Awan, H. Tang, S. Rajbhandari, and Y. He. HIPC, page 272-281. IEEE, (2022)OC-DNN: Exploiting Advanced Unified Memory Capabilities in CUDA 9 and Volta GPUs for Out-of-Core DNN Training.A. Awan, C. Chu, H. Subramoni, X. Lu, and D. Panda. HiPC, page 143-152. IEEE, (2018)Efficient and Scalable Multi-Source Streaming Broadcast on GPU Clusters for Deep Learning.C. Chu, X. Lu, A. Awan, H. Subramoni, J. Hashmi, B. Elton, and D. Panda. ICPP, page 161-170. IEEE Computer Society, (2017)Intercloud message exchange middleware.M. Amin, W. Khan, A. Awan, and S. Lee. ICUIMC, page 79:1-79:7. ACM, (2012)An In-depth Performance Characterization of CPU- and GPU-based DNN Training on Modern Architectures.A. Awan, H. Subramoni, and D. Panda. MLHPC@SC, page 8:1-8:8. ACM, (2017)DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales.Z. Yao, R. Aminabadi, O. Ruwase, S. Rajbhandari, X. Wu, A. Awan, J. Rasley, M. Zhang, C. Li, C. Holmes and 9 other author(s). CoRR, (2023)Communication Profiling and Characterization of Deep-Learning Workloads on Clusters With High-Performance Interconnects.A. Awan, A. Jain, C. Chu, H. Subramoni, and D. Panda. IEEE Micro, 40 (1): 35-43 (2020)

BibSonomy

Disambiguation of "Awan, Ammar Ahmad"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed.

Please choose a person to relate this publication to

Ammar Ahmad

Ammar Ammar

Maha Ammar

Normah Awang Besar Raffie

Usman Khalid Awan

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Awan, Ammar Ahmad"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML 1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed.

Please choose a person to relate this publication to

Ammar Ahmad

Ammar Ammar

Maha Ammar

Normah Awang Besar Raffie

Usman Khalid Awan

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed.