Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies.

S. Song, B. Kruft, M. Zhang, C. Li, S. Chen, C. Zhang, M. Tanaka, X. Wu, J. Rasley, A. Awan, C. Holmes, M. Cai, A. Ghanem, Z. Zhou, Y. He, P. Luferenko, D. Kumar, J. Weyn, R. Zhang, S. Klocek, V. Vragov, M. AlQuraishi, G. Ahdritz, C. Floristean, C. Negri, R. Kotamarthi, V. Vishwanath, A. Ramanathan, S. Foreman, K. Hippe, T. Arcomano, R. Maulik, M. Zvyagin, A. Brace, B. Zhang, C. Bohorquez, A. Clyde, B. Kale, D. Perez-Rivera, H. Ma, C. Mann, M. Irvin, J. Pauloski, L. Ward, V. Hayot-Sasson, M. Emani, Z. Xie, D. Lin, M. Shukla, I. Foster, J. Davis, M. Papka, T. Brettin, P. Balaprakash, G. Tourassi, J. Gounley, H. Hanson, T. Potok, M. Pasini, K. Evans, D. Lu, D. Lunga, J. Yin, S. Dash, F. Wang, M. Shankar, I. Lyngaas, X. Wang, G. Cong, P. Zhang, M. Fan, S. Liu, A. Hoisie, S. Yoo, Y. Ren, W. Tang, K. Felker, A. Svyatkovskiy, H. Liu, A. Aji, A. Dalton, M. Schulte, K. Schulz, Y. Deng, W. Nie, J. Romero, C. Dallago, A. Vahdat, C. Xiao, T. Gibbs, A. Anandkumar, and R. Stevens. CoRR, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Ammar Ahmad

Ammar Ammar

Maha Ammar

Normah Awang Besar Raffie

Usman Khalid Awan

Other publications of authors with the same name

Exploiting Hardware Multicast and GPUDirect RDMA for Efficient Broadcast.C. Chu, X. Lu, A. Awan, H. Subramoni, B. Elton, and D. Panda. IEEE Trans. Parallel Distributed Syst., 30 (3): 575-588 (2019)Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?A. Awan, C. Chu, H. Subramoni, and D. Panda. CoRR, (2017)A Novel Tensor-Expert Hybrid Parallelism Approach to Scale Mixture-of-Experts Training.S. Singh, O. Ruwase, A. Awan, S. Rajbhandari, Y. He, and A. Bhatele. CoRR, (2023)1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence Speed.C. Li, A. Awan, H. Tang, S. Rajbhandari, and Y. He. HIPC, page 272-281. IEEE, (2022)OC-DNN: Exploiting Advanced Unified Memory Capabilities in CUDA 9 and Volta GPUs for Out-of-Core DNN Training.A. Awan, C. Chu, H. Subramoni, X. Lu, and D. Panda. HiPC, page 143-152. IEEE, (2018)Efficient and Scalable Multi-Source Streaming Broadcast on GPU Clusters for Deep Learning.C. Chu, X. Lu, A. Awan, H. Subramoni, J. Hashmi, B. Elton, and D. Panda. ICPP, page 161-170. IEEE Computer Society, (2017)An In-depth Performance Characterization of CPU- and GPU-based DNN Training on Modern Architectures.A. Awan, H. Subramoni, and D. Panda. MLHPC@SC, page 8:1-8:8. ACM, (2017)Intercloud message exchange middleware.M. Amin, W. Khan, A. Awan, and S. Lee. ICUIMC, page 79:1-79:7. ACM, (2012)Communication Profiling and Characterization of Deep-Learning Workloads on Clusters With High-Performance Interconnects.A. Awan, A. Jain, C. Chu, H. Subramoni, and D. Panda. IEEE Micro, 40 (1): 35-43 (2020)DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales.Z. Yao, R. Aminabadi, O. Ruwase, S. Rajbhandari, X. Wu, A. Awan, J. Rasley, M. Zhang, C. Li, C. Holmes and 9 other author(s). CoRR, (2023)

BibSonomy

Disambiguation of "Awan, Ammar Ahmad"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies.

Please choose a person to relate this publication to

Ammar Ahmad

Ammar Ammar

Maha Ammar

Normah Awang Besar Raffie

Usman Khalid Awan

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Awan, Ammar Ahmad"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies.

Please choose a person to relate this publication to

Ammar Ahmad

Ammar Ammar

Maha Ammar

Normah Awang Besar Raffie

Usman Khalid Awan

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies.