Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.

G. Wang, H. Qin, S. Jacobs, C. Holmes, S. Rajbhandari, O. Ruwase, F. Yan, L. Yang, and Y. He. CoRR, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Gang Qin

Minghao Qin

Qin Wang

Qin Li

Qi Qin

Other publications of authors with the same name

Swift machine learning model serving scheduling: a region based reinforcement learning approach.H. Qin, S. Zawad, Y. Zhou, L. Yang, D. Zhao, and F. Yan. SC, page 13:1-13:23. ACM, (2019)Nemo: An Open-Source Transformer-Supercharged Benchmark for Fine-Grained Wildfire Smoke Detection.A. Yazdi, H. Qin, C. Jordan, L. Yang, and F. Yan. Remote. Sens., 14 (16): 3979 (2022)SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement.H. Qin, S. Rajbhandari, O. Ruwase, F. Yan, L. Yang, and Y. He. NeurIPS, page 20531-20544. (2021)DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference.C. Holmes, M. Tanaka, M. Wyatt, A. Awan, J. Rasley, S. Rajbhandari, R. Aminabadi, H. Qin, A. Bakhtiari, L. Kurilenko and 1 other author(s). CoRR, (2024)ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.G. Wang, H. Qin, S. Jacobs, C. Holmes, S. Rajbhandari, O. Ruwase, F. Yan, L. Yang, and Y. He. CoRR, (2023)DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention.Z. Yao, X. Wu, C. Li, M. Zhang, H. Qin, O. Ruwase, A. Awan, S. Rajbhandari, and Y. He. CoRR, (2023)The Age of Correlated Features in Supervised Learning based Forecasting.M. Shisher, H. Qin, L. Yang, F. Yan, and Y. Sun. INFOCOM Workshops, page 1-8. IEEE, (2021)Reinforcement-Learning-Empowered MLaaS Scheduling for Serving Intelligent Internet of Things.H. Qin, S. Zawad, Y. Zhou, S. Padhi, L. Yang, and F. Yan. IEEE Internet Things J., 7 (7): 6325-6337 (2020)DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales.Z. Yao, R. Aminabadi, O. Ruwase, S. Rajbhandari, X. Wu, A. Awan, J. Rasley, M. Zhang, C. Li, C. Holmes and 9 other author(s). CoRR, (2023)Scalable and Efficient Machine Learning as a Service.H. Qin. University of Nevada, Reno, USA, (2022)base-search.net (ftunivnevadair:oai:scholarworks.unr.edu:11714/8388).

BibSonomy

Disambiguation of "Qin, Heyang"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.

Please choose a person to relate this publication to

Gang Qin

Minghao Qin

Qin Wang

Qin Li

Qi Qin

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Qin, Heyang"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.

Please choose a person to relate this publication to

Gang Qin

Minghao Qin

Qin Wang

Qin Li

Qi Qin

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.