ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training – Microsoft Research
ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training – Microsoft Research — Lees op www.microsoft.com/en-us/research/blog/zero-infinity-and-deepspeed-unlocking-unprecedented-model-scale-for-deep-learning-training/