An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Open sourceIndependent project
Inspect repositories, licenses, activity, and alternatives across the Language Model ecosystem.
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries