An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Open sourceIndependent project
Inspect repositories, licenses, activity, and alternatives across the Transformers ecosystem.
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries