An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Open sourceIndependent project
Inspect repositories, licenses, activity, and alternatives across the Gpt 3 ecosystem.
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries