GLM is a General Language Model pretrained with an autoregressive blank-filling objective. It can be finetuned on various natural language understanding and generation tasks. The code is based on Megatron-LM and PET. You can download the pretrained models used in the paper here.
Share this post