FRDCSA
Minor
Internal
External
Git
Packages
GPT2
Jump To:
Parent Description
An implementation of training for [
GPT2
](https://openai.com/blog/better-language-models/) that supports both GPUs and TPUs.
The dataset scripts are a bit hacky and will probably need to be adapted to your needs.
## Requirements For GPUs: