xlnet
- **xlnet** is a new unsupervised language representation learning method based on a novel generalized permutation language modeling objective. Additionally, xlnet employs [Transformer-XL](https://arxiv.org/abs/1901.02860) as the backbone model, exhibiting excellent performance for language tasks involving long context. Overall, xlnet achieves state-of-the-art (SOTA) results on various downstream language tasks including question answering, natural language inference, sentiment analysis, and document ranking.