The seminal paper introducing the Transformer model, which has become central to many state-of-the-art NLP models.
Last Updated: May 2026
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
VerifiedIntroduction of BERT, a new method for pre-training language representations that achieve state-of-the-art results on a variety of NLP tasks.
BERT model for language understanding
At a glance
- Primary category: Research
- Best for: users who want a more specialized AI chat experience
Quick take
Introduction of BERT, a new method for pre-training language representations that achieve state-of-the-art results on a variety of NLP tasks.
Top BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Alternatives
Attention Is All You NeedThe seminal paper introducing the Transformer model, which has become central to many state-of-the-art NLP models.
Generative Pretrained Transformer 3 (GPT-3)The third-generation model in the GPT-n series by OpenAI, showcasing the power of scaling up language models.
GPT-3: Language Models are Few-Shot LearnersDetails the development and capabilities of GPT-3, illustrating its few-shot learning ability across diverse tasks.
More Research
The third-generation model in the GPT-n series by OpenAI, showcasing the power of scaling up language models.
Details the development and capabilities of GPT-3, illustrating its few-shot learning ability across diverse tasks.
Describes Google's Pathways, proposing an innovative approach to scaling AI models and systems asynchronously.
Introduces EfficientNet, a systematic method for scaling CNN architectures, achieving state-of-the-art accuracy with significantly reduced parameters.
Presents DALL·E, a model that generates diverse and detailed images from textual descriptions, demonstrating the intersection of language understanding and visual creativity.
Introduces the T5 model, showcasing its versatility across multiple NLP tasks through a unified framework for text-to-text processing.
Details the AlphaFold system by DeepMind, which made significant breakthroughs in protein folding, impacting biological sciences.
Reviews the application of AI in generating game content, emphasizing the role of machine learning in creative processes.
Explores the potential of quantum machine learning to revolutionize 6G communication networks, highlighting future research directions.