Co-authored BERT: a turning point for transfer learning in NLP.
Researcher Profile
Kristina Toutanova
Bidirectional transformer pretraining (BERT)
Co-author, BERT
Co-authored BERT: a turning point for transfer learning in NLP.
About This Page
This profile is meant to help you get oriented quickly: why this researcher matters, what to read first, and where to explore next.
Last updated
March 20, 2026
Known For
The ideas, systems, and research directions that make this person worth knowing.
01
Bidirectional transformer pretraining (BERT)
02
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
03
BERT
04
NLP
05
Pretraining
Start Here
Canonical papers, project pages, or repositories that anchor this profile.
Related Researchers
People worth exploring next because they share topics, labs, or source material with this profile.
A core name in the pretraining era of NLP, especially if you want to understand how BERT reshaped the field and how that line of work extended into broader document understanding and large-scale language systems.
One of the most important architecture-level thinkers in modern AI, with influence spanning Transformers, efficient scaling, and mixture-of-experts systems.
A foundational figure in modern sequence modeling whose work on the Transformer changed the technical direction of language and multimodal systems.
A foundational transformer co-author who is now worth following for a very different reason: he is one of the few people trying to build a serious frontier lab around alternatives to the default scaling path.
A foundational transformer researcher whose work still matters because it connects the original architecture shift to later efforts on efficiency, scaling, and sequence modeling infrastructure.