Home/Researchers/Kristina Toutanova

Researcher Profile

Kristina Toutanova

Bidirectional transformer pretraining (BERT)

Co-author, BERT

Co-authored BERT: a turning point for transfer learning in NLP.

About This Page

This profile is meant to help you get oriented quickly: why this researcher matters, what to read first, and where to explore next.

Known For

The ideas, systems, and research directions that make this person worth knowing.

01

Bidirectional transformer pretraining (BERT)

02

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

03

BERT

04

NLP

05

Pretraining

Start Here

Canonical papers, project pages, or repositories that anchor this profile.

Related Researchers

People worth exploring next because they share topics, labs, or source material with this profile.

Shared topics

Llion Jones

Transformers

3 sources

A foundational transformer co-author who is now worth following for a very different reason: he is one of the few people trying to build a serious frontier lab around alternatives to the default scaling path.

Start HereAbout Sakana AI

Shared topics

Niki Parmar

Transformers and sequence modeling

3 sources

A foundational transformer researcher whose work still matters because it connects the original architecture shift to later efforts on efficiency, scaling, and sequence modeling infrastructure.