3 sources
A useful profile for the less visible OpenAI work that sits between major model releases and the documents that try to characterize what those models can actually do.
Researcher Profile
Editor reviewedKatarina Slama
Instruction-following via RLHF (InstructGPT)
Contributor to OpenAI's instruction-following and preference-learning work
A useful page for the OpenAI preference-learning line, especially if you want to understand how the field moved from InstructGPT-era RLHF into later work on whether stated preferences actually predict model behavior.
Organizations
OpenAI
Labs
About This Page
This profile is meant to help you get oriented quickly: why this researcher matters, what to read first, and where to explore next.
Last reviewed
March 18, 2026
Known For
The ideas, systems, and research directions that make this person worth knowing.
01
InstructGPT
02
GPT-4
03
Preference-learning evaluation
04
Instruction-following via RLHF (InstructGPT)
05
Training language models to follow instructions with human feedback
06
OpenAI
Start Here
Canonical papers, project pages, or repositories that anchor this profile.
Supporting Sources
Additional links that help verify and flesh out this profile.
Related Researchers
People worth exploring next because they share topics, labs, or source material with this profile.
1 source
Co-authored the InstructGPT paper that set the standard instruction-tuning + RLHF recipe.
4 sources
A useful person to follow for the OpenAI thread that runs from dexterous robotics into later evaluation and capability-measurement work on large language models.
Start HereHindsight Experience Replay
4 sources
A high-signal person to follow for the evaluation and verification side of alignment, especially where language models are pushed to produce answers that can actually be checked rather than merely sounding plausible.
Start HereAlignment Research Center team
3 sources
Important for the product-and-systems side of OpenAI because his work spans the lab’s robotics era and later instruction-following language-model work.
3 sources
A useful person to follow for the connection between classic multi-agent RL and the human-feedback work that later fed into OpenAI’s instruction-following systems.