2 sources
Co-authored Megatron-LM: a core reference for scaling transformer training via model parallelism.
Researcher Profile
Bryan Catanzaro
Model-parallel training at scale (Megatron-LM)
Co-author, Megatron-LM
Co-authored Megatron-LM: a core reference for scaling transformer training via model parallelism.
Topics
About This Page
This profile is meant to help you get oriented quickly: why this researcher matters, what to read first, and where to explore next.
Last updated
March 20, 2026
Official And External Links
Known For
The ideas, systems, and research directions that make this person worth knowing.
01
Model-parallel training at scale (Megatron-LM)
02
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
03
Megatron-LM (GitHub)
04
Systems
05
Training
Start Here
Canonical papers, project pages, or repositories that anchor this profile.
Signature Works
Additional papers, projects, or repositories that help flesh out the profile.
Supporting Sources
Additional links that help verify and flesh out this profile.
Related Researchers
People worth exploring next because they share topics, labs, or source material with this profile.
2 sources
Co-authored Megatron-LM: a core reference for scaling transformer training via model parallelism.
2 sources
Co-authored Megatron-LM: a core reference for scaling transformer training via model parallelism.
2 sources
Co-authored Megatron-LM: a core reference for scaling transformer training via model parallelism.
1 source
Co-authored ZeRO: foundational memory optimizations for training very large models.
1 source
Co-authored ZeRO: foundational memory optimizations for training very large models.