Mohammad Shoeybi
Source-listed: Senior Research Scientist; manages the NLP team · NVIDIA
Record snapshot: Sep 3, 2026. Coverage and affiliations may be incomplete or historical.
Selected work
5- Megatron-LM: Training Multi-Billion Parameter Language Models Using Model ParallelismSaved credit: Contributor · 2019Explore people connected to this work →
- Megatron-LM (GitHub)Saved credit: ContributorExplore people connected to this work →
- Compact Language Models via Pruning and Knowledge DistillationSaved credit: Contributor · 2024Explore people connected to this work →
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetSaved credit: Contributor · 2024Explore people connected to this work →
- RLP: Reinforcement as a Pretraining ObjectiveSaved credit: Contributor · 2026Explore people connected to this work →