Builders & open source
Paolo Glorioso
First author of Zyphra's Zamba and Zamba2 technical reports on hybrid state-space language models
Paolo Glorioso is the first author of the technical reports for Zamba (2024), a 7B model that combines a Mamba backbone with a shared attention module, and for the Zamba2 suite (2024) of 1.2B, 2.7B and 7.4B hybrid models, both released with open weights by Zyphra. Glorioso is also listed as an author of Zyphra's 2024 posts on the Zyda pretraining dataset, the Zyphra training cookbook, and the layer-pruning study "The Unreasonable Ineffectiveness of the Deeper Layers".12345
At a glance
- Current role
- None confirmed in the sources
- Fields
- Language models, Training systems
- Work listed
- 2
- Sources cited
- 9
- Profile reviewed
Research
Glorioso is first-listed author of Zyphra's Zamba report, posted in May 2024, and the Zamba2 suite report, posted in November 2024. Zamba applies one shared attention block across a Mamba backbone, and Zamba2 replaces the Mamba1 blocks with Mamba2 blocks and uses two shared attention blocks.126
Glorioso also appears as an author on Zyphra's 2024 releases of Zamba2-small and Zamba2-mini, on the Zyda dataset post, on the Zyphra training cookbook, and, with collaborators from Sequoia Capital, MIT, Meta FAIR and Cisco, on a study of pruning the deeper layers of language models.78345
Work and contributions
Zamba Open weights
First author of the Zamba technical report, which presents a 7B SSM-transformer hybrid trained on openly available datasets and releases its weights and checkpoints.19
Zamba2-7B Open weights
First author of the Zamba2 suite technical report, which documents the Zamba2 models up to 7.4B parameters and the Zyda-2 pretraining dataset.2
Timeline
- Listed as an author of Zyphra's post on "The Unreasonable Ineffectiveness of the Deeper Layers".5
- Was first-listed author of Zyphra's release of the Zamba 7B model.9
- Posted the Zamba technical report on arXiv as first author.1
- Was first-listed author of Zyphra's Zamba2-small (2.7B) release.7
- Posted the Zamba2 suite technical report on arXiv as first author.2
Documented roles
The sources do not confirm a current role; these are the roles they document.
Companies in their history
- Zyphra 4 people in the wiki
Related people
- Beren MillidgeConnected to Zyphra
- Krithik PuthalathConnected to Zyphra
- Hassan ShapourianConnected to Zyphra
- Luke ZettlemoyerLanguage models · Training systems
- Dirk GroeneveldTraining systems · Language models
- Naveen RaoTraining systems · Language models
- Bryan CatanzaroLanguage models · Training systems
- Noam ShazeerLanguage models · Training systems
- Sam McCandlishTraining systems · Language models
- Jeff DeanTraining systems · Language models
Suggest a correction or removal
Profiles cover public professional work only, and each statement cites a source. If something is out of date, missing or wrong, tell us and link a source. People can also ask for their profile to be corrected or removed.
References
9 sources · profile reviewed Oct 22, 2026 · data updated Oct 22, 2026