Dani Yogatama

Career

Yogatama received a PhD from Carnegie Mellon University (2010 to 2015), advised by Noah Smith as a member of Noah's ARK. Yogatama then worked at the Baidu Silicon Valley AI Lab (2015 to 2016) and at DeepMind (2016 to 2022), where Yogatama was a senior staff research scientist.¹

Yogatama is now a co-founder and the CEO of Reka, and an associate professor of computer science at the University of Southern California.¹

Research

Publications and news listed on Yogatama's site include work on semiparametric language models, random feature attention (ICLR 2021), episodic memory, and the cross-lingual transferability of monolingual representations (ACL 2020).¹³

At Reka, Yogatama co-authored the 2024 technical report on Reka Core, Flash and Edge, multimodal language models trained from scratch that take text, image, video and audio inputs.²

Work and contributions

• Reka Flash Published research

  Co-author of "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" (2024), the Reka Team technical report describing the training and evaluation of the Reka Flash model and its siblings.²

• Random Feature Attention Published research

  Co-author, with Hao Peng, Nikolaos Pappas, Roy Schwartz, Noah Smith and Lingpeng Kong, of the 2021 paper on random feature attention, which Yogatama's site notes was accepted to ICLR 2021 as a spotlight presentation.³¹

Timeline

1. 2010Began a PhD at Carnegie Mellon University, advised by Noah Smith.¹
2. 2015Completed the CMU PhD and joined the Baidu Silicon Valley AI Lab.¹
3. 2016Joined DeepMind, later serving as a senior staff research scientist until 2022.¹
4. Apr 2020Had a paper on the cross-lingual transferability of monolingual representations accepted to ACL 2020.¹
5. Mar 2021Posted Random Feature Attention as a co-author; the paper was accepted to ICLR 2021 as a spotlight presentation.³¹
6. Apr 2024Co-authored the Reka technical report introducing Reka Core, Flash and Edge.²

Other documented roles

Roles the sources document that are not confirmed as current.

• Senior staff research scientist (2016 to 2022), DeepMind¹
• Researcher (2015 to 2016), Baidu Silicon Valley AI Lab¹

Where they work

• Reka 1 person in the wiki
• University of Southern California 2 people in the wiki

Related people

• Armen AghajanyanMultimodal models · Language models
• Shruthan RadhakrishnaLanguage models · Multimodal models
• Jianfeng GaoLanguage models · Multimodal models
• Douwe KielaLanguage models · Multimodal models
• Sasha ShengLanguage models · Multimodal models
• Sathwik Tejaswi MadhusudhanLanguage models · Multimodal models
• Ali FarhadiMultimodal models · Language models
• Jyoti AnejaMultimodal models · Language models
• Victor SanhLanguage models · Multimodal models
• Xiaodong HeMultimodal models · Language models