Matt Deitke

Career

Deitke worked as a research scientist at Ai2 while completing undergraduate and doctoral studies at the University of Washington's Allen School, where Deitke's PhD work was with Ali Farhadi. Deitke later co-founded Vercept, a company building computer-use agents, and is now an AI researcher at Meta, leading a data pod.¹

Research

Deitke's work at Ai2 included ProcTHOR (2022), which used procedural generation to scale the diversity of simulated environments for embodied AI, and Objaverse (2022), a dataset of annotated 3D objects. Deitke's site notes that ProcTHOR received an Outstanding Paper Award at NeurIPS 2022.³⁴¹

With Christopher Clark, Deitke is co-first author of the Molmo and PixMo paper (2024), which released open vision-language models together with new caption, question-answer and pointing datasets collected without the use of external vision-language models; the paper received a CVPR 2025 Best Paper Honorable Mention.²¹

Work and contributions

• Molmo Open weights

  First-listed co-first author, with Christopher Clark, of the Molmo and PixMo paper introducing the Molmo open vision-language models and the PixMo datasets.²¹

• ProcTHOR Published research

  First author of the paper on scaling embodied AI with procedurally generated houses.³

• Objaverse Open data

  First author of the paper introducing Objaverse, a dataset of annotated 3D objects.⁴

Timeline

1. Jun 2022Posted ProcTHOR, on large-scale embodied AI using procedural generation, as first author.³
2. Nov 2022ProcTHOR received an Outstanding Paper Award at NeurIPS 2022.¹
3. Dec 2022Posted Objaverse, a dataset of annotated 3D objects, as first author.⁴
4. Sep 2024Posted the Molmo and PixMo paper as co-first author with Christopher Clark.²
5. Nov 2024Announced the co-founding of Vercept, focused on computer-use agents.¹
6. Jun 2025The Molmo and PixMo paper received a Best Paper Honorable Mention at CVPR 2025.¹

Other documented roles

Roles the sources document that are not confirmed as current.

• Research scientist (past), Allen Institute for AI (Ai2)¹

Honors and recognition

• NeurIPS Outstanding Paper Award (ProcTHOR) · Conference on Neural Information Processing Systems (NeurIPS), 2022¹
• CVPR Best Paper Honorable Mention (Molmo and PixMo) · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025¹

Where they work

• Meta 106 people in the wiki

Related people

• Christoph FeichtenhoferAlso at Meta
• Alexander KirillovAlso at Meta
• Piotr DollárAlso at Meta
• Saining XieAlso at Meta
• Matthijs DouzeAlso at Meta
• Fei-Fei LiComputer vision · Datasets and data
• Bin XiaoComputer vision · Multimodal models
• Fartash FaghriMultimodal models · Datasets and data
• Shusheng YangMultimodal models · Computer vision
• Alexander ToshevComputer vision · Datasets and data