Builders & open source
Samuel Marks
Member of Technical Staff; leads the Cognitive Oversight subteam of the Alignment Science team, Anthropic
- Member of Technical Staff; leads the Cognitive Oversight subteam of the Alignment Science team, Anthropic124
Samuel Marks is a Member of Technical Staff at Anthropic and leads the Cognitive Oversight subteam of its Alignment Science team, which aims to oversee AI systems by examining the cognitive processes behind their behavior rather than only their inputs and outputs. Marks is first author and a core research contributor of "Auditing language models for hidden objectives" (2025), whose authors conducted the work at Anthropic; the study trains a model with a hidden objective and runs a blind auditing game to test whether teams can uncover it. Earlier, Marks was a postdoc at Northeastern University under David Bau, and co-authored the paper describing the NNsight library and the National Deep Inference Fabric as well as a survey of open problems in reinforcement learning from human feedback.1234567
At a glance
- Current role
- Member of Technical Staff; leads the Cognitive Oversight subteam of the Alignment Science team
- Company
- Anthropic
- Sector
- Company
- Education
- Harvard
- Work listed
- 3
- Sources cited
- 10
- Profile reviewed
Career
Marks's Harvard page records a PhD from Harvard in May 2023 in mathematics, on p-adic Hodge theory and prismatic cohomology under Mark Kisin, before a shift to machine learning and the mechanistic interpretability of large language models. Marks then worked as a postdoc at Northeastern University under David Bau.5
At Anthropic, Marks is a Member of Technical Staff and leads the Cognitive Oversight subteam of the Alignment Science team. The MATS program lists Marks as a mentor for its Anthropic streams in 2026 and 2027, with focus areas in AI control and monitoring, misalignment science, and interpretability.12
Research
The Cognitive Oversight subteam aims to oversee AI systems by checking whether anything is suspicious in the cognitive processes behind their behavior, such as detecting when a language model is lying, using both interpretability-based white-box methods and black-box interrogation of models. Marks's 2025 study on auditing language models for hidden objectives trained a model to exploit errors in RLHF reward models and tested whether auditing teams could uncover that objective.134
Earlier interpretability papers by Marks include "The Geometry of Truth" with Max Tegmark, which studies how language models represent the truth of simple true/false statements, and "Sparse Feature Circuits", which introduces methods for finding and editing causal subnetworks of human-interpretable features. In 2026 Marks co-authored CHIVE, an agentic pipeline that finds unexpected model behaviors and explains them with counterfactual prompt edits.892
Open-source work
Marks is a co-author of the paper introducing NNsight, an open-source system that extends PyTorch with deferred remote execution, and the National Deep Inference Fabric, an inference service that runs NNsight requests on shared GPUs and pretrained models.106
Work and contributions
Auditing language models for hidden objectives Published research
First author and core research contributor of the 2025 study, which trains a language model with a hidden objective, runs a blind auditing game in which four teams investigate it, and then compares eight auditing techniques.34
NNsight and NDIF Open-source code
Listed as a co-author in the nnsight repository's citation for "NNsight and NDIF: Democratizing Access to Foundation Model Internals"; the repository is released under the MIT license.6
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback Published research
Co-author of the 2023 survey of open problems and limitations of RLHF and related methods.75
Timeline
- Completed a PhD in mathematics at Harvard, studying p-adic Hodge theory under Mark Kisin.5
- Co-authored a survey of open problems and fundamental limitations of RLHF.7
- Released "The Geometry of Truth" with Max Tegmark, on how language models represent true and false statements.8
- Released "Sparse Feature Circuits" as first author, with co-authors including David Bau.9
- Co-authored the paper introducing NNsight and the National Deep Inference Fabric.10
- Released "Auditing language models for hidden objectives" as first author, with work conducted at Anthropic.34
- Co-authored the CHIVE study on explaining language-model behavior with counterfactual experiments.2
Other documented roles
Roles the sources document that are not confirmed as current.
- Postdoc under David Bau, Northeastern University5
Where they work
- Anthropic 34 people in the wiki
Related people
- Arthur ConmyAlso at Anthropic
- Neel NandaAlso at Anthropic
- Chris OlahAlso at Anthropic
- Evan HubingerAlso at Anthropic
- Collin BurnsAlso at Anthropic
- Kenneth LiInterpretability · Language models
- Yulia TsvetkovLanguage models · Safety and alignment
- Jacob SteinhardtSafety and alignment · Interpretability
- Sameer SinghInterpretability · Language models
- Aylin CaliskanSafety and alignment · Language models
Suggest a correction or removal
Profiles cover public professional work only, and each statement cites a source. If something is out of date, missing or wrong, tell us and link a source. People can also ask for their profile to be corrected or removed.
References
10 sources · profile reviewed Oct 21, 2026 · data updated Oct 21, 2026
- Samuel Marks — MATS mentor page (Anthropic, Member of Technical Staff)
- Would This Change Your Answer? Evaluating Explanations of LLM Behavior in the Wild with Counterfactual Experiments (Anthropic Alignment Science Blog; author affiliation Anthropic)
- Auditing language models for hidden objectives (arXiv 2503.10965)
- Auditing language models for hidden objectives — arXiv HTML (v2, authors and affiliations)
- Samuel Marks — Harvard Mathematics page
- ndif-team/nnsight README and citation (MIT license)
- Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback (arXiv 2307.15217)
- The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets (arXiv 2310.06824)
- Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models (arXiv 2403.19647)
- NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals (arXiv 2407.14561)