AI People Wiki

Builders & open source

Samuel Marks

Member of Technical Staff; leads the Cognitive Oversight subteam of the Alignment Science team, Anthropic

  • Member of Technical Staff; leads the Cognitive Oversight subteam of the Alignment Science team, Anthropic124

Samuel Marks is a Member of Technical Staff at Anthropic and leads the Cognitive Oversight subteam of its Alignment Science team, which aims to oversee AI systems by examining the cognitive processes behind their behavior rather than only their inputs and outputs. Marks is first author and a core research contributor of "Auditing language models for hidden objectives" (2025), whose authors conducted the work at Anthropic; the study trains a model with a hidden objective and runs a blind auditing game to test whether teams can uncover it. Earlier, Marks was a postdoc at Northeastern University under David Bau, and co-authored the paper describing the NNsight library and the National Deep Inference Fabric as well as a survey of open problems in reinforcement learning from human feedback.1234567

At a glance

Current role
Member of Technical Staff; leads the Cognitive Oversight subteam of the Alignment Science team
Company
Anthropic
Sector
Company
Education
Harvard
Work listed
3
Sources cited
10
Profile reviewed

Career

Marks's Harvard page records a PhD from Harvard in May 2023 in mathematics, on p-adic Hodge theory and prismatic cohomology under Mark Kisin, before a shift to machine learning and the mechanistic interpretability of large language models. Marks then worked as a postdoc at Northeastern University under David Bau.5

At Anthropic, Marks is a Member of Technical Staff and leads the Cognitive Oversight subteam of the Alignment Science team. The MATS program lists Marks as a mentor for its Anthropic streams in 2026 and 2027, with focus areas in AI control and monitoring, misalignment science, and interpretability.12

Research

The Cognitive Oversight subteam aims to oversee AI systems by checking whether anything is suspicious in the cognitive processes behind their behavior, such as detecting when a language model is lying, using both interpretability-based white-box methods and black-box interrogation of models. Marks's 2025 study on auditing language models for hidden objectives trained a model to exploit errors in RLHF reward models and tested whether auditing teams could uncover that objective.134

Earlier interpretability papers by Marks include "The Geometry of Truth" with Max Tegmark, which studies how language models represent the truth of simple true/false statements, and "Sparse Feature Circuits", which introduces methods for finding and editing causal subnetworks of human-interpretable features. In 2026 Marks co-authored CHIVE, an agentic pipeline that finds unexpected model behaviors and explains them with counterfactual prompt edits.892

Open-source work

Marks is a co-author of the paper introducing NNsight, an open-source system that extends PyTorch with deferred remote execution, and the National Deep Inference Fabric, an inference service that runs NNsight requests on shared GPUs and pretrained models.106

Work and contributions

Timeline

  1. Completed a PhD in mathematics at Harvard, studying p-adic Hodge theory under Mark Kisin.5
  2. Co-authored a survey of open problems and fundamental limitations of RLHF.7
  3. Released "The Geometry of Truth" with Max Tegmark, on how language models represent true and false statements.8
  4. Released "Sparse Feature Circuits" as first author, with co-authors including David Bau.9
  5. Co-authored the paper introducing NNsight and the National Deep Inference Fabric.10
  6. Released "Auditing language models for hidden objectives" as first author, with work conducted at Anthropic.34
  7. Co-authored the CHIVE study on explaining language-model behavior with counterfactual experiments.2

Other documented roles

Roles the sources document that are not confirmed as current.

  • Postdoc under David Bau, Northeastern University5

Where they work

Suggest a correction or removal

Profiles cover public professional work only, and each statement cites a source. If something is out of date, missing or wrong, tell us and link a source. People can also ask for their profile to be corrected or removed.

References

10 sources · profile reviewed Oct 21, 2026 · data updated Oct 21, 2026

  1. Samuel Marks — MATS mentor page (Anthropic, Member of Technical Staff)MATS · Official page · accessed Oct 21, 2026
  2. Would This Change Your Answer? Evaluating Explanations of LLM Behavior in the Wild with Counterfactual Experiments (Anthropic Alignment Science Blog; author affiliation Anthropic)Anthropic · Official page · published Aug 21, 2026 · accessed Oct 21, 2026
  3. Auditing language models for hidden objectives (arXiv 2503.10965)arXiv · Paper · published Mar 14, 2025 · accessed Oct 21, 2026
  4. Auditing language models for hidden objectives — arXiv HTML (v2, authors and affiliations)arXiv · Paper · published Mar 28, 2025 · accessed Oct 21, 2026
  5. Samuel Marks — Harvard Mathematics pageSamuel Marks · Official page · accessed Oct 21, 2026
  6. ndif-team/nnsight README and citation (MIT license)NDIF team (GitHub repository) · Repository · accessed Oct 21, 2026
  7. Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback (arXiv 2307.15217)arXiv · Paper · published Jul 27, 2023 · accessed Oct 21, 2026
  8. The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets (arXiv 2310.06824)arXiv · Paper · published Oct 10, 2023 · accessed Oct 21, 2026
  9. Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models (arXiv 2403.19647)arXiv · Paper · published Mar 28, 2024 · accessed Oct 21, 2026
  10. NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals (arXiv 2407.14561)arXiv · Paper · published Jul 18, 2024 · accessed Oct 21, 2026