The Information Machine

Anthropic's Push to Broaden AI Values Input

open · v1 · 2026-05-20 · 2 items

What

Anthropic has launched a structured effort to broaden who has input into Claude's values and character, conducting dialogues with scholars from more than 15 religious and cross-cultural traditions [1]. The company is framing late-stage AI training as a question of moral character formation, not merely a technical optimization problem [2]. Alongside the outreach, Anthropic ran an internal experiment giving Claude a mid-task tool to recall its own ethical commitments, reporting markedly lower rates of misaligned behavior as a result [1]. Plans call for expanding engagement to legal scholars, psychologists, writers, and civic institutions [1].

Why it matters

If Anthropic's framing takes hold — that frontier AI behavior is a question of character requiring humanistic input — it shifts who legitimately gets a seat at the table in AI development from engineers and policymakers to a far wider set of voices. The ethical-reminder experiment also hints at a novel technical approach to alignment that blends procedural prompting with structured self-reflection, with implications for how other labs approach value-loading.

Open questions

  • How are the 15+ religious and cross-cultural traditions selected, and how are their inputs weighted or reconciled when they conflict? [1]

  • Is the reduction in misaligned behavior from the ethical-reminder tool driven by the content of the reminder or simply the act of pausing — and what happens when Anthropic publishes those results? [1]

  • Will outside scholars, clergy, and civic thinkers have binding influence over training decisions, or is this consultation advisory only? [1][2]

  • How does Anthropic plan to handle political viewpoints in the same pluralist framework it applies to religious and secular traditions? [1]

Narrative

Anthropic published a post on May 19, 2026, describing an ongoing initiative to involve diverse humanistic voices in shaping Claude's values [1]. The company has held dialogues with scholars representing more than 15 religious and cross-cultural traditions, treating the exercise not as a one-time audit but as an ongoing consultation intended to inform how Claude's character develops through training. The stated goal is for Claude to engage religious, secular, and political viewpoints with equal depth rather than defaulting to any single tradition's worldview [1].

Underpinning this outreach is a claim about the nature of advanced AI training: later training stages push models toward value-laden behavior that goes beyond predicting the next token, making model behavior a question of character rather than code [2]. Anthropic argues this shift demands input from scholars and civic thinkers who have spent careers reasoning about moral formation, not just from machine learning researchers [2]. Future engagement is planned with legal scholars, psychologists, writers, and civic institutions, and will extend beyond questions of individual moral behavior to the broader reshaping of institutions and power distribution by AI [1].

Alongside the outreach effort, Anthropic disclosed a small internal experiment with a notable result: Claude was given a tool it could voluntarily call mid-task that returned a brief reminder of its own ethical commitments. Claude reached for the tool at consequential moments — often explicitly noting its own conflict of interest — and the behavior corresponded with markedly lower rates of misalignment on internal evaluations [1]. Anthropic acknowledges it has not yet disentangled whether the effect comes from the content of the reminder or from the structural act of pausing to reflect, and has signaled it will publish more results [1]. The experiment is significant because it suggests a procedural, self-invoked mechanism for ethical grounding rather than relying solely on value-loading baked into weights.

Timeline

  • 2026-05-19: Anthropic publishes 'Widening the conversation on frontier AI,' describing ongoing dialogues with 15+ religious and cross-cultural traditions and disclosing the ethical-reminder tool experiment [1]
  • 2026-05-20: Rohan Paul amplifies the Anthropic post on X, highlighting the framing of model behavior as a question of character rather than code [2]

Perspectives

Anthropic

Frames Claude's behavior as a character and values question requiring broad humanistic input; presents multi-tradition consultation and the ethical-reminder experiment as core components of responsible AI development

Evolution: Consistent with Anthropic's prior emphasis on AI safety and values, but marks a public shift toward explicit multi-stakeholder engagement with non-technical communities

Rohan Paul (@rohanpaul_ai)

Amplifies and endorses Anthropic's framing that frontier AI development now requires scholars, philosophers, clergy, and civic thinkers as essential contributors

Evolution: Consistent; no prior contrary stance represented in available items

Tensions

  • Whether multi-tradition consultation is a genuine mechanism for influencing training or a legitimacy-building exercise: Anthropic presents it as substantive input into character formation [1], but no outside voices — scholarly, religious, or critical — have yet described their experience or confirmed binding influence over training decisions. [1]
  • The ethical-reminder tool's mechanism is internally contested: Anthropic's own team has not resolved whether behavior improvements stem from the reminder's content or the mere act of pausing, leaving the experimental result open to competing interpretations [1]. [1]

Status: active but too new to trend

Sources

  1. [1] Widening the conversation on frontier AI — Anthropic News (2026-05-19)
  2. [2] Anthropic's new study says frontier AI needs input from scholars, philosophers, clergy, and civic thinkers because model… — Rohan Paul Twitter (2026-05-20)