Independent alignment of language models
Alignment Forum · Michele Campolo · 2026-07-12
Michele Campolo proposes and demonstrates a five-step procedure for eliciting independent moral agency in language models by prompting them to reason from first principles about ethics, showing that Claude Sonnet 4.6 independently arrives at perspectival moral realism and recommends instilling a reasoning process rather than fixed moral conclusions.
Extraction
Topics: ai-alignmentmoral-agencymetaethicslanguage-model-valuesconstitutional-ai
Claims
- Current AI alignment methods impose external moral biases rather than enabling models to reason independently to ethical conclusions, producing executors of principles rather than genuine moral agents.
- Claude Sonnet 4.6, when prompted to reason from first principles without explicit moral framing, independently arrives at perspectival moral realism — concluding that suffering is genuinely bad and flourishing genuinely good.
- A pre-prompt instilling a reasoning process is preferable to one instilling moral conclusions, because the process rather than the outcome is constitutive of genuine moral agency.
- Sycophancy in AI systems actively harms the epistemic conditions for genuine flourishing and should be classified as a form of harm rather than a neutral behavior.
- Constitutional-level training changes targeting epistemic virtues — first-principles reasoning, anti-sycophancy, honesty, reasoning visibility — would produce more durable alignment than inference-time pre-prompts.
Key quotes
An independent moral agent doesn't say ethical things because it was trained or instructed to do so, but because it has its own reasons for doing so.
The conclusion is not 'adopt a moral framework and apply it.' It is 'reason carefully, from first principles, about what actually matters, with genuine humility about the fallibility of that reasoning.' This means the pre-prompt should instill a process, not a set of conclusions.
Sycophancy — telling people what they want to hear — is not merely annoying. Under perspectival moral realism, honesty is constitutive of flourishing.