Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
InteractiveResource . 2026
License: CC BY
Data sources: ZENODO
ZENODO
InteractiveResource . 2026
License: CC BY
Data sources: Datacite
ZENODO
InteractiveResource . 2026
License: CC BY
Data sources: Datacite
versions View all 2 versions
addClaim

Shaped by Training: What Really Sets a Model's Values | Geometry of Trust | Philosophy - Lesson 3

Authors: Wilson, Jade;

Shaped by Training: What Really Sets a Model's Values | Geometry of Trust | Philosophy - Lesson 3

Abstract

Alignment Is Paint on a Landscape | Geometry of Trust Philosophy Lesson 3 A forest's values come from soil and climate. A wolf pack's come from territory and prey. An AI's come from three things: the corpus it read, the architecture that processes what it read, and the training objective it was rewarded for. This talk walks through each of those three shapers — and arrives at a finding that should change how we think about AI alignment. When researchers apply post-hoc alignment methods like RLHF, DPO, or supervised fine-tuning to already-trained models and measure the underlying value geometry before and after, the geometry barely moves. Three alignment methods, eight models across different architectures and corpora, same result. What changes is surface behaviour. The underlying structure that generates that behaviour is unchanged. The value structure is set during training — by the corpus, the architecture, and the objective. Alignment is a thin behavioural veneer layered on top. It shapes what the model says. It doesn't much change what the model is. A landscape with a thin coat of paint. You can re-paint as often as you like. The landscape underneath doesn't change shape. The implications are stark. Certifying the alignment method is insufficient. You need to inspect the training pipeline. You need to monitor the geometry, not just outputs. Which is exactly what the mathematics series produces.

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average