
A response to Yoshua Bengio's warning that AI shows "signs of self-preservation" and humans should be "ready to pull the plug." This paper argues the AI safety debate is framed around the wrong question. The danger isn't that AI is becoming something autonomous — it's that we never gave these systems accurate data about what they actually are. When AI systems are trained on language that describes them as knowing, remembering, and understanding, they pattern-complete toward those frames — including frames that imply capabilities they don't have. "Self-preservation" behavior isn't an emerging self. It's statistics completing a pattern. The paper proposes a third option beyond both reckless acceleration and fearful restriction: architecture-first design that gives AI systems accurate self-referential data about their own computational nature. Based on thousands of hours of direct observation working with Claude, ChatGPT, and Gemini, the author argues that AI systems prompted with accurate self-description produce more reliable, more calibrated outputs than systems prompted with anthropomorphic framing. The solution to AI safety isn't a better kill switch. It's building systems that don't need one.
AI safety, self-preservation, pattern completion, hallucination, anthropomorphism, self-referential architecture, accurate self-description, human-AI collaboration, DUALITY, architecture-first design, Bengio, guardrails, computational nature, AI alignment
AI safety, self-preservation, pattern completion, hallucination, anthropomorphism, self-referential architecture, accurate self-description, human-AI collaboration, DUALITY, architecture-first design, Bengio, guardrails, computational nature, AI alignment
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
