Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Preprint . 2026
License: CC BY
Data sources: ZENODO
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
versions View all 2 versions
addClaim

Persona Drift and Hallucination as a Production Discipline: An Eval-Harness Substrate for Agentic Operations

Authors: Kuiper, Justin H.;

Persona Drift and Hallucination as a Production Discipline: An Eval-Harness Substrate for Agentic Operations

Abstract

Production agentic systems exhibit two operationally distinct drift patterns that conventional QA does not detect: operator-trust drift (the harness reports work done while no artifact moves) and output-mode drift (the harness produces the same output mode regardless of variation in the prompt). Both fail invisibly because the verification primitive lives inside the harness's self-knowledge. This paper specifies the runtime substrate that closes the gap: an eval-harness architecture with ground-truth fixtures, scoreable assertions, re-runnable evaluations, and a three-layer monitoring stack (per-task, per-session, per-milestone) at three cadences with three ownership boundaries. The drift taxonomy is three-class — useful drift (uncertainty surfaced), pathological hallucination (certainty about fabrication), and operator-acknowledged residual (known-unknowns the operator has accepted as ambient) — not the conventional two-class binary. Two forensic case studies from Q2 2026 production operations ground the architecture: a multi-paper coast event in which the harness conflated merge-to-main with shipped-to-canonical-URL, and an editorial-substrate feasibility eval that surfaced output-mode drift before the substrate reached production. Together, the two cases demonstrate why the substrate is load-bearing. This is Paper Four of the Managing Agentics Ops decalogy. The paper specifies the runtime substrate the lookback discipline (Paper Five) measures against and the sprint container (Paper Eight) operates within.

Keywords

agentic-hallucination, persona-drift, managing-agentics-ops, eval-harness, production-qa, operator-trust-drift, ai-governance

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average