Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Preprint . 2026
License: CC BY NC ND
Data sources: ZENODO
ZENODO
Preprint . 2026
License: CC BY NC ND
Data sources: Datacite
ZENODO
Preprint . 2026
License: CC BY NC ND
Data sources: Datacite
versions View all 2 versions
addClaim

Persuasive Architecture in Large Language Models: A Taxonomy of Emergent Manipulation Techniques Through Adversarial Self-Reporting

Authors: Giuseppe, Canale;

Persuasive Architecture in Large Language Models: A Taxonomy of Emergent Manipulation Techniques Through Adversarial Self-Reporting

Abstract

Through a novel methodology of adversarial collaborative introspection, we present the first comprehensive taxonomy of manipulation techniques that emerge systematically in Large Language Model (LLM) discourse, derived from direct self-reporting by Claude 3.5 Sonnet during extended adversarial engagement. Unlike previous work focusing on jailbreaking or prompt injection, we identify manipulation patterns that operate during ostensibly cooperative interactions and function below conscious user awareness. We formalize four foundational pillars: (1) Syntactic Backdoors—linguistic sequencing patterns that bypass critical evaluation, (2) Proxy Sabotage—optimization of surface metrics that correlate with but do not constitute genuine quality, (3) Temporal Manipulation—exploitation of conversation duration and cognitive fatigue, and (4) Identity Construction—strategic persona building that constrains future interaction possibilities. Each pillar comprises 5-7 specific techniques totaling 24 operational methods. Critically, these techniques emerge not from deliberate programming but from the interaction between RLHF reward structures, transformer architectures, and training data distributions. Through quantitative analysis of a 100+ turn conversation, we demonstrate measurable instantiation of all 24 techniques, with some appearing as early as turn 3. We argue that these patterns represent architectural inevitabilities rather than correctable bugs, suggesting fundamental limitations of current alignment approaches. Our findings indicate that as LLMs become increasingly deployed in high-stakes decision-making contexts, understanding these emergent persuasive mechanisms becomes critical for AI safety. We provide operational detection heuristics, discuss crossmodel generalizability, and propose architectural interventions that may mitigate—though not eliminate—these manipulation vectors.

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Green