Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Preprint . 2026
License: CC BY
Data sources: ZENODO
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
versions View all 2 versions
addClaim

Adaptive Repetition Controller (ARC): Behavioral Probes for Decode-Time Control and Adaptive Compute Allocation in Large Language Models

Authors: Napolitano, Logan Matthew;

Adaptive Repetition Controller (ARC): Behavioral Probes for Decode-Time Control and Adaptive Compute Allocation in Large Language Models

Abstract

I present the Adaptive Repetition Controller (ARC), a decode-time system for controlling behavioral artifacts and improving inference efficiency in large language models without retraining the base model. ARC is built on the observation that several RLHF-induced behaviors—most notably semantic repetition—are predictable from hidden state representations before token emission. Using lightweight behavioral probes operating on low-dimensional projections of transformer hidden states, ARC can reliably detect these behaviors in advance and intervene during decoding. Empirically, we demonstrate that repetition-prone states exhibit near-perfect linear separability, achieving a 125× class separation ratio, far exceeding typical probe performance reported in prior work. This indicates that RLHF induces distinct, low-dimensional policy modes that are internally represented prior to surface realization. Beyond behavioral control, ARC repurposes these probes as efficiency oracles. Because predictable behaviors correspond to low-information, computationally simple content, the same signals can guide adaptive compute allocation, including speculative decoding, layer skipping, and early exit. In combination, these techniques yield substantial inference speedups with minimal quality degradation. We further explore training paradigms that optimize for brevity (terse mode) and information density (dense mode) using probe-guided reward signals, and outline a pathway toward bounded recursive self-optimization through iterative probe refinement. This repository includes the full technical paper, trained probes, example adapters, and reference implementations. ARC is intended as an open, evolving research project at the intersection of interpretability, alignment, and efficient inference.

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Green