
We present AION, a 2.2B-parameter language model architecture that decouples factual recall from reasoning computation through a learned Hard Bypass mechanism. When an associative memory module (Engram) retrieves a stored fact with confidence exceeding 0.90, the model skips all transformer layers entirely. Gate training achieves 99.6% confidence on factual queries and 0.0% on generative queries after 12 epochs.
efficient inference, early exit, hard bypass, engram, language model, memory-augmented
efficient inference, early exit, hard bypass, engram, language model, memory-augmented
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
