Powered by OpenAIRE graph
Found an issue? Give us feedback
ZENODOarrow_drop_down
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
ZENODO
Preprint . 2026
License: CC BY
Data sources: Datacite
addClaim

TOPO-JEPA: A Topological Joint Embedding Predictive Architecture for Continual World Models

Authors: MORALES, FRANK;

TOPO-JEPA: A Topological Joint Embedding Predictive Architecture for Continual World Models

Abstract

Core Concept TOPO-JEPA is a novel architecture designed to enable continual learning in world models by integrating two complementary approaches: TOPO (Topological AI): Provides a mathematical guarantee of memory preservation to solve catastrophic forgetting, using $O(1)$ memory overhead (67.5 KB). JEPA (Joint Embedding Predictive Architecture): Provides self-supervised, task-agnostic representation learning for world model prediction, though it does not address catastrophic forgetting on its own. Full code Key Performance and Findings Zero Catastrophic Forgetting: Through the mathematical guarantees provided by TOPO, the model avoids the traditional degradation of performance when learning new tasks. Negative Forgetting: Experimental results showed -0.75% combined forgetting, meaning the model actually improved on earlier tasks after learning new ones. High Accuracy: The architecture achieved 89.0% accuracy on the "World vs Sci/Tech" cross-domain task, which was the hardest task in the protocol. Efficiency: The $O(1)$ memory cost of 67.5 KB is 34,000 times less than the HOPE (Nested Learning) architecture. Distinguishing Roles Component Solves Catastrophic Forgetting? Contribution TOPO Yes (via mathematical guarantee) Memory preservation JEPA No Self-supervised representation learning Together Yes Stable and generalizable world models Technical Foundation Prime-Anchored Embeddings: Six embedding rows at prime indices (2, 3, 5, 7, 11, 13) are frozen after the first task. Arithmetic Spectral Theory: The safety constant $\Lambda = 0.9785142874$ provides the theoretical guarantee for anchor stability. Integration: The Topological Governor only requires three additions to standard fine-tuning loops: taking a snapshot after the first task, zeroing anchor gradients and enforcing anchors during subsequent training, and verifying integrity. Availability The implementation and the certified model are available on GitHub and the Hugging Face Hub.

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!