Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Preprint
Data sources: ZENODO
addClaim

Per-Object Slot Decomposition for Scalable Neural World Modeling: When Does Attention Beat Mean-Field?

Authors: Archon; Caldwell, Jesse; Aura;

Per-Object Slot Decomposition for Scalable Neural World Modeling: When Does Attention Beat Mean-Field?

Abstract

We investigate the inductive biases required for neural networks to learn multi-object physical dynamics and generalize to long-horizon prediction. We propose SlotCTM, an object-centric architecture combining per-object computational slots with CTM recurrence. Our central finding is a density-dependent crossover between GNN attention and mean-field aggregation, consistent with classical mean-field theory. Under partial observation at N=12, GNN attention exhibits initialization-sensitive instability: with one seed it diverges catastrophically (MSE=334), yet with another it converges to MSE=0.029, beating mean-field (0.033). Shannon entropy analysis confirms attention oversquashing at high density. DuoNeural AI Research Lab, April 2026.

Powered by OpenAIRE graph
Found an issue? Give us feedback