
Causal representation learning (CRL) — the recovery of latent causal variables and their causal graph from high-dimensionalobservations — has produced a substantial body of theoretical results in the past five years. CITRIS, CauCA, CRID, mechanismsparsity methods, and the recent grouping-based identifiability framework all establish conditions under which causalstructure can in principle be recovered. The gap between this theoretical progress and what has actually been demonstratedon real-world observational video is wider than most accounts acknowledge. Almost all empirical CRL work uses synthetic 3Drendered video sequences with cleanly designed interventions, ground-truth latent factors, and assumption-friendlygenerative processes. Real video provides none of these. This paper argues that the question is not whether CRL istheoretically possible — it is, under specific assumptions — but which of those assumptions real observational video canplausibly satisfy and which it cannot. We make three claims. First, the identifiability literature implicitly assumes interventionaccess, multi-environment data, or strong sparsity priors that real video provides only partially and noisily. Second, threeproperties of real video — object near-independence, occlusions and scene changes as quasi-interventions, and naturallyvarying environmental contexts — offer plausible but unverified routes to satisfying identifiability assumptions. Third, objectcentric video models (Slot Attention, SAVi, SlotFormer) provide a necessary inductive bias but do not by themselves recovercausal structure; the bridge between object-centric representation and causal identification is the genuine empirical frontier.We propose a research agenda focused on this bridge, on benchmarks that span synthetic-to-real, and on the methodologicalhonesty needed to make cumulative progress.
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
