One of the most fundamental questions in developmental biology is how one fertilized cell can give rise to a fully mature organism and how gene regulation governs this process. Precise spatiotemporal gene expression is required for development and is believed to be achieved through a complex interplay of sequence-specific information, epigenetic modifications, trans-acting factors, and chromatin folding. Here we review the role of chromatin folding during development, the mechanisms governing 3D genome organization, and how it is established in the embryo. Furthermore, we discuss recent advances and debated questions regarding the contribution of the 3D genome to gene regulation during organogenesis. Finally, we describe the mechanisms that can reshape the 3D genome, including disease-causing structural variations and the emerging view that transposable elements contribute to chromatin organization.