The Golgi apparatus is a universal feature of eukaryotes, carrying out the key functions of processing, sorting and trafficking of newly synthesized membrane and secretory proteins. The Golgi apparatus has a clearly defined structure, comprising stacks of flattened cisternal membranes that in vertebrates are connected to form a ribbon. How this structure is maintained and how it relates to the functions of the Golgi apparatus has long been an area of interest. In this review I describe recent progress in the identification and characterization of the molecular machinery that together help generate the characteristic organization of this organelle.