Mounting evidence in recent years has challenged the dogma that prokaryotes are simple and undefined cells devoid of an organized subcellular architecture. In fact, proteins once thought to be the purely eukaryotic inventions, including relatives of actin and tubulin control prokaryotic cell shape, DNA segregation, and cytokinesis. Similarly, compartmentalization, commonly noted as a distinguishing feature of eukaryotic cells, is also prevalent in the prokaryotic world in the form of protein-bounded and lipid-bounded organelles. In this article we highlight some of these prokaryotic organelles and discuss the current knowledge on their ultrastructure and the molecular mechanisms of their biogenesis and maintenance.