Despite the wealth of data available for mountain phylogeography, local-scale studies focused on narrow endemic species remain rare. Yet, knowledge of the genetic structure of such species biogeographically linked to a restricted area is of particular importance to understand the history of the local flora and its diversity patterns. Here, we aim to contribute to the phylogeographical overview of the Western Carpathians with a genetic study of Saxifraga wahlenbergii, one of the most characteristic endemic species of this region. We sampled populations from all discrete parts of the species’ distribution range to apply sequencing of selected non-coding cpDNA and nuclear ribosomal DNA (ITS) regions, as well as Amplified Fragment Length Polymorphism (AFLP) fingerprinting. First, while ITS sequences showed weak diversification, the genetic structure based on cpDNA sequences revealed two well-differentiated groups of haplotypes. One of them is restricted to the main center of the distribution range in the Tatra Mountains (Mts), while the second group included a series of closely related haplotypes, which in most cases were unique for particular isolated groups of populations in peripheral mountain ranges and in the south-eastern part of the Tatra Mts. AFLP fingerprinting also revealed a pattern of divergence among populations, while only partly corroborating the division observed in cpDNA. Taking into account all the data, the pattern of genetic structure, supported by the high levels of unique genetic markers in populations, may reflect the historical isolation of populations in several local refugia during the last glacial period. Not only the center of the range in the Tatra Mts, but also other, neighboring massifs (Malá Fatra, Nízke Tatry, Chočské vrchy, Muránska planina), where populations are characterized by separate plastid DNA haplotypes, could have acted as separate refugia.