Six rock glaciers in the Southern Carpathians have been investigated by means of geoelectrical soundings in order to detect their internal stratigraphy and the existence of frozen sediments. In the case of three relict rock glaciers, the electrical resistivity measurements indicated a typical internal structure. Low resistivity values (<10 kΩm) which are typical of unfrozen fine-grained materials were obtained, but high resistivity values (25–240 kΩm) measured in the Pietroasa, Iesu and Pietrele rock glaciers denote the presence of sediments cemented by interstitial ice and ice lenses. Based on the moderate resistivity values, the ice content is probably low to medium in the upper portion of these rock glaciers, that is, above 2040 m. At two sites (Pietroasa and Vaiuga rock glaciers), ground surface temperature (GST) evolution was monitored using digital dataloggers. Mean annual ground surface temperature and GST regime throughout the winter were extracted from the recordings and confirmed the probability of permafrost occurrence in Pietroasa rock glacier. In the Iesu and Pietrele rock glaciers, measurements of bottom temperatures of the winter snow cover were performed in March 2012. Considering the thick active layer, the reduced ice content and the presence of scarce vegetation on their surface it could be assumed that the permafrost exists in marginal conditions in the Southern Carpathians. The ground ice in permafrost is produced by the groundwater freezing or by snow banks buried by coarse angular boulders following large rockfalls.