Knowledge on the occurrence of pathogenic tick-borne bacteria Anaplasma phagocytophilum and Anaplasma ovis is scarce in sheep from Germany. In 2020, owners from five flocks reported ill thrift lambs and ewes with tick infestation. Out of 67 affected sheep, 55 animals were clinically examined and hematological values, blood chemistry and fecal examinations were performed to investigate the underlying disease causes. Serological tests (cELISA, IFAT) and qPCR were applied to all affected sheep to rule out A. phagocytophilum and A. ovis as a differential diagnosis. Ticks were collected from selected pastures and tested by qPCR. Most animals (n = 43) suffered from selenium deficiency and endoparasites were detected in each flock. Anaplasma spp. antibodies were determined in 59% of examined sheep. Seventeen animals tested positive for A. phagocytophilum by qPCR from all flocks and A. phagocytophilum was also detected in eight pools of Ixodes ricinus. Anaplasma phagocytophilum isolates from sheep and ticks were genotyped using three genes (16S rRNA, msp4 and groEL). Anaplasma ovis DNA was identified in six animals from one flock. Clinical, hematological and biochemical changes were not significantly associated with Anaplasma spp. infection. The 16S rRNA analysis revealed known variants of A. phagocytophilum, whereas the msp4 and groEL showed new genotypes. Further investigations are necessary to evaluate the dissemination and health impact of both pathogens in the German sheep population particularly in case of comorbidities.