Infective endocarditis involving the right side of the heart is typically associated with IV drug abuse and chronic indwelling catheters which commonly involve the tricuspid valve. Isolated pulmonary valve endocarditis (PVE) is a rare clinical entity. We report a rare case of a young woman with a history of end-stage renal disease (ESRD) on hemodialysis through tunneled catheter presenting with persistent coagulase-negative staphylococcus (CoNS) epidermidis bacteremia despite being on appropriate treatment with IV vancomycin for two weeks. Because of the persistent bacteremia, a transesophageal echocardiogram was performed and it revealed a thickened pulmonary valve with 1.8 cm vegetation in the left posterior cusp. She was successfully treated with IV daptomycin course for a total of six weeks. The recommended management for PVE is usually medical treatment with IV antibiotics gauged according to sensitivities of the cultures. Our article highlights the fact that the decision to manage it medically versus surgically can propose a challenge as the guidelines are not very robust.