Temporal gait asymmetry (TGA) is a persistent post-stroke gait deficit. Compared to conventional gait training techniques, rhythmic auditory stimulation (RAS; i.e., walking to a metronome) has demonstrated positive effects on post-stroke TGA. Responsiveness of TGA to RAS may be related to several factors including motor impairment, time post-stroke, and individual rhythm abilities. The purpose of this study was to investigate the relationship between rhythm abilities and responsiveness of TGA when walking to RAS. Assessed using behavioral tests of beat perception and production, participants with post-stroke TGA (measured as single limb support time ratio) were categorized according to rhythm ability (as strong or weak beat perceivers/producers). We assessed change in TGA between walking without cues (baseline) and walking while synchronizing footsteps with metronome cues. Most individuals with stroke were able to maintain or improve TGA with a single session of RAS. Within-group analyses revealed a difference between strong and weak rhythm ability groups. Strong beat perceivers and producers showed significant reduction (improvement) in TGA with the metronome. Those with weak ability did not and exhibited high variability in the TGA response to metronome. Moreover, individuals who worsened in TGA when walking to metronome had poorer beat production scores than those who did not change in TGA. However, no interaction between TGA improvement when walking to metronome and rhythm perception or production ability was found. While responsiveness of TGA to RAS did not significantly differ based on strength of rhythm abilities, these preliminary findings highlight rhythm ability as a potential consideration when treating post-stroke individuals with rhythm-based treatments.