While antibodies remain established therapeutic and diagnostic tools, other protein scaffolds are emerging as effective and safer alternatives. Affibodies in particular are a new class of small proteins marketed as bio-analytic reagents. They feature tailorable binding affinity, low immunogenicity, high tissue permeation, and high expression titer in bacterial hosts. This work presents the development of affibody-binding peptides to be utilized as ligands for their purification from bacterial lysates. Affibody-binding candidates were identified by screening a peptide library simultaneously against two model affibodies (anti-immunoglobulin G (IgG) and anti-albumin) with the aim of selecting peptides targeting the conserved domain of affibodies. An ensemble of homologous sequences identified from screening was synthesized on Toyopearl® resin and evaluated via binding studies to select sequences that afford high product binding and recovery. The affibody–peptide interaction was also evaluated by in silico docking, which corroborated the targeting of the conserved domain. Ligand IGKQRI was validated through purification of an anti-ErbB2 affibody from an Escherichia coli lysate. The values of binding capacity (~5 mg affibody per mL of resin), affinity (KD ~1 μM), recovery and purity (64–71% and 86–91%), and resin lifetime (100 cycles) demonstrate that IGKQRI can be employed as ligand in affibody purification processes.