In microbiome research, considerable effort has been invested in finding core microbiomes, which have been hypothesized to contain the species most important for host function. Much less attention has been paid to microbiome members that are present in only a subset of hosts. Such accessory microbiomes must in large part consist of species that have no effect on fitness, but some will have deleterious effects on fitness (pathogens), and it is also possible that some accessory microbiome members benefit an ecologically distinct subset of hosts. This short paper discusses what we know about accessory microbiomes, specifically by comparing it with the concept of accessory genomes.