The members of the Poxviridae family are globally distributed all over the world and can cause infectious diseases. Although genome sequences are publicly available for representative isolates of all genera, studies on the criteria for genome-based classification within the Poxviridae family have rarely been reported. In our study, 60 Poxviridae genomes were re-annotated using Prokka. By using BLAST filtration and MCScanX, synteny and similarity of whole genomic amino acid sequences were visualized. According to the analysis pattern, the Chordopoxvirinae and Entomopoxvirinae subfamilies can be subdivided into five and two categories respectively, which is consistent with the phylogenetic tree constructed based on whole genomic amino acid sequences and Poxvirus core genes. Finally, four genes (Early transcription factor, DNA-directed RNA polymerase, RNA polymerase-associated transcription-specificity factor and DNA-dependent RNA polymerase) were selected from Poxvirus core genes by substitution saturation analysis and phylogenetic tree verification. Phylogenetic trees constructed based on single gene and concatenated sequences of the four selected genes showed that the classification of subgroups was consistent with the phylogenetic trees based on genome. Conclusion: a new method based on the similarity of whole genomic amino acid sequences was proposed for Poxviridae taxon demarcation, and the use of the four selected qualified genes will help make phylogenic identification of newly discovered Poxviridae isolates more convenient and accurate.