As a decision information preference which includes membership degree (MD), non-membership degree (NMD), and probability, the probabilistic dual hesitant fuzzy set (PDHFS) is a crucial tool for effectively expressing uncertain information. In the domains of multi-attribute decision making (MADM) and multi-attribute group decision making (MAGDM), distance measures are extremely helpful tools. In this study, a novel PDHFS distance measure is put out, on which a MAGDM method that takes decision-makers’ (DMs’) psychological behavior into account is proposed. First, a novel distance measure is put forward to effectively assess the difference between different PDHFSs by adding consideration of the distances between MDs and between NMDs. Second, a similarity-trust analysis method based on the new distance measure is employed to calculate expert weights for integrating group decisions, and the group satisfaction index and regret theory are extended to a probabilistic dual hesitant fuzzy information environment. A MAGDM method based on the novel distance measure and regret theory is proposed. Finally, the proposed method is applied to the selection of radiation protection strategies in nuclear power plants, and it is also determined through parametric analysis that DMs’ tendency to avoid regret has an impact on the outcomes of decisions. When the method proposed in this study is compared to existing approaches, the findings demonstrate that the method’s performance in resolving MAGDM issues in a PDHFS environment is superior.