Fluoride anion interaction has been explored for the first time to investigate how the structure of sodium zirconium phosphate (NZP) and calcium zirconium phosphate (CZP) can be altered in its presence. Different compositions were made by adding NaF and CaF2 in CZP and NZP matrices respectively. Fluoride interaction differs with NZP and CZP structure as suggested by F-NMR data. The addition of fluoride to the NZP or CZP structure enables to stabilize the structure at a low temperature of 600–700 °C under microwave conditions.