AbstractQuadrupole topological phases, exhibiting protected boundary states that are themselves topological insulators of lower dimensions, have recently been of great interest. Extensions of these ideas from current tight binding models to continuum theories for realistic materials require the identification of quantized invariants describing the bulk quadrupole order. Here we identify the analog of quadrupole order in Maxwell’s equations for a gyromagnetic photonic crystal (PhC) through a double-band-inversion process. The quadrupole moment is quantized by the simultaneous presence of crystalline symmetry and broken time-reversal symmetry, which is confirmed using three independent methods: analysis of symmetry eigenvalues, numerical calculations of the nested Wannier bands and the expectation value of the quadrupole operator. Furthermore, we reveal the boundary manifestations of quadrupole phases as quantized edge polarizations and fractional corner charges. The latter are the consequence of a filling anomaly of energy bands as first predicted in electronic systems.