In response to the rapid advancements in radar detection technology and the widespread deployment of infrared sensors, single-function stealth materials are increasingly challenged to meet the sophisticated demands of concealment within complex electromagnetic environments. As a result, there is a pressing need for research into metamaterial structures that can simultaneously deliver ultra-wideband radar stealth and controllable infrared invisibility. Here, a novel metamaterial structure was proposed and realized, comprising vertically integrated infrared stealth and radar stealth layers, with the aim of accomplishing both ultra-wideband radar stealth and controlled infrared invisibility. Coded units were designed based on the geometric phase modulation mechanism and then arrayed through a random matrix strategy optimized by a genetic algorithm, yielding a radar stealth layer characterized by outstanding properties such as ultra-wideband radar stealth and insensitivity to polarization states. A temperature-adaptive infrared stealth switching function was successfully achieved by incorporating vanadium dioxide, a phase-change material, into the infrared stealth layer, exploiting its insulator-to-metal phase transition at a critical temperature. The fabrication and performance testing of the samples have further validated the practicality and rationality of the design scheme. This work can not only open up innovative pathways for the advancement of multi-band compatible stealth technology but is also of great significance for the application of electromagnetic shielding and stealth technologies in complex settings.