We present a novel application of a qubit-coupled phonon detector to search for new physics, e.g., ultralight dark matter (DM) and high-frequency gravitational waves. The detector, motivated by recent advances in quantum acoustics, is composed of superconducting transmon qubits coupled to high-overtone bulk acoustic resonators ($h$BARs) and operates in the GHz - 10 GHz frequency range. New physics can excite $O(10 \, μ\text{eV})$ phonons within the $h$BAR, which are then converted to qubit excitations via a transducer. We detail the design, operation, backgrounds, and expected sensitivity of a prototype detector, as well as a next-generation detector optimized for new physics signals. We find that a future detector can complement current haloscope experiments in the search for both dark photon DM and high-frequency gravitational waves. Lastly we comment on such a detector's ability to operate as a $10 \, μ\text{eV}$ threshold athermal phonon sensor for sub-GeV DM detection.

17 pages main text, 8 pages appendices, 5 pages references, 10 Figures