We prove a general theorem establishing the bispectrality of noncommutative Darboux transformations. It has a wide range of applications that establish bispectrality of such transformations for differential, difference and q q -difference operators with values in all noncommutative algebras. All known bispectral Darboux transformations are special cases of the theorem. Using the methods of quasideterminants and the spectral theory of matrix polynomials, we explicitly classify the set of bispectral Darboux transformations from rank one differential operators and Airy operators with values in matrix algebras. These sets generalize the classical Calogero–Moser spaces and Wilson’s adelic Grassmannian.