In demyelinating diseases such as multiple sclerosis, a critical problem is failure of remyelination, which is important for protecting axons against degeneration and restoring conduction deficits. However, the underlying mechanism of demyelination/remyelination remains unclear. N-acetylglucosaminyltransferase-IX (GnT-IX; also known as GnT-Vb) is a brain-specific glycosyltransferase that catalyzes the branched formation of O-mannosyl glycan structures. O-Mannosylation of α-dystroglycan is critical for its function as an extracellular matrix receptor, but the biological significance of its branched structures, which are exclusively found in the brain, is unclear. In this study, we found that GnT-IX formed branched O-mannosyl glycans on receptor protein tyrosine phosphatase β (RPTPβ) in vivo. Since RPTPβ is thought to play a regulatory role in demyelinating diseases, GnT-IX-deficient mice were subjected to cuprizone-induced demyelination. Cuprizone feeding for 8 weeks gradually promoted demyelination in wild-type mice. In GnT-IX-deficient mice, the myelin content in the corpus callosum was reduced after 4 weeks of treatment, but markedly increased at 8 weeks, suggesting enhanced remyelination under GnT-IX deficiency. Furthermore, astrocyte activation in the corpus callosum of GnT-IX-deficient mice was significantly attenuated, and an oligodendrocyte cell lineage analysis indicated that more oligodendrocyte precursor cells differentiated into mature oligodendrocytes. Together, branched O-mannosyl glycans in the corpus callosum in the brain are a necessary component of remyelination inhibition in the cuprizone-induced demyelination model, suggesting that modulation of O-mannosyl glycans is a likely candidate for therapeutic strategies.