This dataset contains curated molecular structures and associated nuisance and assay-interference annotations used to train and evaluate the CAGE-Fusion multimodal deep-learning framework for early drug-discovery screening. The dataset aggregates compounds from multiple public sources and literature-derived annotations, covering common assay-interference categories such as aggregation, reactivity, luciferase inhibition, and promiscuous behavior.