Estrogen regulates over a thousand genes, with an equal number of them being induced or repressed. The distinct mechanisms underlying these dual transcriptional effects remain largely unknown. We derived comprehensive views of the transcription machineries assembled at estrogen-responsive genes through integrating multiple types of genomic data. In the absence of estrogen, the majority of genes formed higher-order chromatin structures, including DNA loops tethered to protein complexes involving RNA polymerase II (Pol II), estrogen receptor alpha (ERα) and ERα-pioneer factors. Genes to be 'repressed' by estrogen showed active transcription at promoters and throughout the gene bodies; genes to be 'induced' exhibited active transcription initiation at promoters, but with transcription paused in gene bodies. In the presence of estrogen, the majority of estrogen-induced genes retained the original higher-order chromatin structures, whereas most estrogen-repressed genes underwent a chromatin reconfiguration. For estrogen-induced genes, estrogen enhances transcription elongation, potentially through recruitment of co-activators or release of co-repressors with unique roles in elongation. For estrogen-repressed genes, estrogen treatment leads to chromatin structure reconfiguration, thereby disrupting the originally transcription-efficient chromatin structures. Our in silico studies have shown that estrogen regulates gene expression, at least in part, through modifying previously assembled higher-order complexes, rather than by facilitating de novo assembly of machineries.