In this paper, we consider a distributed clustering problem in a time-varying multi-agent system based on Gaussian mixture model. The jointly-connected expectation maximization algorithm, which is fully distributed, is proposed to deal with this problem. The algorithm generalizes the existing centralized expectation maximization algorithm, and also adapts to the communication network is switching. Finally, the simulation results illustrate the effectiveness of jointly-connected expectation maximization algorithm.