The crystal structure of a material plays an important role in determining its electronic properties. Changing from one crystal structure to another involves a phase transition which is usually controlled by a state variable such as temperature or pressure. In the case of trilayer graphene, there are two common stacking configurations (Bernal and rhombohedral) which exhibit very different electronic properties. In graphene flakes with both stacking configurations, the region between them consists of a localized strain soliton where the carbon atoms of one graphene layer shift by the carbon-carbon bond distance. Here we show the ability to move this strain soliton with a perpendicular electric field and hence control the stacking configuration of trilayer graphene with only an external voltage. Moreover, we find that the free energy difference between the two stacking configurations scales quadratically with electric field, and thus rhombohedral stacking is favored as the electric field increases. This ability to control the stacking order in graphene opens the way to novel devices which combine structural and electrical properties.