A key aspect in cover crop management is termination before the cash crop is planted. The aim of this study was to assess the effects of termination methods on ground-dwelling arthropods. The conventional mechanical termination method—i.e., green manuring by means of a disc harrow—was compared to flattening using a roller crimper. Two different crop systems were investigated for two growing seasons; cauliflower was grown in autumn after the termination of a mixture of cowpea, pearl millet, and radish, and tomato was cropped in spring and summer after the termination of a mixture of barley and vetch. Ground beetles (Coleoptera: Carabidae), rove beetles (Coleoptera: Staphylinidae), and spiders (Araneae) were sampled by means of standard pitfall traps throughout the growing season of both cash crops. The roller crimper increased the overall abundance of ground beetles in the first growing season of both cash crops, whereas in the second year, no significant effect could be detected. Rove beetles were more abundant in plots where the cover crops were terminated by the roller crimper. Finally, green manuring increased the abundance of spiders, especially on the first sampling date after cover crop termination. Albeit different taxa showed different responses, the termination of cover crops by a roller crimper generally increased the abundance of ground dwelling arthropods. Given that most of the sampled species were generalist predators, their increased abundance could possibly improve biological control.