This article is part of a multi-year study of governance structures in the midst of insecurity and organized crime in fragile sub-state regions, where in the absence of a strong state, non-state actors (like insurgents, traffickers and tribal warlords) engage in political and socioeconomic governance. Building on our prior work on West Africa and the Afghanistan-Pakistan tribal belt, this paper focuses on the Andean borderlands, drawing on recent fieldwork in Colombia, Ecuador and Venezuela. We explore patterns of behavior in which competition among violent non-state actors is not the norm. Instead, several instances were found in which violent non-state actors work collaboratively or have tacit non-interference agreements to provide public goods through arrangements we characterize as “complementary governance.” We therefore argue that, to understand how illicit authority emerges, it is not sufficient to consider one armed non-state actor in isolation or in a dichotomy to the state. As we contend, we have to take into account the complex connections and interactions among different (violent) non-state structures. Moving beyond state versus non-state governance to governance that is constitutive of various non-state groups, the perspective put forward in this article thus is aimed to enrich the current debate on governance and security.