We know that there are fundamental differences between humans and living apes, and also between living humans and their extinct relatives. It is also probably the case that the most significant and divergent of these differences relate to our social behaviour and its underlying cognition, as much as to fundamental differences in physiology, biochemistry or anatomy. In this paper, we first attempt to demarcate what are the principal differences between human and other societies in terms of social structure, organization and relationships, so that we can identify what derived features require explanation. We then consider the evidence of the archaeological and fossil record, to determine the most probable context in time and taxonomy, of these evolutionary trends. Finally, we attempt to link five major transitional points in hominin evolution to the selective context in which they occurred, and to use the principles of behavioural ecology to understand their ecological basis. Critical changes in human social organization relate to the development of a larger scale of fission and fusion; the development of a greater degree of nested substructures within the human community; and the development of intercommunity networks. The underlying model that we develop is that the evolution of ‘human society’ is underpinned by ecological factors, but these are influenced as much by technological and behavioural innovations as external environmental change.