The People in Social Context (PISC) dataset is a new dataset that focuses on social relationships. It consists of 22,670 images of 9 types of social relationships. We provide annotation of the bounding boxes of all people, as well as the social relationship between all pairs of people in the images. In addition, we provide occupation annotation. For more details on the collection process and statistics of the dataset, please see our paper. image_info.json contains bounding box annotation and information about image source, image size, image id. relationship.json contains annotation of the 3 types of coarse relationships relationship_fine.json contains annotation of the 6 types of fine relationships occupation.json contains annotation of the occupation after downloading all image parts (images-*), extract using: cat images-* | tar zx The dataset can be applied, but not limited to the following research areas: social relationship study people detection occupation recognition Please cite the following paper if you use the PISC dataset in your work (papers, articles, reports, books, software, etc): J. Li, Y. Wong, Q.Zhao, M. Kankanhalli Dual-Glance Model for Deciphering Social Relationships ICCV, 2017. http://doi.org/