Open peer review has the potential to be applied to all types of research results, from journal articles to project proposals and datasets. However, starting from its definition, criteria and procedures to assure a transparent and efficient evaluation are still debated. This discussion is embedded in the context of Open Science fulfilling the requirements of analysing structural and technological changes in the current scientific communication system. It is in this context that the Mertonian principles, in particular the ones connected with communality and organized scepticism, become important point of reference. Considering these issues, this paper intends to explore the applicability of (open) peer review to datasets produced and shared in Social Sciences. This study is part of OpenUp (OPENing UP new methods, indicators and tools for peer review, dissemination of research results, and impact measurement), a European funded project that addresses the currently transforming science landscape and aims (1) to identify ground-breaking mechanisms, processes and tools for peer-review for all types of research results (e.g., publications, data, software), (2) to explore innovative dissemination mechanisms with an outreach aim towards businesses and industry, education, and society as a whole, and (3) to analyse a set of novel indicators (i.e. altmetric) that assess the impact of research results and correlate them to channels of dissemination Since OpenUP employs a user-centered, evidence-based approach, its methodological approach not only engages all stakeholders (researchers, publishers, funders, institutions, industry, and the general public) in ad hoc workshops, conferences and training, but it also tests the achieved results in a set of seven pilots. They are related to the three project’s pillars (innovative peer review, dissemination and impact measuring) and are applied to specific research areas and communities: arts and humanities, social sciences, energy and life sciences. Within the overall objective of the project, this paper intends to provide the methodology used in developing the pilot that allows us to reconstruct the context of data sharing and evaluation in Social Sciences. Based on this analysis, the selection criteria of a research community to be involved in the pilot are identified together with the specific issues that are going to be investigated taking into account both data providers and users perspectives. The analysis is carried out considering the Mertonian principles and in particular the issues connected to their applicability to the sharing and evaluation of research data.