Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ Recolector de Cienci...arrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
Environmental Science & Policy
Article . 2025 . Peer-reviewed
License: CC BY NC ND
Data sources: Crossref
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
DIGITAL.CSIC
Article . 2025 . Peer-reviewed
Data sources: DIGITAL.CSIC
versions View all 3 versions
addClaim

Learning from practice: Expanding the OECD’s impact evaluation criteria based on experiences of subnational climate assemblies in France, Spain and Portugal

Authors: Lancha Hernández, Emma; Becerril Viera, Isabel;

Learning from practice: Expanding the OECD’s impact evaluation criteria based on experiences of subnational climate assemblies in France, Spain and Portugal

Abstract

Las Asambleas Climáticas (AC) tienen como objetivo incorporar las perspectivas de los ciudadanos en las políticas públicas. Para evaluar su impacto en las políticas, los investigadores a menudo se basan en los criterios de evaluación de la OCDE, que están diseñados para una amplia gama de procesos deliberativos. Sin embargo, los desarrollos recientes de las AC, en particular a nivel subnacional, han introducido prácticas innovadoras que no están plenamente reflejadas en estos marcos existentes. En respuesta a los debates académicos en curso sobre las AC y su medición de impacto, este estudio se basa en experiencias y discursos prácticos para refinar y expandir los criterios de impacto de las políticas de la OCDE. Basándonos en entrevistas en profundidad semiestructuradas con 14 informantes clave involucrados en 8 AC subnacionales en Francia, España y Portugal, nuestro objetivo es adaptar los criterios de impacto de las políticas mediante la integración de debates académicos y conocimientos empíricos de contextos subnacionales. Tradicionalmente, la evaluación del impacto de las políticas se ha tratado como una dimensión separada, desconectada de las fases de diseño e implementación. Sin embargo, nuestro análisis temático revela que es necesaria una evaluación holística de todo el proceso de AC para evaluar con precisión su impacto. Por lo tanto, sostenemos que los factores clave, como la alineación de los mandatos con las políticas públicas existentes, la inclusión y los roles de los diversos actores sociales a lo largo del proceso y las estructuras de gobernanza interna, deben tenerse en cuenta en los futuros marcos de evaluación. En última instancia, ofrecemos nuevas consideraciones y adaptaciones que mejoran la evaluación del impacto de las políticas para las AC subnacionales

Climate Assemblies (CAs) aim to incorporate citizens’ perspectives into public policy. To evaluate their policy impact, researchers often rely on the OECD's evaluation criteria, which are designed for a broad range of deliberative processes. However, recent CAs developments—particularly at the subnational level—have introduced innovative practices that are not fully captured by these existing frameworks. In response to ongoing academic debates on CAs and its impact measurement, this study draws on practical experiences and discourses to refine and expand the OECD's policy impact criteria. Based on semi-structured, in-depth interviews with 14 key informants involved in 8 subnational CAs in France, Spain, and Portugal, our aim is to adapt the policy impact criteria by integrating academic debates and empirical insights from subnational contexts. Traditionally, policy impact evaluation has been treated as a separate dimension, disconnected from the design and implementation phases. However, our thematic analysis reveals that a holistic evaluation of the entire CA process is necessary to accurately assess its impact. Thus, we argue that key factors—such as the alignment of mandates with existing public policies, the inclusion and roles of various social actors throughout the process, and internal governance structures—must be considered in future evaluation frameworks. Ultimately, we offer new considerations and adaptations that enhance the assessment of policy impact for subnational CAs.

The authors would like to thank KNOCA, and especially Graham Smith, for entrusting them with the research that underpins this article. We also thank the editors of this special issue (Oliver Escobar and Stephen Elstub) for their efforts. Additionally, we appreciate other members of the IESA-CSIC Team (Joan Font and Rodrigo Ramis), the department of Sociology of Universidad Pablo de Olavide and Patricia García-Espín and Ernesto Ganuza for their comments and contributions.

Peer reviewed

Countries
Spain, Spain
Keywords

End poverty in all its forms everywhere, Policy impact, http://metadata.un.org/sdg/1, OECD, Discourses, Evaluation, Criteria, Climate assemblies (CAs)

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    1
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
    OpenAIRE UsageCounts
    Usage byUsageCounts
    visibility views 17
    download downloads 29
  • 17
    views
    29
    downloads
    Powered byOpenAIRE UsageCounts
Powered by OpenAIRE graph
Found an issue? Give us feedback
visibility
download
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
views
OpenAIRE UsageCountsViews provided by UsageCounts
downloads
OpenAIRE UsageCountsDownloads provided by UsageCounts
1
Average
Average
Average
17
29
Green
hybrid