Evaluation of LEADER and LEADER added value
- Evaluation
- LEADER
- CAP Strategic Plans
- Evaluation
- Cross-cutting Impacts
- Performance Monitoring and Evaluation Framework (PMEF)
Evaluating LEADER helps understand how Local Development Strategies (LDS) achieve their objectives and contribute to CAP Strategic Plan objectives. Assessing LEADER’s added value reveals insights about how the implementation of the LEADER method generates added value, expressed through improved governance and social capital, and enhanced results of the LDS.
Page contents
Basics
In a nutshell
LEADER/community-led local development (CLLD) has been implemented within the EU for over thirty years. Its scope and tools have expanded over multiple programming periods.
According to the evaluation support study on the impact of LEADER on balanced territorial development, the LEADER approach has proven to be effective for local rural development, targeting and achieving economic development, strengthening social fabric and capacity, and enhancing local governance, with good coherence alongside other policies.
Acknowledged in the CAP Strategic Plans Regulation, LEADER remains a compulsory element also in the 2023-2027 programming period under the cooperation type of interventions (Article 77), with a minimum allocation of 5% of the total European Agricultural Fund for Rural Development (EAFRD) contribution to the CAP Strategic Plan (CSP).
The conceptual framework of LEADER evaluation
LEADER/CLLD operates within a multilevel framework and requires a multilevel evaluation at both the CSP and local level. Here’s how it works:
- CSP level: LEADER is mainly programmed under Specific Objective 8 (SO) as a cooperation type of intervention. However, according to the intervention logic of the CSP, LEADER can also contribute to the achievement of other SOs.
- Local level: Local Action Groups (LAGs) operate at this level, often using multiple European Structural and Investment (ESI) Funds to achieve their objectives under a single Local Development Strategy (LDS). These strategies are linked to a specific territory and contribute to the achievement of local, national and EU level policy objectives.
In both cases, the evaluation can take on a multidimensional nature, typically focusing on the assessment of effectiveness, efficiency, relevance, coherence and Union added value of the interventions at each of the two levels, as well as the links between them.
The objectives of the LEADER evaluation at both levels are to:
- Demonstrate the achievements of LEADER towards local, national and EU policy objectives.
- Contribute to better targeted support for rural areas and beneficiaries.
- Provide knowledge on how to better design and implement LEADER.
According to Article 33(3)(f) of Regulation (EU) 2021/1060, the evaluation of LEADER at the local level is the responsibility of the LAG. LAGs can carry out the evaluation activities through:
- Self-assessment: conducted by the LAG itself.
- Independent evaluation: conducted by an independent body.
- A combination of both: a mix of self-assessment and independent evaluation.
Assessing LEADER added value
Besides assessing the extent to which an LDS has contributed to achieving local and relevant CSP objectives, an important aspect is assessing LEADER added value. The added value is generated through the application of the seven LEADER principles, which lead to improved governance and social capital as well as enhanced results and impacts, which also bring structural changes in a LAG’s area.
The added value of LEADER can be assessed as a specific evaluation topic if this is in line with the needs and intervention logic of the CSP.
Evaluation level | Evaluation focus | |
---|---|---|
At CSP level | CSP evaluation: Contributions of LEADER to SO8 and other SOs | LEADER added value |
At local level (self-assessment and/or independent evaluation) | LDS evaluation: Achievements of LDS objectives and results (including the contributions of LDS outputs and results to the CSP and CAP objectives) |
What to evaluate?
Evaluations of SOs where LEADER has been designed to contribute as a cooperation type of intervention (Article 77) shall be conducted during the implementing period with enough time to prepare the subsequent CSP period and ex post.
For such evaluations, Member States are required to define evaluation questions (EQ) and factors of success (FoS) to assess the evaluation criteria of effectiveness, efficiency, relevance, coherence and Union added value. The guidelines ‘Use of factors of success in evaluation’ offer relevant EQs, FoS, main indicators and steps to assess FoS.
For example, when assessing ‘local development’ the guidelines propose the EQ ‘To what extent have CAP Strategic Plan interventions contributed to local development and the provision of local services and infrastructure?’ and the relevant FoS ‘Local services and infrastructures are improving due to CAP support’. Results from LDS will feed into the assessment of this FoS, particularly for LAGs that have identified the PMEF Result Indicator R.41 ‘Connecting rural Europe: Share of rural population benefitting from improved access to services and infrastructure through CAP support’ as relevant in their LDS.
There is no specific EU regulation defining the evaluation framework for local level evaluations of LEADER. However, considering that the results of local level evaluations may feed into CSP evaluations, it is beneficial to apply a similar evaluation framework structure. This includes defining EQs, FoSs for applied evaluation criteria and relevant measurable indicators.
Given that LEADER added value is a specific topic within the CSP to be assessed, the non-binding guidelines ‘Assessing the added value of LEADER’ have been developed. These guidelines provide the background and rationale for assessing LEADER added value in the context of the 2023-2027 CSP and offer an example of an evaluation framework for practical implementation.
LEADER added value evaluation framework
The evaluation framework is developed around the three components of LEADER added value: improved social capital, improved governance, and enhanced results and impacts. Each component is analysed using its key constituent elements, associated with corresponding evaluation questions.
EQs help formulate the issues that need to be assessed, clarify the key evaluation element and guide the formulation of the corresponding FoS.
FoS further specify certain aspects of evaluation questions/topics and express the expected change of the evaluated intervention(s). They provide insight into how the EQs will be answered by specifying what must be assessed and by setting the rationale for developing and using specific metrics (output, result and impact indicators). They form the basis for establishing a causal chain and can be the core component for structuring evaluation findings.
For each FoS, a list of output, result and impact indicators, with their corresponding data sources, is proposed in these guidelines. These indicators use quantitative and qualitative data to measure the direction of change indicated by the FoS and consequently answer the EQ.
-
The following figure shows that the evaluation of LEADER added value contributes to the CSP impact evaluations. In the figure, the evaluation framework of the LEADER added value is divided into its three components: social capital, governance and enhanced results and impacts.
Based on the example of social capital, the figure shows that each component is further specified by key elements and evaluation questions. Each evaluation question can have one or several FoS. Each FoS has relevant output, result and impact indicators.
Such a framework is key to generating robust evidence on LEADER added value and identifying areas for improvement. It is recommended that Managing Authorities, if possible, in consultation with evaluators, develop such a framework early in the programming period. This allows for the adaptation and/or design of the necessary monitoring/information systems at LAG level to collect the required data and information.
Although Article 2(d) of Implementing Regulation (EU) 2022/1475 stipulates that the evaluation of LEADER added value is conducted at the CSP level, Member States can also initiate it at the local level
Learning from practice
Building the Evaluation Culture in Tuscany - Local Level LEADER Evaluation Support for LAGs
LEADER/CLLD Evaluation: Laying the Conceptual Foundation of the Approach
LEADER/CLLD Evaluation at a Glance
Danish Case Study - LAG Operations Database for the Monitoring and Evaluation of LEADER/CLLD
RURAL EVALUATION NEWS - Issue Number 4
RURAL EVALUATION NEWS - Issue Number 6
RURAL EVALUATION NEWS - Issue Number 9
LEADER-Aktionen zur lokalen Entwicklung im ländlichen Raum Österreichs
Publications
- FARNET Guide #15: Evaluating CLLD - Handbook for LAGs and FLAGs (2018).
- German Rural Network (2017): Self-evaluation in regional development: Guide and Methods box.
- Department of Rural and Community Development in Ireland (2018): LEADER Programme - Performance Monitoring Guidance.
- Department of Rural and Community Development in Ireland (2018): Ireland's LEADER Evaluation Handbook for Ireland’s Local Action Groups, Financial Partners and Implementing Partners.
- Pollermann, Kim; Raue, Petra; Schnaut, Gitta (2017) : Input for and output of local governance in rural development, Regional Studies Association, Annual Conference 2017: The Great Regional Awakening: New Directions, 4th – 7th June 2017, Trinity College Dublin, Ireland, ZBW - Leibniz Information Centre for Economics, Kiel, Hamburg.
- LAG of the Prealpi and Dolomiti areas (Italy). Use of the social networking approach to assess the added value of LEADER/CLLD in terms of social capital.
Events
Good Practice Workshop: Wie man den Mehrwert von LEADER bewertet
Wie wird der Mehrwert von LEADER bewertet?
- European Evaluation Helpdesk for Rural Development (ENRD), Good Practice Workshop ‘Showing the added value of LEADER/CLLD through evaluation’ (2018).
Examples of past evaluations
See the EU CAP Network’s publications database: LEADER Member States evaluations
Training materials
The following European Evaluation Helpdesk for the CAP training materials can be applied in Member State contexts:
Topic | Description | Presentation |
---|---|---|
Evaluation of the LEADER and its added value (2024) | The presentation is pertinent for the evaluation of LEADER in the 2023-2027 programming period. It outlines legal requirements for the evaluation of LEADER at CSP and local level. The presentation explains the concept of the LEADER added value and its operationalisation. It presents examples of the evaluation framework for the assessment of the LEADER added value. | Assessing the added value of LEADER 2024 |
Evaluation of LEADER/CLLD (2017) | The presentation covers the 2014-2022 programming period evaluation of LEADER/CLLD. It outlines the policy instrument CLLD for 2014-2020, focusing on its legal requirements, concept, and evaluation at both the RDP and LAG levels. It provides detailed steps for the evaluation of LEADER/CLLD and emphasises the support available for LAGs in their evaluation tasks. The presentation provides methodological guidance and practical tools. | Evaluation of LEADER/CLLD 2017 |
Quantification of LEADER/CLLD contributions and measuring their secondary effects (2020) | The presentation covers the 2014-2022 programming period evaluation of LEADER/CLLD and focuses on the issue of quantification of contributions and measuring their secondary effects. It includes a reminder of the evaluation framework, key issues and evaluation steps for quantifying contributions, such as checking consistency with intervention logic, developing program-specific evaluation elements and identifying evaluation methods. It addresses the need to improve LAGs' evaluation capacity and suggests methods and tools for data collection and analysis. The presentation contains practical exercises and suggestions for discussions on the topic. | Evaluation of LEADER/CLLD 2020 |
Further reading
Bewertung des Mehrwerts von LEADER
Working Package 1: Topic 4 - Quantification of LEADER/CLLD contributions and measuring their secondary effects
Evaluation of LEADER/CLLD
CAP Evaluation News – Mai 2024
GAP Bewertung Experteneinblicke in LEADER
- European Commission, Directorate-General for Agriculture and Rural Development, (2023). Evaluation support study of the costs and benefits of the implementation of LEADER: final report, Publications Office of the European Union.
Ressourcen
Documents
Assessing the added value of LEADER 2024
(PPTX – 1.07 MB)
Evaluation of LEADER/CLLD 2017
(PPTX – 2.07 MB)
Evaluation of LEADER/CLLD 2020
(PPTX – 894.72 KB)