Learning Portal

Learning Portal - Planning evaluations

Why is planning evaluations important? How is an evaluation plan for a CAP Strategic Plan structured? What specific aspects of a CAP Strategic Plan need to be evaluated? When do evaluations of a CAP Strategic Plan take place? What are the key components of a comprehensive evaluation framework for CAP Strategic Plans?

Creative designer drawing website

Basics

Why do we evaluate CAP Strategic Plans?

Evaluations are carried out because they provide significant benefits for better and more efficient policy planning and delivery. More specifically, the evaluations of CAP Strategic Plans are useful for:

  • Demonstrating the progress and achievements of a CAP Strategic Plan and justifying the use of its funding.
  • Providing information that improves the focus of interventions and therefore increases policy efficiency.
  • Ensuring accountability and transparency of a CAP Strategic Plan’s implementation.
  • Serving as a communication channel between the Managing Authority and the European Commission, as well as key stakeholders involved in the design and implementation of the plan.
  • Providing evidence and a solid analytical base for the design of future plans and policies.
  • Constituting a continuous learning and improvement process that contributes to a higher level of quality during the implementation and future designs of the plan.

How to plan?

An evaluation plan is a written document that describes how you will evaluate your CAP Strategic Plan and how you intend to use evaluation results to improve implementation and decision-making. The plan clarifies how you will describe the ‘What’, ‘How’, and ‘Why It Matters’ for a CAP Strategic Plan.

For the new CAP, the evaluation plan is the instrument for Member States to structure, manage, and steer assessments of their CAP Strategic Plans. It also helps achieve a common understanding of evaluation needs, objectives, responsibilities, and tasks while contributing to the identification of appropriate data and resources. It establishes greater transparency and the ability to steer future policy design.

Evaluation plans are submitted to the Monitoring Committee no later than one year after the approval of a CAP Strategic Plans. The European Commission does not need to approve evaluation plans, but it does take note of them. Member States shall share information on evaluation activities and findings with the Commission after an examination by the Monitoring Committee and no later than one month before the annual review meeting. What must be shared with the Commission includes:

  • Information on evaluation activities and findings (i.e. progress made in carrying out evaluations, syntheses of evaluations and follow-ups on findings).
  • And any amendments to the evaluation plan itself.

The evaluation plan ensures that:

  • All appropriate evaluation activities will take place.
  • Sufficient and appropriate resources will be available to undertake all the necessary evaluations.
  • The data required for evaluations will be available in a timely manner and appropriate format.

Thus, the evaluation plan enables Member States to:

  • Improve the planning and structuring of evaluations of a CAP Strategic Plan.
  • Improve the orientation of monitoring and evaluation activities, establish a clear link between them and align them to the priority needs of different stakeholders involved in a CAP Strategic Plan.
  • Improve the use of evaluation results, as well as their effective integration, communication and dissemination.

As set out by Article 140 of Regulation (EU) 2021/2115, evaluations improve the quality of plans' design and implementation. Member States are required to evaluate their CAP Strategic Plan during and after the implementation period (ex post evaluation).

To meet evaluation requirements, Member States shall develop an evaluation plan that meets the minimum requirements listed in Annex II of Commission Implementing Regulation (EU) 2022/1475. The evaluation plan contains, among other things, information on the planned evaluations during the implementation period from 2023 until 2027 and for the ex post evaluation in 2031.

What to evaluate?

Member States shall evaluate each CAP Specific Objective (10 in total) at least once during the implementation period, if relevant, in accordance with a CAP Strategic Plan’s intervention logic.

Specific Objectives can be assessed individually or grouped together (i.e. comprehensive evaluations covering several objectives) in line with the necessary intervention logic. If a Specific Objective is not evaluated during the implementation period, then Member States should provide justification for it.

Specific interventions or topics will be evaluated according to each Member State’s evaluation needs, its CAP Strategic Plan intervention logic and the state of the implementation itself.

Specific evaluation topics include:

  • Identifying LEADER added value.
  • National CAP Networks.
  • The Agricultural Knowledge and Information System (AKIS).
  • Climate architecture and the environment.

The simplification of administrative burdens on beneficiaries is also a potential topic for an efficiency assessment.

When to evaluate?

In the period from 2023 to 2027, the Commission and Member States will have to carry out two types of evaluations:

  • Evaluations conducted during the implementation period of the 2023-2027 CAP programming period.
  • An ex post evaluation that has to be completed by 31 December 2031.

Evaluations should be planned during the implementation period so results are timely available for the discussions on the following programming periods (i.e. after 2027), both at the national level and at an EU level. Member States are encouraged to use data available from the previous 2014-2022 programming period for their assessments as well.

Step-by-step

Member States are encouraged to establish an evaluation framework. Typical actions related to an evaluation framework include:

  • Use relevant evaluation criteria considering the scope, type and up-take of a CAP Strategic Plan’s intervention. The criteria are effectiveness, efficiency, relevance, coherence and EU added value. In addition, Member States will also assess the impacts in relation to their contribution to achieving the General and Specific Objectives addressed by a CAP Strategic Plan through the use of impact indicators. This means that if a Specific Objective is not addressed, there is no requirement to assess the impacts thereof. However, a justification needs to be provided. The overall impact of the CAP Strategic Plan will be assessed only during the ex post evaluation (i.e. 2031).
  • Where relevant, consider the territorial scope of interventions. This applies particularly to interventions that are not implemented at a national level but at local or regional levels.
  • Identify key evaluation elements to assess (e.g. for the evaluation criteria of effectiveness, Annex I of Commission Implementing Regulation (EU) 2022/1475 includes further specifications, notably for each Specific Objective, in which key evaluation elements as well as factors of success are identified. However, for the other evaluation criteria, Annex I does not include any specifications).
  • Formulate evaluation questions and factors of success to assess evaluation criteria of effectiveness, efficiency, relevance, coherence and the EU added value (Annex I of Commission Implementing Regulation (EU) 2022/1475 offers recommendations for factors of success). During the previous CAP programming period (2014-2022), there were 30 EU-wide common evaluation questions, accompanied by judgement criteria for focus areas and for the programme level. For CAP 2023-2027, a Member State can develop its own evaluation questions for assessing the above evaluation criteria.
  • Consider all relevant common indicators (output, result, impact and context) for analysing the effects of a CAP Strategic Plan on Specific Objectives. Net effects should be calculated for the individual impact indicators (listed in Annex III of Commission Implementing Regulation (EU) 2022/1475).
  • If needed, use additional relevant information (quantitative and qualitative) and additional indicators other than the common ones to help draw relevant conclusions on the impact of a CAP Strategic Plan.

The regulatory framework uses the term ‘where relevant’ in various instances when referring to what and how to evaluate. This means that Member States should address all relevant aspects. Some aspects may always be relevant (e.g. LEADER added value), which are included in all CAP Strategic Plans and should, therefore, be evaluated by all Member States. Other aspects may be relevant in some Member States (e.g. the territorial scope is more relevant in regionalised Member States as opposed to non-regionalised Member States).

Evaluation Plan outline

The seven sections of an evaluation plan are covered in the table below. For each section, minimum and additional content is proposed, based on Annex II of Commission Implementing Regulation (EU) 2022/1475. Member States may choose to change the order of the evaluation plan sections as per their needs, i.e. one could argue stakeholder mapping comes first since stakeholders need to be consulted to gather their needs, while at the same time, some stakeholders may also play a role in data provision or contributing to the identification of evaluation topics.

Section of the evaluation plan Minimum content (Regulation) Additional content (recommended)
1. Objectives and needs
  • Objective evaluations and needs
  • Ensuring sufficient activities are undertaken
  • Evaluation activities
  • Evaluation topics
2. Governance and coordination
  • Monitoring and Evaluation (M&E) arrangements
  • Main bodies and responsibilities
  • Structures to effectively manage the planning, implementation and quality of evaluations
3. Stakeholder mapping
  • Description of relevant stakeholders
  • Stakeholder needs
  • Capacity building needs
  • Stakeholder map
  • Classification of stakeholders
  • How to use stakeholder mapping
4. Timeline

Planning of evaluations:

  • Contribution to CAP objectives during the implementation period
  • Evaluation of specific topics
  • Accompanying studies and other research and analysis activities

Roadmap of evaluations, including all types of evaluation activities:

  • Evaluations
  • Evaluation support studies
  • Capacity building activities
  • Monitoring systems development
5. Data and information
  • Arrangements for data availability
  • Data sources
  • Institutional arrangements for data provision and data quality
  • Identification of data gaps and remedial actions when addressing those gaps
  • Data systems operational on time

A general evaluation framework for identifying data gaps that include:

  • Indicative evaluation questions
  • Factors of success
  • Indicators
  • Data sources
6. Communication and follow-up
  • Approach for disseminating evaluation findings to target recipients
  • Mechanisms to follow up on the use of evaluation results
  • Description of the communication plan
  • Goals for communicating evaluation findings
  • Role of National CAP Networks
7. Resources, technical support and capacity building
  • Description of resources needed to implement the evaluation plan (administrative capacity, data, financial resources and IT needs)
  • Description of the implementation of programme support (i.e. technical support, capacity building activities, LAG support in terms of evaluation activities)
  • Structured capacity building plan for LAGs for evaluating local development strategies

Links between different sections of the evaluation plan

 Links between different sections of the evaluation plan

Links between different sections of the evaluation plan

The figure illustrates the interlinkages between the seven chapters of an evaluation plan in the Common Agricultural Policy programming period 2023-2027: governance and coordination, stakeholder mapping, needs and objectives, timeline, data and information, resources (technical support and capacity building), communication and follow-up. Each chapter is interconnected, ensuring a comprehensive and coordinated approach to evaluating the implementation of the CAP Strategic Plan and its impact. Stakeholder mapping influences the identification of evaluation needs and objectives, which in turn guides the development of the evaluation timeline, data collection, and resource allocation for evaluation. Effective communication and follow-up ensure stakeholder engagement, while the governance and coordination of evaluation provide the necessary oversight to integrate and align all components of the evaluation plan.

Main takeaway points

  • Evaluating CAP Strategic Plans is essential for demonstrating progress and ensuring policy effectiveness, efficiency, relevance, coherence and EU added value.
  • An evaluation plan must clearly outline the objectives, methodology and importance of the evaluation process.
  • Evaluations should focus on each Specific Objective of a CAP Strategic Plan, assessing them individually or in groups, and justify any objective not evaluated.
  • Evaluations are conducted during the implementation period (2023-2027) with a final ex post evaluation expected by 31 December 2031.
  • A robust evaluation framework should include relevant criteria and evaluation questions, as well as consider territorial scope and the use of common indicators.

Learning from practice

Published evaluation plans of Member States

Training material

Key evaluation concepts for 2023-2027 based on Regulation (EU) 2022/1475 in relation to the evaluation ​of CAP Strategic Plans and evaluation plans (purpose, structure and content), according to the European Evaluation Helpdesk for the CAP’s guidelines on the evaluation plan.

English language

Presentation on the ‘Evaluation of CAP Strategic Plans. Evaluation WORKS (2023)’

(PPTX – 12.24 MB)

Further reading

Publication - Guidelines and tools |

Guidelines - Design of evaluation plans