European Innovation Partnership Wales Evaluation Phase 2: Interim Evaluation Report

The evaluation report is an interim report on the EIP Wales, covering the 2014-2020 programming period under the Welsh Government Rural Communities - Rural Development Programme (RC-RDP). The evaluation has been undertaken between 2021 and 2023 and covers the scheme over six years from 2016 to 2023.

The scope of this evaluation encompasses a comprehensive assessment of the EIP Wales initiative, focusing on its implementation and impact. The evaluation seeks to measure the effectiveness of services provided through Farming Connect, the application and decision-making processes, the role of innovation brokers, and the design aspects of the EIP scheme. Additionally, it aims to assess how well project findings have been disseminated, the innovativeness of the projects, and the overall impact of these initiatives on the Operational Group members. It also examines whether EIP Wales has successfully addressed Welsh government’s cross-cutting themes, particularly in the areas of sustainable development and climate change adaptation.

The evaluation used a mixed-method approach, combining qualitative and quantitative methods, adhering to HM Treasury Green, Magenta and Aqua Book guidelines. It included desk research, a survey of 239 Operational Group (OG) members, interviews with delivery staff and innovation brokers, and a theory of change workshop.

The evaluation faced several methodological limitations. Only farmers and foresters responded to the survey and, thus, informed this report.

According to the evaluation report, usually feedback is received from one or two OG members per project (20 of the 40 projects had one response and 14 had two responses). There were a few projects, however, in which several OG members had responded to the survey, including one project in which nine survey responses were received, another in which seven responses were received, and two in which six responses were received (the remaining two projects had three responses each). This may skew the survey feedback included in this report because the overall sample may be disproportionately affected by positive or negative feedback relating to the success of those projects.

Also, as only 20 of the 46 projects were completed at the time of this interim evaluation, the ability to assess long-term outcomes and dissemination activities was constrained. Finally, non-beneficiary feedback was limited to those who withdrew or had unsuccessful applications, which may not fully represent all potential participants.

The scheme effectively supported a wide range of projects, with most OG members reporting positive outcomes. Projects led to increased confidence, knowledge, and business improvements, with many introducing new practices or achieving cost savings and improved collaboration. Many OG members indicated their intention to continue working together in the future. The support fostered innovation, with high additionality; most projects would not have progressed without EIP Wales funding.

Around 72% of OG members strongly agreed that their projects were successful, and approximately 83% reported being either very or somewhat satisfied with the support they received during the project delivery. Specific impacts of the projects were evident, with 84% of respondents indicating they had applied new practices on their farms as a direct result of participating in the scheme. Additionally, 54% of respondents reported that they have been able to generate new income or reduce costs as a result of the project, particularly in the areas of animal health and nutrition, with reductions in antibiotic use.

The scheme also addressed cross-cutting themes such as equal opportunities, sustainable development, and tackling poverty. Of the 46 applications, 45 claimed to promote equal opportunities, mainly through gender balance and support for young people. One project addressed the Welsh language, with support assumed to have positive benefits due to the economic importance of agriculture to Welsh-speaking communities. Sustainable development was a key focus, with 43 projects targeting waste reduction and efficiency improvements. Additionally, 43 projects aimed to tackle poverty and social exclusion, improving skills, raising household income, and enhancing health outcomes.

In terms of innovation, the evaluation assessed the extent to which EIP Wales raised awareness and encouraged broader industry adoption of innovative practices. The analysis showed that only six out of 26 projects introduced new practices within the sector, but 77% brought new methods to Wales. In many cases, the innovation lay in the application of existing technologies, with the scheme being used to test their cost-effectiveness

The evaluation found that innovation brokers (IBs) played a crucial role in delivering projects by providing facilitation support, helping manage complex tasks such as sourcing materials and data collection. 87% of the 46 projects engaged IBs, whose role was highlighted as essential, with 92% of lead applicants expressing high satisfaction with the support they received from their IBs in refining and developing their project ideas. While the robust application and appraisal processes ensured that projects were scientifically sound, there were concerns about the role of IBs potentially diluting the bottom-up approach. The evaluation also considered the appropriateness of the scheme's delivery model, the balance between bottom-up ownership of the project and scientific rigour and the degree to which the scheme aligned with strategic innovation needs in agriculture and forestry. Recommendations included more targeted project selection in future schemes to ensure alignment with strategic objectives and broader sectoral needs.