Learning from Research

Sustainability indicators at the farm level for monitoring and evaluating the CAP

The FLINT project established a tested data infrastructure of 33 farm-level sustainability indicators for monitoring, evaluating and targeting the CAP and other related policy measures.

Output Description

The FLINT project establishes a tested data infrastructure with up-to-date farm-level indicators to monitor, evaluate, and target the CAP and other related policy measures. FLINT collects 33 farm-level sustainability indicators in 3 major domains: 

E1: Greening: Permanent grassland, E2: Greening: Existing/created areas of EFA, E3: Semi-natural farmland areas, E4: Pesticide usage (Pesticide risk score), E5: Nutrient balance (N, P) (farm-gate balance), E6: Soil organic matter in arable land, E7: Indirect energy usage, E8: Direct energy usage, E9: On-farm RE production, E10:Farm management to reduce nitrate leaching, E11: Farm management to reduce soil erosion, E12: Use of Legumes, E13: GHG Emissions per product, E14: GHG Emissions per ha, E15: Carbon Sequestration, E16: Water usage and storage, E17: Irrigation practices

EI1: Innovation, EI2: Producing under a label or brand, EI3: Types of market outlet, EI4: Farm succession, EI5: Efficiency field parcel (LPIS), EI6: Modernity of the farm Investment, EI7: Insurance (events outside the control of farm), including personal (disability) & farm (building structure) insurance, EI8: Share of output under contract with a fixed price, EI9: Risk exposure (non-agricultural activities)

S1: Advisory service provided to the farm, S2: Education and training, S3: Ownership/management, S4: Social engagement/participation, S5: Employment and working conditions, S6: Quality of life, S7: Social diversification: improving the image of farmers/agriculture in local communities

FLINT carried out several studies for each of these domains that combine the new sustainability indicators collected and integrated at the farm level with corresponding FADN data. The studies aim to examine the added value of the collected indicators in addressing policy evaluation questions.  

Studies for the environmental sustainability indicators include works on:  

The maintenance of permanent grassland is a prime policy target, expecting it to provide carbon sequestration and benefit local biodiversity. This study summarises novel environmental sustainability indicators that include the proportion of permanent grassland managed intensively or extensively, the proportion of permanent grassland managed extensively and with designated nature protection, and the area covered by semi-natural habitats.

This study includes all nine participating Member States. It compares three indicators for farm-level SOM management using FLINT data (CountPractices: count SOM relevant practices on-farm), FLINT and FADN data (SOM index: sum of the area with SOM-relevant farming practices divided by total farm area) as well as FLINT and FADN data + coefficients from standard data tables (SOM balance: SOM return to the field – SOM removal through harvest). Results indicated that the SOM index is the most suitable of the three indicators.

This study includes all nine participating Member States. However, many water indicators are only estimated for regions in Spain and Greece. It uses the FLINT indicators on ‘Water consumption and metering per source: rainfall storage, watercourse, groundwater, mains supply’, ‘Water consumption and metering per usage: livestock, irrigation, others’, and ‘Irrigation: network organisation, energy dependence, water payment system’.

Studies for the economic indicators include works on:  

This study includes all nine participating Member States except France. It defines the economically sustainable farm as the economically vulnerable farm regarding agricultural production but considered sustainable due to the presence of off-farm income. Differences in viability and economic sustainability are shown across the eight Member States surveyed. The analysis is sensitive to the factors included in the viability measurement and the threshold income used to define viability.

This study includes all nine participating Member States. It incorporates environmental outputs in the calculation of technical efficiency. It performs the analysis of the effects of CAP subsidies on technical efficiency for more than one thousand farms, with FADN data and additional data collected via the FLINT project. Results indicate that subsidies on farm technical efficiency changes when environmental outputs (greenhouse gas emissions, nitrogen balance and ecological focus areas) are considered in the efficiency calculation.

This study includes all nine participating Member States except France. It provides insight into different adoption rates of five types of innovation in agriculture across Europe. These types refer to product innovations that are new for the company within the last three years, new product innovations for the market, new process innovations for the company within the previous three years, new process for the market, and organisational innovations. In combination with the FADN database, the FLINT database is shown to have the potential for supporting policy on competitiveness and sustainability.

This study includes all nine participating Member States except France. It considers three complementary or substitutes three mainstream categories of risk management strategies: insurances, contracts, and alternative methods (such as diversification and off-farm income). It assesses the adoption of these strategies and the determinants of farmers’ choices for complementary or substitute instruments in the EU.

Studies on the social sustainability of farms include works on:

This study analyses the impact of farmer age on economic, environmental and social indicators of sustainability in the EU, incorporating new data from the FLINT project on the age at which a farmer becomes a decision-maker. Irish FLINT and FADN data combined suggest that the older the farmer is when they establish themselves as a decision-maker, the less likely the farm is to be sustainable and the more likely the farmer is to reside in a vulnerable household.

This study examines the use of extension services by farm households by exploring the type of extension service engaged with, the degree of engagement and the kind of information sought. In addition, the impact of extension services on economic, environmental and social sustainability is also considered. FLINT and FADN data combined outline how households engage with extension services and the implications for sustainability at the farm level. It also suggests that national policies primarily influence the degree to which households engage with extension services.

This study explores the use of advisory services and their linkages with sustainability as measured through FLINT indicators. Results indicate that differences exist concerning the number of contacts of farms with advisory services across countries, type of farms, farmers’ degree of agricultural education, utilised agricultural area, legal type of farm ownership and economic size of the farms. The number of contacts with advisory services is positively related to the adoption of innovations, measures for farm diversification, and the number of sources of information utilised at the farm level.

Relevance for monitoring and evaluation of the CAP

FLINT used the FADN network to collect additional sustainability indicators.  

Already, many Members States collect, through FADN Farm Returns additional information. For example, more than two-thirds of the countries collect information on themes such as irrigation practices, while information related to engagement in the local community, quality of life, and working conditions is collected by very few countries. Almost 20% of Member States collect data on key environmental variables such as nutrient balance, greenhouse gas emissions and pesticide usage 

FLINT proposes a systematic approach that covers a range of sustainability indicators directly related to policy evaluation. An increasing number of studies attempt to use data from FADN as proxies for environmental variables or farm practices in their assessments. Given the growing need for data on farms' economic, social and environmental sustainability performance, the FLINT’s 33 sustainability indicators are an inspiring start of what data should be collected for monitoring and how these data can be utilised for evaluating the CAP. The advantage of collecting this data in a systematic, integrated way is that it allows the evaluation of trade-offs and coherence of policy measures. For example, a policy measure may improve environmental performance at the expense of economic performance, or the action may support environmental and economic performance. 

The ideas and findings of FLINT have played an essential role in the further design and implementation of the Farm Sustainability Data Network (FSDN) proposed by the EU Farm to Fork strategy.  

The proposed sustainability indicators can be used without any adaptations, either in a stand-alone ad-hoc survey or as a supplement to a FADN survey.  

Relevance of the output per CAP Objectives

  • Specific Objective 1 - Ensure a fair income for farmers 
  • Specific Objective 2 - Increase competitiveness
  • Specific Objective 3 - Improve farmers' position in the food chain
  • Specific Objective 4 - Climate change action
  • Specific Objective 5 - Environmental care
  • Specific Objective 6 - Preserve landscape and biodiversity
  • Specific Objective 7 - Support generational renewal
  • Specific Objective 8 - Vibrant rural areas
  • Specific Objective 9 - Protect food and health quality
  • Cross-cutting Objective - Fostering knowledge and innovation

Additional output information

Data collection systems used:

  • FADN (FSDN)
  • Ad-hoc data collection

 

Type of output:

New / improved data for M&E

New indicators

Associated evaluation approaches:

  • Cost and benefit analysis 
  • Impact evaluation ex ante 
  • Impact evaluation ex post 

Spatial scale:

  • Farm holding

Project information

Flint Logo

Farm Level Indicators for New Topics in policy evaluation 

To establish a tested data infrastructure with up-to-date farm level indicators for monitoring and evaluating the CAP and better targeting CAP and other related policy measures.  

FLINT aims to demonstrate: 

  • the feasibility of collecting policy-relevant data in different administrative environments – with newly developed farm-level indicators of economic, environmental, social issues;  

  • how the new farm level indicators can be used to evaluate policies and improve the targeting of policy initiatives. 

FLINT’s specific objectives are to:  

  • Assess current and future policy evaluation needs;  

  • Review the data available to facilitate policy evaluation and identify any data gaps; 

  • Pilot the collection of additional farm-level data through the FADN under different data collection administrative environments;  

  • Test the value of the newly collected farm level indicators for policy evaluations; 

  • Make recommendations about the future data collection in the EU. 

Project’s timeframe: 2014 – 2016

Contacts of project holder: Hans Vrolijk, Wageningen Economic Research, part of Wageningen Research (hans.vrolijk@wur.nl)

Territorial coverage: Finland, France, Germany, Greece, Hungary, Ireland, Poland, Spain, The Netherlands