- Case study
- Open Access
Background qualitative analysis of the European Reference Life Cycle Database (ELCD) energy datasets – part I: fuel datasets
SpringerPlus volume 4, Article number: 151 (2015)
The aim of this study is to identify areas of potential improvement of the European Reference Life Cycle Database (ELCD) fuel datasets.
The revision is based on the data quality indicators described by the ILCD Handbook, applied on sectorial basis. These indicators evaluate the technological, geographical and time-related representativeness of the dataset and the appropriateness in terms of completeness, precision and methodology.
Discussion and evaluation
Results show that ELCD fuel datasets have a very good quality in general terms, nevertheless some findings and recommendations in order to improve the quality of Life-Cycle Inventories have been derived. Moreover, these results ensure the quality of the fuel-related datasets to any LCA practitioner, and provide insights related to the limitations and assumptions underlying in the datasets modelling.
Giving this information, the LCA practitioner will be able to decide whether the use of the ELCD fuel datasets is appropriate based on the goal and scope of the analysis to be conducted. The methodological approach would be also useful for dataset developers and reviewers, in order to improve the overall DQR of databases.
The European Platform of Life Cycle Assessment (EPLCA), a project initiated by the Institute for Environment and Sustainability (IES), has the objective of promoting Life Cycle Thinking (LCT) and providing appropriate support to business and public administrations within the European Union (EU), as well as in close coordination with international activities. This support is essential, and is being achieved through the development of a number of different deliverables, being the European Reference Life Cycle Database (ELCD) one of them (Recchioni et al. 2014). The ELCD provides core Life Cycle Inventory (LCI) data from front-running EU-level business associations and, where not available, other sources. Several energy-related datasets are provided within the ELCD, since energy is a key input to most environmental analyses of products or processes. The ELCD latest version can be consulted on the JRC webpage: http://eplca.jrc.ec.europa.eu/ELCD3/.
Although LCA-based methodologies and tools seem to develop fast, the availability of quality-assured LCA data still represents a major bottleneck to a broader use of LCA and environmental footprint methods in business and in policy (Fazio et al. 2015). Under the framework of ISO standards (ISO 2006) some guidelines have been developed to address the Data Quality Requirements: i) ILCD handbook (EC-JRC 2010a) considers six indicators regarding technological representativeness, geographical representativeness, time-related representativeness, completeness, precision/uncertainty, and methodological appropriateness and consistency, ii) UNEP/SETAC life cycle initiative (UNEP 2011) also include reproducibility, representativeness, and information on data sources, iii) USLCI Database (2012) Project Development Guidelines describes the data quality basing on data age, source and collection method; data representativeness; averaging methods; methods used to estimate or justify data gaps; and information about key assumptions or methodological choices, and iv) Ecoinvent (http://ecoinvent.ch) proposes a specific Data Quality rating, named pedigree matrix, where include aspects such as geographical, technological and temporal validity, the origin, representativeness and validation of the data, and administrative information (Fazio et al. 2015).
The objective of this analysis is to identify areas of potential improvement of the ELCD fuel datasets quality, considering data available in third party life cycle databases and from authoritative bodies and/or business associations. The work has consisted in analysing and comparing fuel datasets from different databases, considering the ELCD database as the basis for this analysis. This effort has been carried out in two stages, which are summarized below:
Selection of datasets, databases and quality standards, in order to assure the methodology. This part aimed at providing a justified list of datasets and databases (and other sources) to consider in the subsequent analysis. Moreover, justified criteria and quality standards list have been clearly defined in order to be used in the analytical comparison.
Analysis and qualitative comparison of the datasets. Each selected fuel dataset was analysed according to the previously defined quality indicators. Then, findings and recommendations were derived in order to identify the potential improvements of ELCD datasets.
Selection of datasets and databases
The energy datasets to be analysed should be representative of the European context, and therefore a deep review of the most updated data in terms of fuel for EU -27 has been conducted.
According to European statistics (EUROSTAT 2012; EC 2011), there are four main petroleum products obtained from the European refineries: i) Diesel, which represents more than 37% of the refineries output; ii) Gasoline, which represents more than 20%; iii) Residual (or Heavy) fuel oil, which represents more than 15%; and iv) Kerosene, that represents more than 6%. Due to their relevance in the share of fuel production, these products were chosen for the analysis to be conducted.
Biofuels production has significantly increased during the last decade due to a favourable framework and the support of several policies. Nowadays biofuels represent 11% of the total biomass produced in EU-27, being biodiesel the highest contributor to the total production, 60% (EC 2011). The contribution of Europe to biofuels production is expected to increase due to its high potential. Nevertheless, this affirmation could be misleading because of two reasons: i) According to many studies the potential for European biofuels production is clearly limited, and ii) Currently (2013), a substantial share of biofuels used in Europe is based on imported feedstock. In case of increasing, rapeseed oil seems to be one of the raw materials expected to contribute the most in the share of biodiesel. So, in order to cover this potential fuel in the analysis, biodiesel from rapeseed oil was included as dataset.
Additionally, an analysis of the gross heat generation in the EU-27 pointed out the relevance of the natural gas as fuel, being its contribution to the heat generation around 44% (EC 2011). Then, natural gas was considered as the most important heat supplier dataset in the analysis.
The current fuel datasets available at the ELCD database have been originated from PE International (GaBi developers). The latest ELCD includes fuel datasets referring to EU-15. Since the scope of this evaluation is to analyse the ELCD datasets under the European context, it seems appropriate the use of datasets from GaBi that consider EU-27 as geographical horizon. Table 1 shows the six chosen datasets as the base for the comparison with other datasets.
These datasets have been compared to their counterparts from three other databases, which have been selected based on three main criteria: i) they include data related to Europe, ii) they include large data related to energy products and services, and iii) they are well recognised in the scientific community. The selected databases have been the following: Ecoinvent v2.2, GEMIS 4.7, and E3 database. Considering theses databases and the availability of datasets, Table 2 presents the list of datasets to be finally analysed. The database selection have been made irrespective of the methodological compliance of the database/datasets with the ILCD quality criteria: it was indeed assumed that although other databases might have lower DQR according to ILCD rules (because they were not specifically developed using these rules), datasets would represent interesting benchmarks and some improvement could be derived from the background analysis (Fazio et al. 2015).
Quality criteria for analysis
The evaluation has been based on the quality indicators developed within the ILCD handbook (EC-JRC 2010a, b, 2011): Technological representativeness (TeR), Geographical representativeness (GR), Time-related representativeness (TiR), Completeness (C), Precision/Uncertainty (P) and Methodological appropriateness and consistency (M). Each of those has been evaluated according to the degree of accomplishment of the criterion, from 1 (very good, so meets the criterion to a very high degree) to 5 (very poor, so does not at all meet the criterion).
An overall Data Quality Rating (DQR) of the datasets has been calculated by summing up the achieved quality rating for each of the quality criteria indicator, divided by the total number of considered indicators, as shown in Equation 1.
Nevertheless, it should be noticed that a single score indicator might lead to misleading interpretation of the results. Some datasets might not contain enough information to evaluate them against all criteria and summing all scores could be misunderstood. The analysis is focused on the improvement of ELCD fuel datasets and has been based on the available documentation and/or information of database providers. The unavailability of certain information does not automatically mean that a dataset is potentially worse than another.
The quality indicators described in the ILCD Handbook (EC-JRC 2011) provide a general framework to evaluate datasets. When applying these indicators to specific sectorial datasets, it is necessary to redefine them based on the specific characteristics of the processes/technologies in order to identify key aspects. This practice facilitates their use in the analysis of fuel energy systems. For this purpose, a deep pre-analysis of the technology situation was conducted, considering the European market context. The main features for assessing each criterion are summarized below (Fazio et al. 2015). Table 4 highlights both quality criteria definitions and values considered.
TeR, GR and TiR representativeness: These criteria define the degree to which datasets reflect true population of interest regarding technology, geography and time/age of the data, respectively. Datasets related to the most representative fuel technologies in each area, in the European market context, basing on the above mentioned statistic criteria derived from authoritative sources. The origins of the imported raw fuels (if any) for fuel production, have been listed for each chosen country. TiR has been related to the expected obsolescence of the technology applied (based on existing data) defined as the year/s in which inventory was collected, with a deviation of ± 5 years. The framework is the same proposed by the ILCD Handbook, however the sector-specific expert judgement has been used to define the above mentioned criteria (e.g. the adjustment on elementary flows coverage, quality of references, etc.), through the analysis of authoritative sources.
C: Defines the share of (elementary) flows that are quantitatively included in the inventory and should assess the degree of coverage of the overall environmental impact. It is assessed as the share of elementary flows, weighted on the number of environmental impact categories that are quantitatively included in the inventory. A pre-analysis based on sectorial experience, to identify the elementary flows (and within them a list of the most relevant ones in mass and/or impact basis) that allow the estimation of the 16 environmental impact categories mentioned at the mid-point level ILCD 2011 recommended method was done – see EC (2011) -. In this paper the preliminary analysis on completeness lead to a score based on the number of covered impact categories, then the score have been adjusted in relation to the coverage of relevant elementary flows included in the dataset (i.e. no changes if the flow list includes more than 75% of the flows, one level lower if the flow list is covered only from 50 to 75%, and 2 levels lower if the flow coverage is less than 50%)
P: Defines the measure of the variability of the data values for each data expressed. Decisive factors accounted were both the reliability of data and the uncertainty degree of the information (such as data, models and assumptions). Thus an expert judgement has been considered, based on the quality of the references and their sources, whether measured, calculated or estimated from literature.
M: Defines if the applied LCI methods and methodological choices are in line with the goal and scope of the data set, especially its intended applications and decision support context. To evaluate this criterion, a correct and consistent application of the recommended LCI modelling framework and LCI method approaches for the given situation, according to the ILCD Handbook, was applied, focusing on three issues: i) System boundaries; ii) End of Life (EoL) modelling iii) Multifunctionality (according to the different contexts defined in the ILCD Handbook.
The comparison of the selected datasets from different databases, referred to the same technology, can lead to the identification of potential improvements in each quality criteria. Moreover, relevant Authoritative Sources and Business Associations, which could provide additional information to improve the quality of the ELCD results, can be also identified in order to enhance the overall quality of data. It must be remarked that many recommendations are related to future updated versions of ELCD fuel datasets. Table 6 shows a summary of the findings and recommendations that arose from such cross assessment.
Conclusions and recommendations
This extended analysis of the ELCD fuel datasets aimed at providing better founded information related to its data quality, following the indicators developed and described within the ILCD handbook (EC-JRC 2011). This analysis, together with the ELCD electricity datasets one (Garraín et al. 2015), have meant an opportunity to implement these quality indicators to different datasets for the first time. It has had two main consequences. Firstly, the implementation of the quality indicators to the energy-related datasets from the ELCD has been used to understand the room for improvement in future ELCD versions. Additionally, it has also served to identify whether these data quality indicators are applicable and useful for database developers in general, as well as for LCA practitioners. It should be stated that results obtained from this analysis ensure the quality of the energy-related datasets to any LCA practitioner, and provide insights related to the limitations and assumptions underlying in the datasets modelling. Giving this information, the LCA practitioner will be able to decide whether the use of the ELCD datasets is appropriate based on the goal and scope of the analysis to be conducted.
Along the current analysis, several assumptions have been made in order to facilitate the analysis, such as the selection of databases and datasets or the definition of DQIs. The results have to be understood under this context. Taking those considerations into account, the data quality assessment conducted in here should not be extrapolated to datasets under different contexts. Furthermore, the analysis has been performed only to the most representative fuel datasets from the ELCD as well as from the selected databases. The conclusions obtained in this analysis cannot be extrapolated to other type of datasets, nor can be used to compare databases among them.
From the deep analysis conducted, it must be highlighted that the ELCD datasets have been modelled based on an extensive review of the most relevant literature and statistics. The documentation used to model the ELCD energy related datasets can be found in the Life Cycle Thinking Platform web-site (http://eplca.jrc.ec.europa.eu/ELCD3/).
In terms of the quality criteria, the analysed ELCD datasets showed a very good performance in the majority of the criteria, where several recommendations for improving have been detailed above. In the case of biofuels and although it fully complies with the methodology quality criterion, it would be advisable to harmonize the methodology recommended by the ILCD handbook and used in the biofuels ELCD datasets with the proposed by the EC in the framework of biofuels sustainability certification. E3 database fully follows this methodology and can be used as a source of data. The EC Energy Transparency Platform is also a source of relevant information.
Concerning the different technologies analysed, crude oil fuel based ELCD datasets achieve the best scores in all quality criteria. It is acknowledged the extensive use of Authoritative Sources and Business Associations as a source of data and the effort to apply an innovative allocation methodology avoiding black box unit scenarios. Natural fuel ELCD dataset performs better than any other database in five quality criteria. It has been modelled in a way that includes the most updated and precise natural gas supply mix in EU-27. The rapeseed biodiesel ELCD dataset has been analysed using the information provided by PE (2012a). Some information was missing and therefore, it could not be evaluated. The dataset lacks the raw material imports –rapeseed and rapeseed oil- which is considered to be a big limitation that should be improved. Regarding the methodology, as mentioned before, there is a lack of harmonization between the methodology used in the ELCD database and the methodology proposed by the EC in the framework of biofuels sustainability verification.
Considering the new research lines of the EC and the social debate generated from the potential shale gas exploitation in Europe, it is recommended to follow the development of this technology and the regulatory framework, so that the technology could be included in future versions, if necessary.
Regarding the use of authoritative sources, the ELCD database makes extensive use of the statistical information provided by the IEA (International Energy Agency). Although the IEA is of course an important authoritative source, for the European context it seems appropriates the use of data reported by each country to Eurostat. In order to improve precision, it would be advisable to make a more extensive use of Business Associations and Authoritative sources data that have been proposed through the analysis.
This analysis aims at providing guidance for the improvement of the fuel ELCD datasets in future versions. Since its first release, the ELCD database has been updated two times. The needs of reviewing and updating the ELCD database depend on the different sectors and the technologies. It would be useful to define periods to revise the fuel related datasets. For this purpose, a deep analysis of the learning curves would identify the level of maturity for new technologies (2nd and 3rd generation biofuels, fuel cells, etc.).
Finally, it should be noted that the selected databases are in a constant process of updating and improvement, e.g. Ecoinvent v3.0 or GEMIS v4.93, so a detailed analysis of these can offer further potential improvements to future ELCD versions.
EC-JRC (2010a) International Reference Life Cycle Data System (ILCD) Handbook – General guide for Life Cycle Assessment – Detailed guidance, European Commission - Joint Research Centre - Institute for Environment and Sustainability, First edition March 2010. EUR 24708 EN. Publications Office of the European Union, Luxembourg
EC-JRC (2010b) International Reference Life Cycle Data System (ILCD) Handbook - Specific guide for Life Cycle Inventory data sets, European Commission - Joint Research Centre - Institute for Environment and Sustainability, First edition March 2010. EUR 24709 EN. Publications Office of the European Union, Luxembourg
EC-JRC (2011) International Reference Life Cycle Data System (ILCD) Handbook- Recommendations for Life Cycle Impact Assessment in the European context, European Commission-Joint Research Centre - Institute for Environment and Sustainability, First edition November 2011. EUR 24571 EN. Publications Office of the European Union, Luxemburg
EUROSTAT (2012) http://www.eurostat.eu. Access March 2012
Fazio S, Garraín D, Mathieux F, de la Rúa C, Recchioni M, Lechón Y (2015) Method applied to the background analysis of energy data to be considered for the European Reference Life Cycle Database (ELCD). Springer Open (accepted, 2015)
Garraín D, Fazio S, de la Rúa C, Recchioni M, Lechón Y (2015) Mathieux F (2015) Background qualitative analysis of the European Reference Life Cycle Database (ELCD) energy datasets – Part II: Electricity datasets. Springer Open 4:30, doi: 10.1186/s40064-015-0812-2
ISO (2006) ISO 14044:2006 Environmental management - Life cycle assessment - Requirements and guidelines
JEC (2007) JRC-EUCAR-CONCAWE collaboration, Well-to-wheels Analysis of Future Automotive Fuels and Powertrains in the European Context, WELL-to-WHEELS Report, Version 2c, March
JEC (2011) JRC-EUCAR-CONCAWE collaboration, Well-to-wheels Analysis of Future Automotive Fuels and Powertrains in the European Context, WELL-to-WHEELS Report, Version 3c, July
PE (2012a) Documentation of energy datasets in GaBi 5.0. Confidential report provided by PE Inernational, Sttutgart, Germany
PE (2012b) The GaBi refinery model. PE Inernational, Sttutgart, Germany
Recchioni M, Mathieux F, Blengini GA (2014) Challenges and opportunities for wide publication of quality-assured LCI data: the experience of the Life Cycle Data Network. Int J Life Cycle Ass
RED (2009) Directive 2009/28/EC of the European Parliament and of the Council of 23 April 2009 on the promotion of the use of energy from renewable sources and amending and subsequently repealing Directives 2001/77/EC and 2003/30/EC. Official Journal of the European Union, 5th June
UNEP-SETAC (2011) Global guidance principles for life cycle assessment databases. A basis for greener processes and products., United Nations Environment Programme. http://www.unep.org/pdf/Global-Guidance-Principles-for-LCA.pdf.
USLCI Database (2012) National renewable energy laboratory., Accessed November 19, 2012. https://www.lcacommons.gov/nrel/search.
Both the methodology and the application described in this paper has been developed under the framework of a Tender (IES/H/2011/01/13/NC) negotiated between the European Commission and CIEMAT (Research Centre on Energy, Environment & Tech), called “Background analysis of energy data to be considered for the European Life Cycle Database (ELCD)”.
The authors declare that they have no competing interests.
The authors from CIEMAT (DG, CdlR, YL) carried out the analysis of the datasets, the authors from JRC (SF, MR, FM) mainly contributed in the development of the methodological framework and in editing. All authors read and approved the final manuscript.