of 29

Report of the Data and Information Group (DIG)

ICES DIG REPORT 2015 ICES SCIENCE COMMITTEE ICES CM 2015/SCICOM:02 REF. SCICOM, ACOM Report of the Data and Information Group (DIG) May 2015 Copenhagen, Denmark International Council for the Exploration
0 views29 pages
All materials on our website are shared by users. If you have any questions about copyright issues, please report us to resolve them. We are always happy to assist you.
Documenttranscript
ICES DIG REPORT 2015 ICES SCIENCE COMMITTEE ICES CM 2015/SCICOM:02 REF. SCICOM, ACOM Report of the Data and Information Group (DIG) May 2015 Copenhagen, Denmark International Council for the Exploration of the Sea Conseil International pour l Exploration de la Mer H. C. Andersens Boulevard DK-1553 Copenhagen V Denmark Telephone (+45) Telefax (+45) Recommended format for purposes of citation: ICES Report of the Data and Information Group (DIG), May 2015, Copenhagen, Denmark. ICES CM 2015/SCICOM: pp. For permission to reproduce material from this publication, please apply to the General Secretary. The document is a report of an Expert Group under the auspices of the International Council for the Exploration of the Sea and does not necessarily represent the views of the Council International Council for the Exploration of the Sea ICES DIG REPORT 2015 i Contents Executive summary Opening of the meeting Adoption of the agenda Progress on ICES Data Plan ASC theme session proposals Other topics ICES Data Centre InterCatch and Regional Database (RDB) Fishframe DATRAS Quality control database Spatial facility Data archaeology Other topics Digital citation Recent developments Marine Scotland Other organisations The 8 principles on Data Citation Agreement Incorporation of citation guidelines in ICES Data Policy Data guidelines Data guidelines submitted to IODE/JCOMM/ICES clearing house (ocean data practices) Data guidelines not yet submitted to IODE/JCOMM/ICES clearinghouse Other topics Training Making the most of ICES data Data availability for and data transfer between ICES groups Data availability for ICES groups Data transfer between ICES groups First step forward Follow-up of actions and recommendations recommendation to DIG and 2014 recommendations from DIG... 17 ii ICES DIG REPORT DIG Actions Annex 1: List of participants Annex 2: DIG Agenda Annex 3: DIG Draft Terms of Reference for the next meeting Annex 4: Recommendations and Actions Annex 5: Data Plan tables Annex 6: SCICOM response on endorsement of 8 principles on Data Citation Annex 7: Training Making the most of ICES Data Annex 8: Template for inventory of data(products) used by ICES Expert Groups Annex 9: Data availability in ICES groups... 46 ICES DIG REPORT Executive summary The Data and Information Group (DIG) met in Copenhagen, May people representing 9 different countries, a representative from OSPAR, Head of ICES Data Centre, and ca. 10 members of the ICES Data Centre joined the meeting. During the 2015 plenary meeting, the group reviewed the progress related to the data deliverables of ICES Strategic Plan and furthermore met up with ICES Data Centre, and discussed digital data citation, progress on ICES Data Guidelines, and data availability between and within ICES Groups. Data availability in ICES groups As concluded by a number of groups and recently highlighted at the Bureau meeting in February 2015, there is an issue in the ICES strategic plan implementation in the systematic understanding of what data sources are being used, by whom, what is the quality of these data, how access is provided to these data, and when, and where the gaps in provision of data and data products are. This undermines the advice process, and is likely a cause of inefficiencies and duplication of effort. To (1) have an overview of the datasets/-products used and/or created by all ICES Expert Groups, and (2) gain insight in the data flows between the groups, DIG proposed an approach to ACOM and SCICOM chairs. Eight pre-selected ICES Expert Groups will be asked to fill in meta data of the datasets/- products they use and/or create and/or manage in an online catalogue, which will be publicly available and searchable. After the eight groups have provided the information, the information and the filling process will be evaluated by DIG, and other groups will be asked to add to the catalogue. The catalogue will also be pre-filled with information about existing ICES managed datasets and data products (stock assessment graphs, survey indices, ICES database regional datasets, etc.). ICES dataset collections and portals Tools and facilities that have been developed by the ICES Data Centre were presented and discussed: Commercial catch sampling: It is important to align Regional Database (RDB) Fishframe and InterCatch as data submitters now have to submit the same data twice, on different aggregation levels. DIG supports the decision made by ICES Council to fund an extra person for 1.5 years to work on the RDB. Biological trawl survey: The most recent developments of the Database on Trawl Surveys (DATRAS) were presented. In October 2014, the Workshop on Integrating DATRAS Products (WKIDP) took place. This group defined new output products from the DATRAS system, and encouraged ICES Data Centre to make tools developed outside ICES available via the DATRAS webpage. Quality Control: The database contains all checks that are carried out on ICES databases, to create insight in quality flagging. A DIG subgroup will, intersessionally, think along with ICES Data Centre in 2015 to make quality information on databases available to end-users. Data archaeology: For the EMODnet Biology project, Danish benthic data and trawl data for eel, including stomach data and other fish species caught were digitised as a pilot to investigate the time needed to digitise historic data. 4 ICES DIG REPORT 2015 ICES can only carry out data archaeology at ICES when project funding is available. DIG pointed out that historic data are very relevant for baseline studies for MSFD. Marine litter: The litter (seafloor, microplastics) reporting format is ready and tested. Two input formats were developed: one using the DATRAS id key, and an option for environmental reporting format ERF3.2. Data will be presented through the data portal as one marine litter data type. Hydrochemical: The ICES Data Centre is facilitating making the HELCOM Eutrophication Assessment operational through the EUTRO-OPER project. ICES Data Guidelines ICES exposes its Data Guidelines on the ICES website ( and, since mid-2014, also on the repository of IODE/JCOMM/ICES ( However, a short survey in 2014 learned that the existence of the ICES Data Guidelines is greatly unknown. DIG asked ICES and IODE to provide usage statistics of the Data Guidelines from both the ICES website as well as from the Oceandatapractices Repository. Based on the outcome of the statistics, DIG will decide on whether and how to review and update the existing Data Guidelines. Digital Data Citation Citation of data can give proper credit to data providers who have made data available to the scientific community. Operational examples of Digital Data Citation were discussed. ICES Data Plan On most topics scheduled for 2015, progress had been made. On some topics, ICES Data Centre could not make progress due to budget restraints. ICES DIG REPORT Opening of the meeting The Data and Information Group (DIG) met in Copenhagen, May people representing 9 different countries, a representative from OSPAR, Head of ICES Data Centre, and ca. 10 members of the ICES Data Centre joined the meeting. The participants list is in Annex 1. DIG participants in Adoption of the agenda The Terms of Reference of the group were as follows: a ) b ) c ) d ) e ) Review priorities on the Data Centre action list Provide guidance and feedback to the ICES Data Centre Advise on other data regulations and their impact on ICES Data Strategy, ICES Data Policy Review output from offspring groups (WKIDP, LinkedIn Data and Information Forum) if relevant Promote new technologies and data management infrastructure development Products (e.g. updated data management guidelines, reviews of ICES Data Strategy, ICES Data Policy, etc.) from the meeting as well as a written report to SCICOM will be delivered before 15 July The group reports to SCICOM during the SCICOM midterm meeting March 2015 as well as the SCICOM meeting at ICES ASC The group reports to ACOM by correspondence and via the ACOM representative. Main topics discussed during the meeting were: i. Progress on ICES Data Plan (Chapter 3, Annex 5, related to ToR a) ii. Information exchange with ICES Data Centre (Chapter 4, related to ToR b) 6 ICES DIG REPORT 2015 iii. Digital citation, mainly focusing on data, within ICES (Chapter 5, Annex 6, related to ToR e) iv. Availability, versioning and visibility of ICES Data Guidelines (Chapter 6, related to ToR d) v. Develop training Making the most of ICES Data (Chapter 7.1, Annex 7) vi. Data flow between ICES groups (Chapter 7.2, Annex 8) The agenda of the meeting is in Annex 2. 3 Progress on ICES Data Plan The ICES Data Plan was reviewed and the status of the different topics was identified. All items having a deadline or milestone in 2015 were discussed by DIG and the status was added to the table. This chapter only contains some general discussions and the actions resulting from the discussions. The data plan tables including the status can be found in Annex ASC theme session proposals The DIG ASC theme session proposal was rejected. Over the last years, it has become clear that only combined data sessions with other (scientific) groups were accepted. As Data is one of the ICES Strategic pillars it is important that this comes forward at the ICES ASC. DIG finds it very important to have Data as a topic present at the ICES ASC, whether it is as a theme session or in a different format. This point will be brought forward during Bureau meeting in June and will be discussed with the ASC organisers. The Big Data session at ASC 2014 was a moderate success. DIG should be prepared that there is sufficient expertise in and support for the session once it is accepted. 3.2 Other topics An extra column has been added to the Data Plan tables (Annex 5) describing the progress till May Where relevant, a reference to a section in this report is provided. 4 ICES Data Centre The ICES Data Centre presented last year s major developments and asked for feedback. 4.1 InterCatch and Regional Database (RDB) Fishframe The main focus of the RDB on the short term is to support regional coordination meetings (RCMs). It is important to align RDB and InterCatch as data submitters now have to submit the same data twice, on different aggregation levels. The EU funding for RDB only supports maintenance and hosting, and not development. Development should so far go via projects, but ICES intention is that EU also will fund the RDB development. Currently a 1.5-year time-limited development period is funded from ICES budget. It is currently not clear how many stock coordinators are using the RDB. This should become clearer once metadata on the datasets used is being provided by the various expert groups. In the most optimal case, re-aggregation (e.g. in case of area and temporal level) of data from InterCatch could be done based on RDB. Feedback about the use of InterCatch experienced by the expert working groups WKBALTCOD (Benchmark Workshop on Baltic Cod Stocks) and WGBFAS (Baltic ICES DIG REPORT Fisheries Assessment Working Group) was presented (see also the relevant group reports). To conduct benchmark assessments for the two Baltic cod stocks within WKBALTCOD, a data call was issued. Instead of the normally used age based data, length based data should be uploaded to InterCatch. Since many countries imported the same catches again, but with different metiers (catch data was imported for the assessment as e.g. Trawl and then again for WGBALTCOD as Active ), many double data sets were included in InterCatch. The functionality that data imports for the whole year would all be included was not communicated clearly enough to data providers with the data call. Correction of these errors as well as some additional database issues increased the workload of the stock coordinators using InterCatch. The final achievement of length-based catch data was not only delayed by several weeks but the results still showed large discrepancies. WKBALTCOD recommends that either InterCatch is enhanced and/or that investments are done in the further development of RDB. Simple, simultaneous storage and use of age and length data for a given year as well as holding and merging of more than one data set (stratum) per year, together with the possibility to select the needed strata when extracting data, should be possible. Based on the experiences when using InterCatch to prepare and aggregate stock data for the assessment of cod, flatfish and small pelagics in the Baltic, WGBFAS recommends that DIG considers a transition to the FishFrame/RDB platform with a clear timeline for implementation. This is based on the opinion that a database with access to raw data is preferred, so that data handling for benchmarks and exploration of data would be enhanced. In addition, several functions that are requested by stock coordinators are available in RDB, already. DIG discussed the feedback and recommendations from the working groups and supported the decision made by ICES Council to fund an extra person for 1.5 years to work on the RDB. ICES Data Centre presenting achievements to DIG. 4.2 DATRAS The most recent developments of the Database on Trawl Surveys (DATRAS) were presented: 8 ICES DIG REPORT 2015 In October 2014, the Workshop on Integrating DATRAS Products (WKIDP) took place. This group defined new output products from the DATRAS system. Products related to IBTSWG surveys and WGBIFS surveys are online available. The products from the Beam trawl survey data are almost ready and will be put online this summer. MSFD product for MSFD large fish indicator (LFI) is under review and will be available when agreed upon. During the Working group on demersal fish in North Sea and Skagerrak (WGNSSK) in 2015 it appeared that by the major submission agreed by IBTS Working Group changes occurred in the indices of some species. This was caused by an incomplete data submission by one of the countries. It is important to think about how to register changes in the database. Currently QA/QC version control is data submitter s responsibility, but there is a role for ICES too. There is a joint ICES/IMARES (Netherlands) project to automize data submission to DATRAS. It will be made as generic as possible so other countries can easily join if this project is successful. Partial upload for DATRAS data will be ready this year. The current DATRAS web services were tested by VLIZ and no problems were found Changes suggested by WKDATR (2013) were successfully implemented in DATRAS in Quality control database The (internal ICES) database contains all checks that are carried out on ICES databases. The checks are however not easy to understand for non-experts. The reason for setting up the database was to get insight in quality flagging, so it should be investigated which information should be shared with the end- users. A DIG subgroup will, intersessionally, think along with ICES Data Centre in 2015 to make quality information on databases available to end-users. 4.4 Spatial facility There is a new (Arc GIS based) spatial facility under development. Metadata are easily accessible via this facility and features are being developed to create user-friendly output. DIG discussed the pros and cons for a facility based on ArcGIS, as opposed to an open-source approach. A DIG subgroup is installed to support ICES Data Centre in the development of new features, and test the facility. 4.5 Data archaeology For the EMODNET Biology project, Danish benthic data and trawl data for eel, including stomach data and other fish species caught were digitised. It was a pilot to investigate the time needed to digitise historic data. The output of the ICES Working Group on the History of Fish and Fisheries (WGHIST) was used to locate historic data. ICES can only carry out data archaeology at ICES when project funding is available. DIG pointed out that historic data are very relevant for baseline studies for MSFD. In June an EMODNET workshop will be organised how to best retrieve information from written lists. OCR (optical character recognition) does not work properly for most paper entries. To be able to get better insight in historic data, DIG recommends that ICES DIG REPORT WGHIST makes the list of historic datasets publicly available. It was mentioned in the discussion that crowdsourcing might be a way to digitise historic data, although this should be thoroughly investigated before implemented. 4.6 Other topics The litter (seafloor, microplastics) reporting format is ready and tested. Two input formats were developed: one using the DATRAS id key, and an option for environmental reporting format ERF3.2. Data will be presented through the data portal as one litter data type. The stock assessment graphs are ready and being used by stock assessment groups and in the advice Fish eggs and larvae database: major steps were made by the Workshop on the ICES Egg and Larval Database (WKIELD) in April Multiple datasets were made available to the database. It was decided that fecundity and atresia data will be incorporated in a separate ICES database. The addition of MIKey data (a small net attached to the regular MIK net used for herring larvae sampling during Q1 IBTS) was discussed and agreed upon. HELCOM Eutrophication Assessment Tool (HEAT): The ICES Data Centre is facilitating making the HELCOM Eutrophication Assessment operational through the EUTRO-OPER project. The ICES Data Centre will be hosting the assessment database where the individual indicators will be calculated base ona factsheet per indicator. The implementation will be finalized by October ICES is partnering in the H2020 project AtlantOS and has a task to create an acoustic (treated data) database. The acoustic database is under development in collaboration with WGFAST and WGIPS, and overseen by SSGIEOM 5 Digital citation 5.1 Recent developments ICES investigated the possibility to mint Permanent Identifiers (PIDs) to datasets. A contract was drafted with the Danish PID provider (DTU), but it was not signed to budget cuts. This year no budget yet. Technically it is possible to mint PIDs to datasets at ICES Marine Scotland At Marine Scotland data citation has been made possible. UK and Scottish government has in general been moving into more open data and open data publication and through participating in ICES discussions on mechanisms for data citation has enabled us to implement persistent identifiers, in this case DOIs. Marine Scotland launched the marine data publication portal in November 2014 and is now gradually building up published datasets and reports from Marine Scotland. The data publication portal at Marine Scotland marinedata.scotland.gov.uk is built using a workflow that comprises by both internal metadata and a public facing data portal which provides the landing pages for the individual DOIs: 10 ICES DIG REPORT Other organisations BODC (UK) producing DOIs for some time (see NIOZ (NL) developed a repository for publication which can also hold underlying datasets. Data part is not well known, but technically in place. VLIZ (BE) created guidelines and steps on data citation. 5.2 The 8 principles on Data Citation Agreement The 8 principles of the Joint Declaration of Data Citation were reviewed by DIG in 2014 and in 2015 SCICOM discussed and took note of the 8 principles. DIG has taken note of SCICOM s comments on the 8 principles and the DIG commentary and asks SCICOM to disregard the previous DIG commentary and let the 8 principles stand alone. A DIG subgroup will work intersessionally on the interpretation and implementation of the 8 principles within the ICES Data Policy. The next paragraph contains a first inventory of overlaps between the current ICES Data Policy and the 8 principles of data citation Incorporation of citation guidelines in ICES Data Policy The 8 principles should be added as aspirational guidelines to section 7 of the Data Policy. That
Advertisement
MostRelated
View more
We Need Your Support
Thank you for visiting our website and your interest in our free products and services. We are nonprofit website to share and download documents. To the running of this website, we need your help to support us.

Thanks to everyone for your continued support.

No, Thanks
SAVE OUR EARTH

We need your sign to support Project to invent "SMART AND CONTROLLABLE REFLECTIVE BALLOONS" to cover the Sun and Save Our Earth.

More details...

Sign Now!

We are very appreciated for your Prompt Action!

x