CMCC Data Delivery System: Overview, Recent Advances and Future Perspectives

CMCC Webinar
18 July 2023, 12.00 pm CEST
To join the webinar, register here

Speaker
Marco Mancini, CMCC –  ASC Division

Moderator
Monia Santini, CMCC – IAFES Division

Abstract
The CMCC Data Delivery System (DDS) has been operational since December 2020 for publishing and disseminating scientific dataset produced by CMCC Research Divisions. Since its first deployment, the system has evolved to ensure better robustness and performance. Current version relies on a cloud-native microservices-based architecture that has been deployed — using Kubernetes — to the production environment in March 2023. In this webinar, we will describe in detail the new DDS architecture and the different frameworks, tools, libraries and technologies that have been adopted for the DDS architectural components. The core of the DDS is geokube; it is a Python library we have been developing with the aim to improve the user experience (UX) as well as for the analysis and visualisation of climate and earth science data. It provides high-level abstractions in terms of both Data Model (inspired by Climate Forecast and Unidata Common Data Models) and Application Programming Interface (inspired by xarray package).
Key features of geokube are the capabilities to (i) perform georeferenced axis-based indexing on data structures and specialised geospatial operations according to different types of geo-scientific datasets, like structured grids, observations, profiles etc., (ii) perform operations on the variables that are either instantaneous or defined over intervals, (iii) convert to/from xarray data structures and to read/write CF-compliant NetCDF datasets.
Furthermore, we will showcase how the DDS has been used for publishing scientific datasets, how to build downstream applications and services and how it has been integrated in different projects and initiatives. We conclude the webinar with a preview of some of the features that are in development and future perspectives on the DDS.


WATCH THE VIDEO


HOW TO PARTICIPATE
18 July 2023, 12.00 pm CEST
To join the webinar, register here


ORGANIZED BY:
CMCC



Start typing and press Enter to search

Shopping Cart