EarthServer - Agile Analytics on Big Data Cubes

Publication date: 
01 October, 2015
Wagemann, J
Siemen, S.
Medium / Event: 
ECMWF Website article

 The Horizon 2020 funded EarthServer project aims to establish scalable web-based analysis and processing services for multi-dimensional geo-referenced Earth Science data. Big Earth Science data often need extensive processing in order to retrieve meaningful and communicable information for users and decision-makers. The challenge is to extract the right information from petabytes (PB) of raw data. Ideally, data processing and analysis should be performed on server-side and only kilobytes of refined information are downloaded.

By exploring rasdaman, an intelligent Array Database Technology, in combination with standard data access protocols defined by the Open Geospatial Consortium (OGC), EarthServer explores the possibilities and challenges of providing access to data sizes beyond one petabyte of 3-D and 4-D Earth Science datacubes. In the course of EarthServer, large data centres, such as ECMWF, PML, MEEO/ESA, NCI and Jacobs University, aim at setting up web-based services related to water, air, climate and planetary science data.