Technology Strategy Board ; Royal Institute of Technology ; BULL SAS ; German Research Centre for Artificial Intelligence ; SCIENCE AND TECHNOLOGY FACILITIES COUNCIL ; SEAGATE SYSTEMS UK LIMITED ; Atomic Energy and Alternative Energies Commission ; Allinea Software (United Kingdom) ; Diamond Light Source ; ARM LIMITED ; United Kingdom Space Agency ; Forschungszentrum Jülich
Grant period
2015-09-01 - 2018-08-31
Funding body
European Union
Call number
H2020-FETHPC-2014
Grant number
671500
Identifier
G:(EU-Grant)671500
Note: Worldwide data volumes are exploding and islands of storage remote from compute will not scale. We will demonstrate the first instance of intelligent data storage, uniting data processing and storage as two sides of the same rich computational model. This will enable sophisticated, intention-aware data processing to be integrated within a storage systems infrastructure, combined with the potential for Exabyte scale deployment in future generations of extreme scale HPC systems.
Enabling only the salient data to flow in and out of compute nodes, from a sea of devices spanning next generation solid state to low performance disc we enable a vision of a new model of highly efficient and effective HPC and Big Data demonstrated through the SAGE project.
Objectives
- Provide a next-generation multi-tiered object-based data storage system (hardware and enabling software) supporting future-generation multi-tier persistent storage media supporting integral computational capability, within a hierarchy.
- Significantly improve overall scientific output through advancements in systemic data access performance and drastically reduced data movements.
- Provides a roadmap of technologies supporting data access for both Exascale/Exabyte and High Performance Data Analytics.
- Provide programming models, access methods and support tools validating their usability, including ‘Big-Data’ access and analysis methods
- Co-Designing and validating on a smaller representative system with earth sciences, meteorology, clean energy, and physics communities
- Projecting suitability for extreme scaling through simulation based on evaluation results.
Call Alignment: We address storage data access with optimised systems for converged Big Data and HPC use, in a co-design process with scientific partners and applications from many domains. System effectiveness and power efficiency are dramatically improved through minimized data transfer, with extreme scaling and resilience.