000872890 001__ 872890
000872890 005__ 20230711161607.0
000872890 0247_ $$2Handle$$a2128/23940
000872890 037__ $$aFZJ-2020-00355
000872890 041__ $$aEnglish
000872890 1001_ $$0P:(DE-Juel1)144441$$aPleiter, Dirk$$b0$$eCorresponding author$$ufzj
000872890 1112_ $$aEuroHPC Summit Week 2019$$cPoznań$$d2019-05-13 - 2019-05-18$$wPoland
000872890 245__ $$aMaestro Project Introduction
000872890 260__ $$c2019
000872890 3367_ $$033$$2EndNote$$aConference Paper
000872890 3367_ $$2DataCite$$aOther
000872890 3367_ $$2BibTeX$$aINPROCEEDINGS
000872890 3367_ $$2DRIVER$$aconferenceObject
000872890 3367_ $$2ORCID$$aLECTURE_SPEECH
000872890 3367_ $$0PUB:(DE-HGF)6$$2PUB:(DE-HGF)$$aConference Presentation$$bconf$$mconf$$s1579530249_30828$$xInvited
000872890 520__ $$aIn this talk, we provide an introduction to the Maestro project.This project was started in September 2018 involving the following partners:Appentra, CEA, Cray, CSCS, ECMWF, Forschungszentrum Juelich, Seagate.The goal is to develop and demonstrate a new middleware that aims at addressingtwo key shortcomings observed for today's supercomputing solutions.First, available solutions typically lack data awareness as they are optimisedfor filling processing pipelines, not for managing data.Furthermore, available solutions lack memory awareness, i.e. available middlewaredo not have information about available memory (or storage) hardware and thusare not able to make data transport decisions.Maestro applies a co-design approach for designing a solution addressing these challenges.The co-design applications, in particular, include data-intensive applications likethe weather prediction workflow from ECMWF.In this case, simulations of the IFS model produce huge amounts of data that are consumedby other applications, which generate products for ECMWF's products member states and customers.This matches well Maestro's concept of providing a pool of data objects, wheredata producers give objects to the pool and data consumers take objects from the pool.Using suitable metadata, the Maestro middleware can manage storing and transport of data objectstaking the hardware architecture into account, on which the applications are being executed.We will conclude this talk with an outlook on the work of the Maestro project.
000872890 536__ $$0G:(DE-HGF)POF3-513$$a513 - Supercomputer Facility (POF3-513)$$cPOF3-513$$fPOF III$$x0
000872890 536__ $$0G:(EU-Grant)801101$$aMAESTRO - Middleware for memory and data-awareness in workflows (801101)$$c801101$$fH2020-FETHPC-2017$$x1
000872890 8564_ $$uhttps://juser.fz-juelich.de/record/872890/files/20190516-maestro.pdf$$yOpenAccess
000872890 8564_ $$uhttps://juser.fz-juelich.de/record/872890/files/20190516-maestro.pdf?subformat=pdfa$$xpdfa$$yOpenAccess
000872890 909CO $$ooai:juser.fz-juelich.de:872890$$pec_fundedresources$$pdriver$$pVDB$$popen_access$$popenaire
000872890 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)144441$$aForschungszentrum Jülich$$b0$$kFZJ
000872890 9131_ $$0G:(DE-HGF)POF3-513$$1G:(DE-HGF)POF3-510$$2G:(DE-HGF)POF3-500$$3G:(DE-HGF)POF3$$4G:(DE-HGF)POF$$aDE-HGF$$bKey Technologies$$lSupercomputing & Big Data$$vSupercomputer Facility$$x0
000872890 9141_ $$y2019
000872890 915__ $$0StatID:(DE-HGF)0510$$2StatID$$aOpenAccess
000872890 920__ $$lyes
000872890 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0
000872890 980__ $$aOPENSCIENCE
000872890 9801_ $$aFullTexts
000872890 980__ $$aconf
000872890 980__ $$aVDB
000872890 980__ $$aUNRESTRICTED
000872890 980__ $$aI:(DE-Juel1)JSC-20090406