Home > Publications database > Integration of Parallel I/O Library and Flash Native Accelerators: An Evaluation of SIONlib with IME > print |
001 | 892137 | ||
005 | 20250804115154.0 | ||
024 | 7 | _ | |a 10.1145/3439839.3458736 |2 doi |
024 | 7 | _ | |a 2128/27712 |2 Handle |
024 | 7 | _ | |a WOS:001481625100005 |2 WOS |
037 | _ | _ | |a FZJ-2021-01972 |
041 | _ | _ | |a English |
100 | 1 | _ | |a Chasapis, Konstantinos |0 P:(DE-HGF)0 |b 0 |e Corresponding author |
111 | 2 | _ | |a EuroSys '21: Sixteenth European Conference on Computer Systems |c Online Event |d 2021-04-26 - 2021-04-28 |w UK |
245 | _ | _ | |a Integration of Parallel I/O Library and Flash Native Accelerators: An Evaluation of SIONlib with IME |
260 | _ | _ | |c 2021 |b ACM New York, NY, USA |
295 | 1 | 0 | |a Proceedings of the Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems |
300 | _ | _ | |a 8 |
336 | 7 | _ | |a CONFERENCE_PAPER |2 ORCID |
336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
336 | 7 | _ | |a conferenceObject |2 DRIVER |
336 | 7 | _ | |a Output Types/Conference Paper |2 DataCite |
336 | 7 | _ | |a Contribution to a conference proceedings |b contrib |m contrib |0 PUB:(DE-HGF)8 |s 1641839782_26014 |2 PUB:(DE-HGF) |
336 | 7 | _ | |a Contribution to a book |0 PUB:(DE-HGF)7 |2 PUB:(DE-HGF) |m contb |
490 | 0 | _ | |a CHEOPS '21 |
520 | _ | _ | |a As illustrated by the IO500 ranking performance and scalability of storage systems have improved dramatically in the recent years. Most of these progresses are due to novel hardware and architectures. The resulting solutions tend to be more complex and harder to manage from an end-user perspective. This work proposes to address simultaneously the user experience and the performance issue. The solution is based on DDN's Infinite Memory Engine (IME), an all Flash distributed cache that sits between the compute nodes and the parallel file system. IME delivers extreme performance for bulk data and complex I/O patterns but does not accelerate metadata traffic. To shield the end-user from the additional complexity of dealing with an extra storage-tier, IME accesses are embedded within SIONlib. SIONlib is a parallel I/O library, which has the ability to provide a task local like access scheme for a single file in the underlying file system that allows to reduce the number of metadata operations. This combined construction with IME and SIONlib allows end-users to obtain the Flash level of performance transparently for their applications and also to receive a performance boost on metadata operations. In respect of traditional file systems, according to the partest benchmark suite, the solution improves performance over 1.8 times on a single node and up to 4 times for multiple nodes. Moreover, experimenting with SIONlib parameters we observe that the resulting performances are more robust towards different data layout patterns and transfer sizes than with traditional file systems. |
536 | _ | _ | |a 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) |0 G:(DE-HGF)POF4-5112 |c POF4-511 |f POF IV |x 0 |
536 | _ | _ | |a EoCoE-II - Energy Oriented Center of Excellence : toward exascale for energy (824158) |0 G:(EU-Grant)824158 |c 824158 |f H2020-INFRAEDI-2018-1 |x 1 |
588 | _ | _ | |a Dataset connected to CrossRef Conference |
700 | 1 | _ | |a Acquaviva, Jean-Thomas |0 P:(DE-HGF)0 |b 1 |
700 | 1 | _ | |a Lührs, Sebastian |0 P:(DE-Juel1)7757 |b 2 |u fzj |
773 | _ | _ | |a 10.1145/3439839.3458736 |p 6 |
856 | 4 | _ | |u https://juser.fz-juelich.de/record/892137/files/CHEOPS___IME___SIONlib-ACM_format.pdf |y OpenAccess |
856 | 4 | _ | |u https://juser.fz-juelich.de/record/892137/files/CHEOPS___IME___SIONlib_ACM_reference_only.pdf |y OpenAccess |
909 | C | O | |o oai:juser.fz-juelich.de:892137 |p openaire |p open_access |p driver |p VDB |p ec_fundedresources |p dnbdelivery |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)7757 |
913 | 1 | _ | |a DE-HGF |b Key Technologies |l Engineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action |1 G:(DE-HGF)POF4-510 |0 G:(DE-HGF)POF4-511 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Enabling Computational- & Data-Intensive Science and Engineering |9 G:(DE-HGF)POF4-5112 |x 0 |
913 | 0 | _ | |a DE-HGF |b Key Technologies |l Supercomputing & Big Data |1 G:(DE-HGF)POF3-510 |0 G:(DE-HGF)POF3-511 |3 G:(DE-HGF)POF3 |2 G:(DE-HGF)POF3-500 |4 G:(DE-HGF)POF |v Computational Science and Mathematical Methods |x 0 |
914 | 1 | _ | |y 2021 |
915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
920 | _ | _ | |l yes |
920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
980 | _ | _ | |a contrib |
980 | _ | _ | |a VDB |
980 | _ | _ | |a contb |
980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
980 | _ | _ | |a UNRESTRICTED |
980 | 1 | _ | |a FullTexts |
Library | Collection | CLSMajor | CLSMinor | Language | Author |
---|