Gast ::
| Hauptseite > Publikationsdatenbank > Enabling Scalable Data Processing and Management through Standards-based Job Execution and the Global Federated File System > print |
| Hauptseite > Publikationsdatenbank > Enabling Scalable Data Processing and Management through Standards-based Job Execution and the Global Federated File System > print |
| 001 | 817851 | ||
| 005 | 20210129224034.0 | ||
| 024 | 7 | _ | |a 10.12694/scpe.v17i2.1160 |2 doi |
| 024 | 7 | _ | |a 2128/12206 |2 Handle |
| 024 | 7 | _ | |a WOS:000377906100006 |2 WOS |
| 037 | _ | _ | |a FZJ-2016-04468 |
| 041 | _ | _ | |a English |
| 082 | _ | _ | |a 004 |
| 100 | 1 | _ | |a Memon, Mohammad Shahbaz |0 P:(DE-Juel1)132190 |b 0 |e Corresponding author |u fzj |
| 245 | _ | _ | |a Enabling Scalable Data Processing and Management through Standards-based Job Execution and the Global Federated File System |
| 260 | _ | _ | |c 2016 |
| 336 | 7 | _ | |a article |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
| 336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1472031839_26302 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
| 336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
| 520 | _ | _ | |a Emerging challenges for scientific communities are to efficiently process big data obtained by experimentation and computational simulations. Supercomputing architectures are available to support scalable and high performant processing environment, but many of the existing algorithm implementations are still unable to cope with its architectural complexity. One approach is to have innovative technologies that effectively use these resources and also deal with geographically dispersed large datasets. Those technologies should be accessible in a way that data scientists who are running data intensive computations do not have to deal with technical intricacies of the underling execution system. Our work primarily focuses on providing data scientists with transparent access to these resources in order to easily analyze data. Impact of our work is given by describing how we enabled access to multiple high performance computing resources through an open standards-based middleware that takes advantage of a unified data management provided by the the Global Federated File System. Our architectural design and its associated implementation is validated by a usecase that requires massivley parallel DBSCAN outlier detection on a 3D point clouds dataset. |
| 536 | _ | _ | |a 512 - Data-Intensive Science and Federated Computing (POF3-512) |0 G:(DE-HGF)POF3-512 |c POF3-512 |f POF III |x 0 |
| 588 | _ | _ | |a Dataset connected to CrossRef |
| 700 | 1 | _ | |a Riedel, Morris |0 P:(DE-Juel1)132239 |b 1 |e Corresponding author |u fzj |
| 700 | 1 | _ | |a Memon, Ahmed |0 P:(DE-Juel1)132191 |b 2 |u fzj |
| 700 | 1 | _ | |a Koeritz, Chris |0 P:(DE-HGF)0 |b 3 |
| 700 | 1 | _ | |a Grimshaw, Andrew |0 P:(DE-HGF)0 |b 4 |
| 700 | 1 | _ | |a Neukirchen, Helmut |0 P:(DE-Juel1)169980 |b 5 |u fzj |
| 773 | _ | _ | |a 10.12694/scpe.v17i2.1160 |g Vol. 17, no. 2, p. 115-128 |0 PERI:(DE-600)2240223-8 |n 2 |p 115-128 |t Scalable computing |v 17 |y 2016 |x 1895-1767 |
| 856 | 4 | _ | |y OpenAccess |u https://juser.fz-juelich.de/record/817851/files/1160-1099-1-PB.pdf |
| 856 | 4 | _ | |y OpenAccess |x icon |u https://juser.fz-juelich.de/record/817851/files/1160-1099-1-PB.gif?subformat=icon |
| 856 | 4 | _ | |y OpenAccess |x icon-1440 |u https://juser.fz-juelich.de/record/817851/files/1160-1099-1-PB.jpg?subformat=icon-1440 |
| 856 | 4 | _ | |y OpenAccess |x icon-180 |u https://juser.fz-juelich.de/record/817851/files/1160-1099-1-PB.jpg?subformat=icon-180 |
| 856 | 4 | _ | |y OpenAccess |x icon-640 |u https://juser.fz-juelich.de/record/817851/files/1160-1099-1-PB.jpg?subformat=icon-640 |
| 856 | 4 | _ | |y OpenAccess |x pdfa |u https://juser.fz-juelich.de/record/817851/files/1160-1099-1-PB.pdf?subformat=pdfa |
| 909 | C | O | |o oai:juser.fz-juelich.de:817851 |p openaire |p open_access |p driver |p VDB |p dnbdelivery |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)132190 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 1 |6 P:(DE-Juel1)132239 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)132191 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 5 |6 P:(DE-Juel1)169980 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |1 G:(DE-HGF)POF3-510 |0 G:(DE-HGF)POF3-512 |2 G:(DE-HGF)POF3-500 |v Data-Intensive Science and Federated Computing |x 0 |4 G:(DE-HGF)POF |3 G:(DE-HGF)POF3 |l Supercomputing & Big Data |
| 914 | 1 | _ | |y 2016 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0112 |2 StatID |b Emerging Sources Citation Index |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Thomson Reuters Master Journal List |
| 920 | _ | _ | |l yes |
| 920 | 1 | _ | |0 I:(DE-Juel1)JSC-20090406 |k JSC |l Jülich Supercomputing Center |x 0 |
| 980 | _ | _ | |a journal |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a UNRESTRICTED |
| 980 | _ | _ | |a I:(DE-Juel1)JSC-20090406 |
| 980 | 1 | _ | |a FullTexts |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|