Contribution to a conference proceedings/Contribution to a book

FZJ-2013-00527

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png File Transfer in UNICORE: State of the Art

Schuller, B. (Corresponding author)FZJ* ; Rambadt, M.FZJ* ; Hagemeier, B.FZJ*

2012
Forschungszentrum Jülich GmbH Zentralbibliothek, Verlag Jülich
ISBN: 978-3-89336-829-7

Abstract: The UNICORE middleware is increasingly used for data-intensive applications where large data volumes need to be transferred reliably at adequate data rates. This paper presents the state of the art in UNICORE with respect to file transfer, and takes an in-depth look at the existing functionalities, the performance (transfer rates, reliability) and last-not-least the current limitations of the existing interfaces and available implementations. The recently introduced UFTP file transfer has been deployed and thoroughly tested in realistic environments. Here, we look at the performance of UFTP in two settings: a test installation within the PRACE infrastructure, and a 100GBit/s testbed operated by the TU Dresden and TU Freiberg. The latter study shows the potential of UFTP in a network of the highest performance. Furthermore, we present work that has been done to integrate the widely used GridFTP transfer into UNICORE, motivated by interoperability requirements in the U.S. XSEDE infrastructure as well as other European software such as dCache. Finally, we review the reliability aspects of the UNICORE server-to-server file transfer and present some possible improvements.

---

Contributing Institute(s):

1. Jülich Supercomputing Center (JSC)

Research Program(s):

1. 412 - Grid Technologies and Infrastructures (POF2-412) (POF2-412)

Appears in the scientific report 2012

---