000141704 001__ 141704
000141704 005__ 20250317091728.0
000141704 020__ $$a978-1-4503-2130-3
000141704 0247_ $$2doi$$a10.1145/2464996.2465020
000141704 0247_ $$2altmetric$$aaltmetric:21822711
000141704 037__ $$aFZJ-2014-00071
000141704 041__ $$aeng
000141704 1001_ $$0P:(DE-Juel1)132108$$aFrings, Wolfgang$$b0$$eCorresponding author$$ufzj
000141704 1112_ $$athe 27th international ACM conference$$cEugene$$d2013-06-10 - 2013-06-14$$wOregon
000141704 245__ $$aMassively parallel loading
000141704 260__ $$aNew York, NY$$bACM Press New York, New York, USA$$c2013
000141704 29510 $$aProceedings of the 27th international ACM conference on International conference on supercomputing - ICS '13
000141704 300__ $$a389-398
000141704 3367_ $$0PUB:(DE-HGF)8$$2PUB:(DE-HGF)$$aContribution to a conference proceedings$$bcontrib$$mcontrib$$s1389192531_18637
000141704 3367_ $$0PUB:(DE-HGF)7$$2PUB:(DE-HGF)$$aContribution to a book$$mcontb
000141704 3367_ $$033$$2EndNote$$aConference Paper
000141704 3367_ $$2ORCID$$aCONFERENCE_PAPER
000141704 3367_ $$2DataCite$$aOutput Types/Conference Paper
000141704 3367_ $$2DRIVER$$aconferenceObject
000141704 3367_ $$2BibTeX$$aINPROCEEDINGS
000141704 520__ $$aDynamic linking has many advantages for managing large code bases, but dynamically linked applications have not typically scaled well on high performance computing systems. Splitting a monolithic executable into many dynamic shared object (DSO) files decreases compile time for large codes, reduces runtime memory requirements by allowing modules to be loaded and unloaded as needed, and allows common DSOs to be shared among many executables. However, launching an executable that depends on many DSOs causes a flood of file system operations at program start-up, when each process in the parallel application loads its dependencies. At large scales, this operation has an effect similar to a site-wide denial-of-service attack, as even large parallel file systems struggle to service so many simultaneous requests. In this paper, we present SPINDLE, a novel approach to parallel loading that coordinates simultaneous file system operations with a scalable network of cache server processes. Our approach is transparent to user applications. We extend the GNU loader, which is used in Linux as well as proprietary operating systems, to limit the number of simultaneous file system operations, quickly loading DSOs without thrashing the file system. Our experiments show that our prototype implementation has a low overhead and increases the scalability of Pynamic, a benchmark that stresses the dynamic loader, by a factor of 20.
000141704 536__ $$0G:(DE-HGF)POF2-41G21$$a41G - Supercomputer Facility (POF2-41G21)$$cPOF2-41G21$$fPOF II$$x0
000141704 536__ $$0G:(DE-Juel-1)ATMLAO$$aATMLAO - ATML Application Optimization and User Service Tools (ATMLAO)$$cATMLAO$$x1
000141704 588__ $$aDataset connected to CrossRef Conference
000141704 7001_ $$0P:(DE-HGF)0$$aAhn, Dong H.$$b1
000141704 7001_ $$0P:(DE-HGF)0$$aLeGendre, Matthew$$b2
000141704 7001_ $$0P:(DE-HGF)0$$aGamblin, Todd$$b3
000141704 7001_ $$0P:(DE-HGF)0$$ade Supinski, Bronis R.$$b4
000141704 7001_ $$0P:(DE-Juel1)132299$$aWolf, Felix$$b5$$ufzj
000141704 773__ $$a10.1145/2464996.2465020
000141704 909CO $$ooai:juser.fz-juelich.de:141704$$pVDB
000141704 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132108$$aForschungszentrum Jülich GmbH$$b0$$kFZJ
000141704 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)132299$$aForschungszentrum Jülich GmbH$$b5$$kFZJ
000141704 9132_ $$0G:(DE-HGF)POF3-513$$1G:(DE-HGF)POF3-510$$2G:(DE-HGF)POF3-500$$aDE-HGF$$bKey Technologies$$lSupercomputing & Big Data $$vSupercomputer Facility$$x0
000141704 9131_ $$0G:(DE-HGF)POF2-41G21$$1G:(DE-HGF)POF2-410$$2G:(DE-HGF)POF2-400$$3G:(DE-HGF)POF2$$4G:(DE-HGF)POF$$aDE-HGF$$bSchlüsseltechnologien$$lSupercomputing$$vSupercomputer Facility$$x0
000141704 9141_ $$y2013
000141704 920__ $$lyes
000141704 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0
000141704 980__ $$acontrib
000141704 980__ $$aVDB
000141704 980__ $$aUNRESTRICTED
000141704 980__ $$acontb
000141704 980__ $$aI:(DE-Juel1)JSC-20090406