000894131 001__ 894131 000894131 005__ 20210722135252.0 000894131 0247_ $$2doi$$a10.5281/ZENODO.4543704 000894131 037__ $$aFZJ-2021-03058 000894131 041__ $$aEnglish 000894131 1001_ $$0P:(DE-Juel1)174151$$aClausenAlexander$$b0$$eCorresponding author 000894131 245__ $$aLiberTEM/LiberTEM: 0.6.0 000894131 260__ $$c2021 000894131 3367_ $$2DCMI$$aSoftware 000894131 3367_ $$0PUB:(DE-HGF)33$$2PUB:(DE-HGF)$$aSoftware$$bsware$$msware$$s1626950026_27496 000894131 3367_ $$2BibTeX$$aMISC 000894131 3367_ $$06$$2EndNote$$aComputer Program 000894131 3367_ $$2ORCID$$aOTHER 000894131 3367_ $$2DataCite$$aSoftware 000894131 520__ $$a<p><strong>Homepage: <a href='https://libertem.github.io/LiberTEM/'>https://libertem.github.io/LiberTEM/</a></strong><br> <strong>GitHub repository: <a href='https://github.com/LiberTEM/LiberTEM/'>https://github.com/LiberTEM/LiberTEM/</a></strong><br> <strong>PyPI: <a href='https://pypi.org/project/libertem/'>https://pypi.org/project/libertem/</a></strong></p> <p>LiberTEM is an open source platform for high-throughput distributed processing of large-scale binary data sets using a simplified <a href='https://en.wikipedia.org/wiki/MapReduce'>MapReduce programming model</a>. The current focus is <a href='https://en.wikipedia.org/wiki/Scanning_transmission_electron_microscopy#Universal_detectors_(4D_STEM)'>pixelated</a> scanning transmission electron microscopy (<a href='https://en.wikipedia.org/wiki/Scanning_transmission_electron_microscopy'>STEM</a>) and scanning electron beam diffraction data.</p> <p>It is <a href='https://libertem.github.io/LiberTEM/architecture.html'>designed for high throughput and scalability</a> on PCs, single server nodes, clusters and cloud services. On clusters it can use fast distributed local storage on high-performance SSDs. That way it achieves <a href='https://libertem.github.io/LiberTEM/performance.html'>very high aggregate IO performance</a> on a compact and cost-efficient system built from stock components. All CPU cores and CUDA devices in a system can be used in parallel.</p> <p>LiberTEM is supported on Linux, Mac OS X and Windows. Other platforms that allow installation of Python 3.6+ and the required packages will likely work as well. The GUI is running in a web browser.</p> <p><strong>Installation</strong></p> <p>The short version:</p> <pre>$ virtualenv -p python3 ~/libertem-venv/ $ source ~/libertem-venv/bin/activate (libertem) $ python -m pip install "libertem[torch]" # optional for GPU support (libertem) $ python -m pip install cupy </pre> <p>Please see <a href='https://libertem.github.io/LiberTEM/install.html'>our documentation</a> for details!</p> <p>Deployment as a single-node system for a local user is thoroughly tested and can be considered stable. Deployment on a cluster is experimental and still requires some additional work, see <a href='https://github.com/LiberTEM/LiberTEM/issues/105'>Issue #105</a>.</p> <p><strong>Applications</strong></p> <ul> <li>Virtual detectors (virtual bright field, virtual HAADF, center of mass , custom shapes via masks)</li> <li><a href='https://libertem.github.io/LiberTEM/app/amorphous.html'>Analysis of amorphous materials</a></li> <li><a href='https://libertem.github.io/LiberTEM-blobfinder/'>Strain mapping</a></li> <li><a href='https://libertem.github.io/LiberTEM/udf.html'>Custom analysis functions (user-defined functions)</a></li> <li><a href='https://libertem.github.io/LiberTEM/app/holography.html'>Off-axis electron holography reconstruction</a></li> </ul> <p>Please see <a href='https://libertem.github.io/LiberTEM/applications.html'>the applications section</a> of our documentation for details!</p> <p>The Python API and user-defined functions (UDFs) can be used for more complex operations with arbitrary masks and other features like data export. There are example Jupyter notebooks available in the <a href='https://github.com/LiberTEM/LiberTEM/tree/master/examples'>examples directory</a>. If you are having trouble running the examples, please let us know, either by filing an issue or by <a href='https://gitter.im/LiberTEM/Lobby'>joining our Gitter chat</a>.</p> <p>LiberTEM is suitable as a high-performance processing backend for other applications, including live data streams. <a href='https://gitter.im/LiberTEM/Lobby'>Contact us</a> if you are interested!</p> <p>LiberTEM is evolving rapidly and prioritizes features following user demand and contributions. In the future we'd like to implement live acquisition, and more analysis methods for all applications of pixelated STEM and other large-scale detector data. If you like to influence the direction this project is taking, or if you'd like to <a href='https://libertem.github.io/LiberTEM/contributing.html'>contribute</a>, please join our <a href='https://gitter.im/LiberTEM/Lobby'>gitter chat</a> and our <a href='https://groups.google.com/forum/#!forum/libertem'>general mailing list</a>.</p> <p><strong>File formats</strong></p> <p>LiberTEM currently opens most file formats used for pixelated STEM. See <a href='https://libertem.github.io/LiberTEM/formats.html'>our general information on loading data</a> and <a href='https://libertem.github.io/LiberTEM/reference/dataset.html#formats'>format-specific documentation</a> for more information!</p> <ul> <li>Raw binary files</li> <li>Thermo Fisher EMPAD detector files</li> <li><a href='http://quantumdetectors.com/wp-content/uploads/2017/01/1532-Merlin-for-EM-Technical-Datasheet-v2.pdf'>Quantum Detectors MIB format</a></li> <li>Nanomegas .blo block files</li> <li>Direct Electron DE5 files (HDF5-based) and Norpix SEQ files for <a href='http://www.directelectron.com/de-series/'>DE-Series</a> detectors</li> <li><a href='https://web.archive.org/web/20180809021832/http://www.gatan.com/products/tem-imaging-spectroscopy/k2-camera'>Gatan K2 IS</a> raw format</li> <li>Stacks of Gatan DM3 and DM4 files (via <a href='https://github.com/ercius/openNCEM'>openNCEM</a>)</li> <li>FRMS6 from PNDetector pnCCD cameras (currently alpha, gain correction still needs UI changes)</li> <li>FEI SER files (via <a href='https://github.com/ercius/openNCEM'>openNCEM</a>)</li> <li>MRC (via <a href='https://github.com/ercius/openNCEM'>openNCEM</a>)</li> <li>HDF5-based formats such as Hyperspy files, NeXus and EMD</li> <li>Please contact us if you are interested in support for an additional format!</li> </ul> <p><strong>License</strong></p> <p>LiberTEM is licensed under GPLv3. The I/O parts are also available under the MIT license, please see LICENSE files in the subdirectories for details.</p> 000894131 536__ $$0G:(DE-HGF)POF4-5351$$a5351 - Platform for Correlative, In Situ and Operando Characterization (POF4-535)$$cPOF4-535$$fPOF IV$$x0 000894131 536__ $$0G:(DE-HGF)ZT-I-0025$$aPtychography 4.0 - Proposal for a pilot project "Information & Data Science" (ZT-I-0025)$$cZT-I-0025$$x1 000894131 536__ $$0G:(EU-Grant)823717$$aESTEEM3 - Enabling Science and Technology through European Electron Microscopy (823717)$$c823717$$fH2020-INFRAIA-2018-1$$x2 000894131 536__ $$0G:(EU-Grant)856538$$a3D MAGiC - Three-dimensional magnetization textures: Discovery and control on the nanoscale (856538)$$c856538$$fERC-2019-SyG$$x3 000894131 536__ $$0G:(EU-Grant)686053$$aCritCat - Towards Replacement of Critical Catalyst Materials by Improved Nanoparticle Control and Rational Design (686053)$$c686053$$fH2020-NMP-2015-two-stage$$x4 000894131 536__ $$0G:(EU-Grant)780487$$aVIDEO - Versatile and Innovative Detector for Electron Optics (780487)$$c780487$$fERC-2017-PoC$$x5 000894131 588__ $$aDataset connected to DataCite 000894131 650_7 $$2Other$$aSTEM 000894131 650_7 $$2Other$$aTEM 000894131 650_7 $$2Other$$apixelated STEM 000894131 650_7 $$2Other$$a4D STEM 000894131 650_7 $$2Other$$ahigh-throughput 000894131 650_7 $$2Other$$aelectron microscopy 000894131 7001_ $$0P:(DE-Juel1)171370$$aWeberDieter$$b1$$eCorresponding author 000894131 7001_ $$0P:(DE-Juel1)180323$$aRuzaevaKarina$$b2$$eCorresponding author 000894131 7001_ $$0P:(DE-Juel1)159136$$aMigunovVadim$$b3 000894131 7001_ $$00000-0002-2870-366X$$aBaburajanAnand$$b4 000894131 7001_ $$00000-0001-5045-5650$$aBahuleyanAbijith$$b5 000894131 7001_ $$0P:(DE-Juel1)157760$$aCaronJan$$b6 000894131 7001_ $$00000-0003-2079-5368$$aChandraRahul$$b7 000894131 7001_ $$0P:(DE-HGF)0$$aDeyShankhadeep$$b8 000894131 7001_ $$00000-0003-0224-3746$$aHalderSayandip$$b9 000894131 7001_ $$00000-0001-5934-7525$$a, KatzDaniel S.$$b10 000894131 7001_ $$00000-0003-1010-0366$$a, LevinBarnaby D. A.$$b11 000894131 7001_ $$00000-0001-7981-5293$$aNordMagnus$$b12 000894131 7001_ $$00000-0003-2348-8558$$aOphusColin$$b13 000894131 7001_ $$0P:(DE-HGF)0$$aPeterSimon$$b14 000894131 7001_ $$0P:(DE-HGF)0$$avanJay, Schyndel$$b15 000894131 7001_ $$0P:(DE-HGF)0$$aShinJaeweon$$b16 000894131 7001_ $$0P:(DE-HGF)0$$aSunkuSai$$b17 000894131 7001_ $$0P:(DE-Juel1)165314$$aMüller-CasparyKnut$$b18 000894131 7001_ $$0P:(DE-Juel1)144121$$a, Dunin-BorkowskiRafal E.$$b19 000894131 773__ $$a10.5281/ZENODO.4543704 000894131 909CO $$ooai:juser.fz-juelich.de:894131$$popenaire$$pVDB$$pec_fundedresources 000894131 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)174151$$aForschungszentrum Jülich$$b0$$kFZJ 000894131 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)171370$$aForschungszentrum Jülich$$b1$$kFZJ 000894131 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)180323$$aForschungszentrum Jülich$$b2$$kFZJ 000894131 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)165314$$aForschungszentrum Jülich$$b18$$kFZJ 000894131 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)144121$$aForschungszentrum Jülich$$b19$$kFZJ 000894131 9131_ $$0G:(DE-HGF)POF4-535$$1G:(DE-HGF)POF4-530$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5351$$aDE-HGF$$bKey Technologies$$lMaterials Systems Engineering$$vMaterials Information Discovery$$x0 000894131 9141_ $$y2021 000894131 9201_ $$0I:(DE-Juel1)ER-C-1-20170209$$kER-C-1$$lPhysik Nanoskaliger Systeme$$x0 000894131 980__ $$asware 000894131 980__ $$aVDB 000894131 980__ $$aI:(DE-Juel1)ER-C-1-20170209 000894131 980__ $$aUNRESTRICTED