001038640 001__ 1038640 001038640 005__ 20250203215421.0 001038640 037__ $$aFZJ-2025-01611 001038640 041__ $$aEnglish 001038640 1001_ $$0P:(DE-Juel1)140202$$aStrube, Alexandre$$b0$$eCorresponding author 001038640 1112_ $$aEuroSciPy 2024$$cSzczecin$$d2025-04-26 - 2025-04-30$$gEuroSciPy$$wPoland 001038640 245__ $$aHelmholtz Blablador and the LLM models' ecosystem 001038640 260__ $$c2024 001038640 3367_ $$033$$2EndNote$$aConference Paper 001038640 3367_ $$2DataCite$$aOther 001038640 3367_ $$2BibTeX$$aINPROCEEDINGS 001038640 3367_ $$2DRIVER$$aconferenceObject 001038640 3367_ $$2ORCID$$aLECTURE_SPEECH 001038640 3367_ $$0PUB:(DE-HGF)6$$2PUB:(DE-HGF)$$aConference Presentation$$bconf$$mconf$$s1738562196_21855$$xOther 001038640 502__ $$cMaritime University of Szczecin 001038640 520__ $$aHelmholtz Blablador is the LLM inference server from the Helmholtz Foundation. This talk explores Blablador's role in hosting open-source LLM models and models developed in-house at the Juelich Supercomputing Centre (JSC). This talk is about Blablador and the open source LLM models' ecosystem.In the ever-evolving world of machine learning, the Helmholtz Foundation's Blablador stands out as an open LLM inference server/service for the academic community. This talk discusses Blablador and its role in hosting both open-source LLM models, models developed by the academic community in general, and those developed in-house at the Juelich Supercomputing Centre (JSC).Blablador not only supports a wide range of models but also provides a robust platform for researchers and developers to experiment, collaborate, and innovate. As a result, Blablador has significantly contributed to the growth and advancement of the LLM models' ecosystem.This talk will look at the architecture and functionality of Blablador, its integration with the JSC, and its impact on the LLM models' ecosystem. We explore Blablador's role in fostering collaboration and innovation in the machine learning community. 001038640 536__ $$0G:(DE-HGF)POF4-5112$$a5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511)$$cPOF4-511$$fPOF IV$$x0 001038640 536__ $$0G:(DE-Juel-1)E54.303.11$$aHelmholtz AI Consultant Team FB Information (E54.303.11)$$cE54.303.11$$x1 001038640 8564_ $$uhttps://strube1.pages.jsc.fz-juelich.de/2024-08-talk-euro-scipy/#/title-slide 001038640 909CO $$ooai:juser.fz-juelich.de:1038640$$pVDB 001038640 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)140202$$aForschungszentrum Jülich$$b0$$kFZJ 001038640 9131_ $$0G:(DE-HGF)POF4-511$$1G:(DE-HGF)POF4-510$$2G:(DE-HGF)POF4-500$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$9G:(DE-HGF)POF4-5112$$aDE-HGF$$bKey Technologies$$lEngineering Digital Futures – Supercomputing, Data Management and Information Security for Knowledge and Action$$vEnabling Computational- & Data-Intensive Science and Engineering$$x0 001038640 9141_ $$y2024 001038640 920__ $$lyes 001038640 9201_ $$0I:(DE-Juel1)JSC-20090406$$kJSC$$lJülich Supercomputing Center$$x0 001038640 980__ $$aconf 001038640 980__ $$aVDB 001038640 980__ $$aI:(DE-Juel1)JSC-20090406 001038640 980__ $$aUNRESTRICTED