Conference Presentation (Other)

FZJ-2025-01611

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Helmholtz Blablador and the LLM models' ecosystem

Strube, A. (Corresponding author)FZJ*

2024

Abstract: Helmholtz Blablador is the LLM inference server from the Helmholtz Foundation. This talk explores Blablador's role in hosting open-source LLM models and models developed in-house at the Juelich Supercomputing Centre (JSC). This talk is about Blablador and the open source LLM models' ecosystem.In the ever-evolving world of machine learning, the Helmholtz Foundation's Blablador stands out as an open LLM inference server/service for the academic community. This talk discusses Blablador and its role in hosting both open-source LLM models, models developed by the academic community in general, and those developed in-house at the Juelich Supercomputing Centre (JSC).Blablador not only supports a wide range of models but also provides a robust platform for researchers and developers to experiment, collaborate, and innovate. As a result, Blablador has significantly contributed to the growth and advancement of the LLM models' ecosystem.This talk will look at the architecture and functionality of Blablador, its integration with the JSC, and its impact on the LLM models' ecosystem. We explore Blablador's role in fostering collaboration and innovation in the machine learning community.

---

Contributing Institute(s):

1. Jülich Supercomputing Center (JSC)

Research Program(s):

1. 5112 - Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups (POF4-511) (POF4-511)
2. Helmholtz AI Consultant Team FB Information (E54.303.11) (E54.303.11)

Appears in the scientific report 2024

---