%0 Conference Paper
%A Penke, Carolin
%T An Introduction to Large Language Models
%M FZJ-2024-06880
%D 2024
%X Large Language Models (LLMs) have revolutionized the field of artificial intelligence, enabling advanced text generation and understanding. This talk provides a concise overview of LLMs, focusing on their development, architecture, and implementation. We explain key concepts, and give details on the backbone of modern LLMs: the transformer architecture and its innovative attention mechanism. To be able to train these models on supercomputers, advanced parallelization techniques are needed. Recent advancements and promising trends are identified. Through the lens of the OpenGPT-X project, this presentation will highlight the collaborative efforts in developing multilingual, open-source LLMs.
%B Women in Data Science Conference Chemnitz
%C 6 Jun 2024 - 7 Jun 2024, Chemnitz (Germany)
Y2 6 Jun 2024 - 7 Jun 2024
M2 Chemnitz, Germany
%F PUB:(DE-HGF)6
%9 Conference Presentation
%U https://juser.fz-juelich.de/record/1034059