OpenGPT-X

Aufbau eines Gaia-X Knotens für große KI-Sprachmodelle und innovative Sprachapplikations-Services; Teilvorhaben: Optimierung und Skalierung auf großen HPC-Systemen

CoordinatorHerten, Andreas
Grant period2022-01-01 - 2024-12-31
Funding bodyBundesnetzagentur
IdentifierG:(DE-Juel-1)68GX21007F

 

Recent Publications

All known publications ...
Download: BibTeX | EndNote XML,  Text | RIS | 

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Conference Presentation (Invited)
Efficient Computation of Low-Rank Representations to Reduce Memory Requirements in LLM Training
LoRAINNe’24: workshop on LOw-Rank Approximations and their Interactions with Neural NEtworks, LoRAINNe’24, NancyNancy, France, 26 Nov 2024 - 27 Nov 20242024-11-262024-11-27 [10.34734/FZJ-2024-06889] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Conference Presentation (Other)
Mathematical Techniques to Reduce Memory Requirements in Deep Learning
OpenGPT-X Forum 2024, BerlinBerlin, Germany, 5 Nov 2024 - 5 Nov 20242024-11-052024-11-05 [10.34734/FZJ-2024-06888] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Talk (non-conference) (Invited)
Efficient Computation of Low-Rank Representations to Reduce Memory Requirements in Deep Learning
RWTH Aachen SFB 1481 Colloquium, AachenAachen, Germany, 11 Dec 2024 - 11 Dec 20242024-12-112024-12-11 [10.34734/FZJ-2024-06883] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Conference Presentation (Plenary/Keynote)
An Introduction to Large Language Models
Women in Data Science Conference Chemnitz, ChemnitzChemnitz, Germany, 6 Jun 2024 - 7 Jun 20242024-06-062024-06-07  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Contribution to a conference proceedings  ;  ;  ;
Performance and Power: Systematic Evaluation of AI Workloads on Accelerators with CARAML
Supercomputing Conference 2024, 2024 International Workshop on Performance, Portability, and Productivity in HPC, SC24, AtlantaAtlanta, USA, 17 Nov 2024 - 22 Nov 20242024-11-172024-11-22 Nan () [10.1109/SCW63240.2024.00158] OpenAccess  Download fulltext Files  Download fulltextFulltext BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Poster (Other)  ;  ;  ;
CARAML: Systematic Evaluation of AI Workloads on Accelerators
OpenGPT-X Forum, BerlinBerlin, Germany, 5 Nov 2024 - 5 Nov 20242024-11-052024-11-05 [10.34734/FZJ-2024-06308] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Contribution to a conference proceedings  ;
OpenGPT-X: Novel Architecture Exploration
WHPC@SC23: 16th International Women in HPC Workshop, WHPC@SC23, Denver, ColoradoDenver, Colorado, USA, 12 Nov 2023 - 17 Nov 20232023-11-122023-11-17 2 pp. () [10.34734/FZJ-2023-05369] OpenAccess  Download fulltext Files  Download fulltextFulltext BibTeX | EndNote: XML, Text | RIS

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Conference Presentation (Invited)  ;
Novel Architecture Exploration - OpenGPT-X: Open Large Language Models
WHPC@SC23: 16th International Women in HPC Workshop, WHPC@SC23, Denver, ColoradoDenver, Colorado, USA, 12 Nov 2023 - 17 Nov 20232023-11-122023-11-17 [10.34734/FZJ-2023-04874] OpenAccess  Download fulltext Files BibTeX | EndNote: XML, Text | RIS

All known publications ...
Download: BibTeX | EndNote XML,  Text | RIS | 


 Record created 2023-12-01, last modified 2023-12-01



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)