Journal Article FZJ-2025-02083

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Injection optimization at particle accelerators via reinforcement learning: From simulation to real-world application

 ;  ;  ;

2025
American Physical Society College Park, MD

Physical review accelerators and beams 28(3), 034601 () [10.1103/PhysRevAccelBeams.28.034601]

This record in other databases:  

Please use a persistent id in citations: doi:  doi:

Abstract: Optimizing the injection process in particle accelerators is crucial for enhancing beam quality and operational efficiency. This paper presents a framework for utilizing reinforcement learning (RL) to optimize the injection process at accelerator facilities. By framing the optimization challenge as an RL problem, we developed an agent capable of dynamically aligning the beam’s transverse space with desired targets. Our methodology leverages the soft actor-critic algorithm, enhanced with domain randomization and dense neural networks, to train the agent in simulated environments with varying dynamics promoting it to learn a generalized robust policy. The agent was evaluated in live runs at the cooler synchrotron COSY and it has successfully optimized the beam cross section reaching human operator level but in notably less time. An empirical study further validated the importance of each architecture component in achieving a robust and generalized optimization strategy. The results demonstrate the potential of RL in automating and improving optimization tasks at particle acceleration facilities.

Classification:

Contributing Institute(s):
  1. Experimentelle Hadrondynamik (IKP-2)
Research Program(s):
  1. 612 - Cosmic Matter in the Laboratory (POF4-612) (POF4-612)

Appears in the scientific report 2025
Database coverage:
Creative Commons Attribution CC BY 4.0 ; DOAJ ; OpenAccess ; Clarivate Analytics Master Journal List ; Current Contents - Physical, Chemical and Earth Sciences ; DOAJ Seal ; Essential Science Indicators ; IF < 5 ; JCR ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Institute Collections > IKP > IKP-2
Workflow collections > Public records
Publications database
Open Access

 Record created 2025-03-25, last modified 2025-04-14


OpenAccess:
Download fulltext PDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)