TY  - JOUR
AU  - Teixeira Parente, Mario
AU  - Schneidewind, Astrid
AU  - Brandl, Georg
AU  - Franz, Christian
AU  - Noack, Marcus
AU  - Boehm, Martin
AU  - Ganeva, Marina
TI  - Benchmarking Autonomous Scattering Experiments Illustrated on TAS
JO  - Frontiers in Materials
VL  - 8
SN  - 2296-8016
PB  - Frontiers Media
M1  - FZJ-2022-01283
SP  - 772014
PY  - 2022
AB  - With the advancement of artificial intelligence and machine learning methods, autonomous approaches are recognized to have great potential for performing more efficient scattering experiments. In our view, it is crucial for such approaches to provide thorough evidence about respective performance improvements in order to increase acceptance within a scientific community. Therefore, we propose a benchmarking procedure designed as a cost-benefit analysis that is applicable to any scattering method sequentially collecting data during an experiment. For a given approach, the performance assessment is based on how much benefit, given a certain cost budget, it is able to acquire in predefined test cases. Different approaches thus get a chance for comparison and can make their advantages explicit and visible. Key components of the procedure, i.e., cost measures, benefit measures, and test cases, are made precise for the setting of three-axes spectrometry (TAS) as an illustration. Finally, we discuss neglected aspects and possible extensions for the TAS setting and comment on the procedure’s applicability to other scattering methods. A Python implementation of the procedure to simplify its utilization by interested researchers from the field is also provided.
LB  - PUB:(DE-HGF)16
UR  - <Go to ISI:>//WOS:000760612600001
DO  - DOI:10.3389/fmats.2021.772014
UR  - https://juser.fz-juelich.de/record/906184
ER  -