Preprint

FZJ-2026-01648

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Risks of AI-driven product development and strategies for their mitigation

Göpfert, J. (Corresponding author)FZJ*RWTH* ; Weinand, J. M.FZJ* ; Kuckertz, P.FZJ* ; Pflugradt, N.FZJ* ; Linßen, J.FZJ*

2025
arXiv

This record in other databases:  

Please use a persistent id in citations: doi:10.48550/ARXIV.2506.00047

Abstract: Humanity is progressing towards automated product development, a trend that promises faster creation of better products and thus the acceleration of technological progress. However, increasing reliance on non-human agents for this process introduces many risks. This perspective aims to initiate a discussion on these risks and appropriate mitigation strategies. To this end, we outline a set of principles for safer AI-driven product development which emphasize human oversight, accountability, and explainable design, among others. The risk assessment covers both technical risks which affect product quality and safety, and sociotechnical risks which affect society. While AI-driven product development is still in its early stages, this discussion will help balance its opportunities and risks without delaying essential progress in understanding, norm-setting, and regulation.

Keyword(s): Computers and Society (cs.CY) ; Artificial Intelligence (cs.AI) ; Computational Engineering, Finance, and Science (cs.CE) ; FOS: Computer and information sciences

---

Contributing Institute(s):

1. Jülicher Systemanalyse (ICE-2)

Research Program(s):

1. 1111 - Effective System Transformation Pathways (POF4-111) (POF4-111)
2. 1112 - Societally Feasible Transformation Pathways (POF4-111) (POF4-111)

---