In this article, Mouadh Yagoubi (IRT SystemX) and Marc Schoenauer (Inria) focus on the challenges associated with the implementation of AI-enhanced physical simulators, and we will discuss the issues related to their validation for an industrial deployment.