Arnaud Gotlieb (Chief research scientist at Simula Research Laboratory – Norway) ran a Seminar@SystemX online, on the following topic: “AI-based Testing of Autonomous Software Systems“, on October 27, 2021, from 2pm to 3:30 pm.


Software testing involves many distinct tasks such test case selection/generation, test suite reduction and prioritization, test execution scheduling, test results assessment, etc. Optimizing these tasks is crucial in order not only to reduce the overall costs of software validation which amounts for more than half of the development costs of software systems, but also to increase the level of confidence we aim to reach in the development of safety-critical systems. In this talk, I will review some of our contributions in the area of testing industrial robots with constraint programming and machine learning techniques. These contributions have been successfully deployed in industrial pilot experiments and allow us to draw some perspectives on the testing of autonomous software systems.


Arnaud Gotlieb is chief research scientist at Simula Research Laboratory in Norway, where he leads a department dedicated to the validation of autonomous systems. He completed his PhD on automatic test data generation using constraint logic programming in 2000 at the University of Nice-Sophia Antipolis and got habilitated (HDR) in Dec. 2011 from University of Rennes, France. Dr. Gotlieb has co-authored more than 120 publications in Artificial Intelligence and Software Engineering and developed several tools for testing safety-critical systems. He was the scientific coordinator of the French ANR-CAVERN project (2008-2011) for Inria, dedicated to the verification of software systems with abstraction-based methods and he led the research-based innovation centre Certus dedicated to software validation and verification (2011-2019) at Simula. He was awarded with the prestigious RCN FRINATEK grant for the T-LARGO project on testing learning robots (2018-2022). He leads the industrial pilots experiments of the H2020 AI4EU Project (2019-2021), dedicated to the creation of the European AI-on-demand platform. Dr. Gotlieb has served in many PCs including IJCAI, AAAI, CP, ICSE-SEIP, ICST, ISSRE, co-chaired the scientific program of SEIP track of ICSE 2014, the “Testing and Verification” track of CP from 2016 to 2019. He co-chaired the first IEEE Artificial Intelligence Testing Conference in 2019 and he is an associate editor of the Wiley Software Testing, Verification and Reliability journal. In 2021, he has co-created RESIST, the first Inria-Simula associate team dedicated the development of resilient software-systems.