Complete Agent-driven Model-based System Testing for Autonomous Systems
Open Access
- 21 October 2021
- journal article
- Published by Open Publishing Association in Electronic Proceedings in Theoretical Computer Science
- Vol. 348, 54-72
- https://doi.org/10.4204/eptcs.348.4
Abstract
In this position paper, a novel approach to testing complex autonomous transportation systems (ATS) in the automotive, avionic, and railway domains is described. It is intended to mitigate some of the most critical problems regarding verification and validation (V&V) effort for ATS. V&V is known to become infeasible for complex ATS, when using conventional methods only. The approach advocated here uses complete testing methods on the module level, because these establish formal proofs for the logical correctness of the software. Having established logical correctness, system-level tests are performed in simulated cloud environments and on the target system. To give evidence that 'sufficiently many' system tests have been performed with the target system, a formally justified coverage criterion is introduced. To optimise the execution of very large system test suites, we advocate an online testing approach where multiple tests are executed in parallel, and test steps are identified on-the-fly. The coordination and optimisation of these executions is achieved by an agent-based approach. Each aspect of the testing approach advocated here is shown to either be consistent with existing standards for development and V&V of safety-critical transportation systems, or it is justified why it should become acceptable in future revisions of the applicable standards.Keywords
This publication has 22 references indexed in Scilit:
- Experimental evaluation of a novel equivalence class partition testing strategySoftware and Systems Modeling, 2017
- Complete model-based equivalence class testing for nondeterministic systemsFormal Aspects of Computing, 2017
- A Novel Approach to HW/SW Integration Testing of Route-Based Interlocking System ControllersPublished by Springer Science and Business Media LLC ,2016
- Checking Experiments for Symbolic Input/Output Finite State MachinesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- A More Precise Implementation Relation for Distributed TestingThe Computer Journal, 2015
- Complete model-based equivalence class testingInternational Journal on Software Tools for Technology Transfer, 2014
- The worst-case execution-time problem—overview of methods and survey of toolsACM Transactions on Embedded Computing Systems, 2008
- An Improved Conformance Testing MethodLecture Notes in Computer Science, 2005
- Online Testing of Real-time Systems Using UppaalLecture Notes in Computer Science, 2005
- Test automation for safety-critical systems: Industrial application and future developmentsLecture Notes in Computer Science, 1996