TY - GEN
T1 - Testing Autonomous Cyber-Physical Systems with Koopman Surrogate Model Predictive Control
AU - Sheikhi, Sanaz
AU - Duggirala, Parasara Sridhar
AU - Bak, Stanley
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Cyber-physical systems (CPSs) are on the rise for safety-critical applications. While formal verification approaches may work on simple systems, these approaches need more scalability. When systems are sufficiently complex, testing is often the only practical way to gain confidence the system works as expected. How can we generate high-quality tests for CPS? This work proposes an approach to improve test case generation for CPSs. We achieve this by proposing a new model-based seed generation algorithm in the fuzz testing pipeline. We first use the Koopman operator technique to construct a predictor model to capture the effect of time-varying inputs on the CPS behavior. Then, we use the model in a Model Predictive Control (MPC) optimization loop, generating control inputs that drive the system through state space. We evaluate the strategy's effectiveness through extensive experiments on the well-known neural network air-To-Air collision avoidance benchmark, ACAS Xu. Evaluation results prove that the proposed Koopman MPC approach achieves better test coverage than other fuzz testing and falsification tools.
AB - Cyber-physical systems (CPSs) are on the rise for safety-critical applications. While formal verification approaches may work on simple systems, these approaches need more scalability. When systems are sufficiently complex, testing is often the only practical way to gain confidence the system works as expected. How can we generate high-quality tests for CPS? This work proposes an approach to improve test case generation for CPSs. We achieve this by proposing a new model-based seed generation algorithm in the fuzz testing pipeline. We first use the Koopman operator technique to construct a predictor model to capture the effect of time-varying inputs on the CPS behavior. Then, we use the model in a Model Predictive Control (MPC) optimization loop, generating control inputs that drive the system through state space. We evaluate the strategy's effectiveness through extensive experiments on the well-known neural network air-To-Air collision avoidance benchmark, ACAS Xu. Evaluation results prove that the proposed Koopman MPC approach achieves better test coverage than other fuzz testing and falsification tools.
KW - autonomous systems
KW - coverage
KW - cyber-physical systems
KW - fuzz testing
KW - Koopman surrogate model
KW - model predictive control
KW - test generation
UR - https://www.scopus.com/pages/publications/85215511799
U2 - 10.1109/SMC-IT61443.2024.00018
DO - 10.1109/SMC-IT61443.2024.00018
M3 - Conference contribution
AN - SCOPUS:85215511799
T3 - Proceedings - 2024 IEEE 10th International Conference on Space Mission Challenges for Information Technology, SMC-IT 2024
SP - 99
EP - 108
BT - Proceedings - 2024 IEEE 10th International Conference on Space Mission Challenges for Information Technology, SMC-IT 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 10th IEEE International Conference on Space Mission Challenges for Information Technology, SMC-IT 2024
Y2 - 15 July 2024 through 19 July 2024
ER -