TY - GEN
T1 - Safe CPS from unsafe controllers
AU - Mehmood, Usama
AU - Bak, Stanley
AU - Smolka, Scott A.
AU - Stoller, Scott D.
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/5/19
Y1 - 2021/5/19
N2 - Modern cyber-physical systems (CPS) interact with the physical world, hence their correctness is important. In this work, we build upon the Simplex Architecture, where control authority may switch from an unverified and potentially unsafe advanced controller to a verified-safe baseline controller in order to maintain system safety. We take the approach further by lifting the requirement that the baseline controller must be verified or even correct, instead also treating it as a black-box component. This change is important; there are many types of powerful control techniques - -model predictive control and neural network controllers - -that often work well in practice, but are unlikely to be formally proven correct due to complexity. We prove such an architecture maintains safety, and present case studies where model-predictive control provides safety for multi-robot coordination, and unverified neural networks provably prevent collisions for groups of F-16 aircraft.
AB - Modern cyber-physical systems (CPS) interact with the physical world, hence their correctness is important. In this work, we build upon the Simplex Architecture, where control authority may switch from an unverified and potentially unsafe advanced controller to a verified-safe baseline controller in order to maintain system safety. We take the approach further by lifting the requirement that the baseline controller must be verified or even correct, instead also treating it as a black-box component. This change is important; there are many types of powerful control techniques - -model predictive control and neural network controllers - -that often work well in practice, but are unlikely to be formally proven correct due to complexity. We prove such an architecture maintains safety, and present case studies where model-predictive control provides safety for multi-robot coordination, and unverified neural networks provably prevent collisions for groups of F-16 aircraft.
KW - Cyber-physical systems
KW - Formal verification
KW - Simplex architecture
UR - https://www.scopus.com/pages/publications/85110580283
U2 - 10.1145/3457335.3461712
DO - 10.1145/3457335.3461712
M3 - Conference contribution
AN - SCOPUS:85110580283
T3 - Proceedings of 2021 Workshop on Computation-Aware Algorithmic Design for Cyber-Physical Systems, CAADCPS 2021
SP - 26
EP - 28
BT - Proceedings of 2021 Workshop on Computation-Aware Algorithmic Design for Cyber-Physical Systems, CAADCPS 2021
PB - Association for Computing Machinery, Inc
T2 - 021 Workshop on Computation-Aware Algorithmic Design for Cyber-Physical Systems, CAADCPS 2021
Y2 - 18 May 2021 through 21 May 2021
ER -