vix.ing · top · new · best · stats · spec

Secure Planning Against Stealthy Attacks via Model-Free Reinforcement\n Learning

2020/01/01 by Alper Kamil Bozkurt, Yu Wang, Bozkurt, Alper Kamil +3
Computer Science · Engineering · #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #Formal Methods in Verification #Physical Unclonable Functions (PUFs) and Hardware Security #Robotics (cs.RO) #Smart Grid Security and Resilience

paper · pdf · doi:10.48550/arxiv.2011.01882

openalex publication_date 2020/01/01 · openalex created_date 2022/07/25 · openalex updated_date 2026/07/28

Abstract

We consider the problem of security-aware planning in an unknown stochastic\nenvironment, in the presence of attacks on control signals (i.e., actuators) of\nthe robot. We model the attacker as an agent who has the full knowledge of the\ncontroller as well as the employed intrusion-detection system and who wants to\nprevent the controller from performing tasks while staying stealthy. We\nformulate the problem as a stochastic game between the attacker and the\ncontroller and present an approach to express the objective of such an agent\nand the controller as a combined linear temporal logic (LTL) formula. We then\nshow that the planning problem, described formally as the problem of satisfying\nan LTL formula in a stochastic game, can be solved via model-free reinforcement\nlearning when the environment is completely unknown. Finally, we illustrate and\nevaluate our methods on two robotic planning case studies.\n

Citations

Related