Abstract
This paper proposes a novel approach to uncover deficiencies of the existing cyber-attack detection schemes and thereby to serve as a foundation for establishing more reliable cybersecure solutions, with particular application in DC microgrids. For this purpose, a multi-agent deep Reinforcement Learning (RL) based algorithm is proposed to automatically discover the vulnerable spots on the conventional index-based cyberattack detection schemes, and automatically generate coordinated stealthy destabilizing False Data Injection (FDI) attacks on cyberprotected islanded DC microgrids. To enable a continuous action space for the trained RL agents and enhance the algorithm’s precision and convergence rate, Deep Deterministic Policy Gradient DDPG) is incorporated. Using this approach, susceptibility of a state-of-the-art detection scheme to several different coordinated FDI attacks on the distributed communication links is identified. The proposed algorithm is also enhanced with a sniffing feature to enable maintaining the stealthy attacks even under the sudden disconnection of any of the compromised links. To address the discovered deficiencies within the index-based detection scheme, a complementary multi-agent RL detection algorithm using Deep Q-Network (DQN) is integrated, which provides a more reliable overall identification performance. Taking into account the communication delays and load changes, the effectiveness of the proposed algorithm is verified by the experimental tests.
Original language | English |
---|---|
Article number | 9633178 |
Journal | IEEE Transactions on Power Electronics |
Volume | 37 |
Issue number | 6 |
Pages (from-to) | 6359-6370 |
Number of pages | 12 |
ISSN | 0885-8993 |
DOIs | |
Publication status | Published - 2022 |
Keywords
- Distributed Control
- DC Microgrid
- Cybersecurity
- False Data Injection
- Reinforcement Learning